Automatic Identification and Production of Related Words for Historical Linguistics

Abstract

Language change across space and time is one of the main concerns in historical linguistics. In this article, we develop tools to assist researchers and domain experts in the study of language evolution. Firstly, we introduce a method to automatically determine if two words are cognates.We propose an algorithm for extracting cognates from electronic dictionaries that contain etymological information. Having built a dataset of related words, we further develop machine learning methods based on orthographic alignment for identifying cognates.We use aligned subsequences as features for classification algorithms in order to infer rules for linguistic changes undergone by words when entering new languages and to discriminate between cognates and non-cognates. Secondly, we extend the method to a finer-grained level, to identify the type of relationship between words. Discriminating between cognates and borrowings provides a deeper insight into the history of a language and allows a better characterization of language relatedness. We show that orthographic features have discriminative power and we analyze the underlying linguistic factors that prove relevant in the classification task. To our knowledge, this is the first attempt of this kind. Thirdly, we develop a machine learning method for automatically producing related words. We focus on reconstructing proto-words, but we also address two related sub-problems, producing modern word forms and producing cognates. The task of reconstructing proto-words consists in recreating the words in an ancient language from its modern daughter languages. Having modern word forms in multiple Romance languages, we infer the form of their common Latin ancestors. Our approach relies on the regularities that occurred when words entered the modern languages. We leverage information from several modern languages, building an ensemble system for reconstructing proto-words. We apply our method on multiple datasets, showing that our approach improves on previous results, having also has the advantage of requiring less input data, which is essential in historical linguistics, where resources are generally scarce.