Computational Linguistics | 2019

How to distinguish languages and dialects

 

Abstract


The terms ‘language’ and ‘dialect’ are ingrained but linguists nevertheless tend to agree that it is impossible to apply a non-arbitrary distinction such that two speech varieties can be identified as either distinct languages or two dialects of one and the same language. A database of lexical information for more than 7,500 speech varieties, however, unveils a strong tendency for linguistic distances to be bimodally distributed. For a given language group the linguistic distances pertaining to either cluster can be teased apart, identifying a mixture of normal distributions within the data and then separating them fitting curves and finding the point where they cross. The thresholds identified are remarkably consistent across datasets, qualifying their mean as a universal criterion for distinguishing between language and dialect pairs. The mean of the thresholds identified translates into a temporal distance of around one to one-and-a-half millennia (1075–1635 years).

Volume Just Accepted
Pages 1-10
DOI 10.1162/COLI_a_00366
Language English
Journal Computational Linguistics

Full Text