English
Related papers

Related papers: Cognitive Limits Shape Language Statistics

200 papers

Zipf's law establishes a scaling behavior for word-frequencies in large text corpora. The appearance of Zipfian properties in human language has been previously explained as an optimization problem for the interests of speakers and hearers.…

Physics and Society · Physics 2021-02-24 Javier Vera , Felipe Urbina , Wenceslao Palma

According to Zipf's meaning-frequency law, words that are more frequent tend to have more meanings. Here it is shown that a linear dependency between the frequency of a form and its number of meanings is found in a family of models of…

Computation and Language · Computer Science 2016-10-14 Ramon Ferrer-i-Cancho

Zipf's law seems to be ubiquitous in human languages and appears to be a universal property of complex communicating systems. Following the early proposal made by Zipf concerning the presence of a tension between the efforts of speaker and…

Adaptation and Self-Organizing Systems · Physics 2015-05-19 Bernat Corominas-Murtra , Jordi Fortuny , Ricard V. Solé

Zipf's law is just one out of many universal laws proposed to describe statistical regularities in language. Here we review and critically discuss how these laws can be statistically interpreted, fitted, and tested (falsified). The modern…

Physics and Society · Physics 2016-05-27 Eduardo G. Altmann , Martin Gerlach

Zipf's law on word frequency is observed in English, French, Spanish, Italian, and so on, yet it does not hold for Chinese, Japanese or Korean characters. A model for writing process is proposed to explain the above difference, which takes…

Data Analysis, Statistics and Probability · Physics 2013-05-03 Linyuan Lu , Zi-Ke Zhang , Tao Zhou

With Zipf's law being originally and most famously observed for word frequency, it is surprisingly limited in its applicability to human language, holding over no more than three to four orders of magnitude before hitting a clear break in…

Computation and Language · Computer Science 2015-03-05 Jake Ryland Williams , Paul R. Lessard , Suma Desu , Eric Clark , James P. Bagrow , Christopher M. Danforth , Peter Sheridan Dodds

We use the formulation of equilibrium statistical mechanics in order to study some important characteristics of language. Using a simple expression for the Hamiltonian of a language system, which is directly implied by the Zipf law, we are…

Physics and Society · Physics 2009-11-11 Kosmas Kosmidis , Alkiviadis Kalampokis , Panos Argyrakis

Zipf's law predicts a power-law relationship between word rank and frequency in language communication systems, and is widely reported in texts yet remains enigmatic as to its origins. Computer simulations have shown that language…

Physics and Society · Physics 2016-04-04 Bohdan B. Khomtchouk , Claes Wahlestedt

The inverse relationship between the length of a word and the frequency of its use, first identified by G.K. Zipf in 1935, is a classic empirical law that holds across a wide range of human languages. We demonstrate that length is one…

Computation and Language · Computer Science 2017-06-02 Stephan C. Meylan , Thomas L. Griffiths

Background: Zipf's discovery that word frequency distributions obey a power law established parallels between biological and physical processes, and language, laying the groundwork for a complex systems perspective on human communication.…

Computation and Language · Computer Science 2009-11-11 Eduardo G. Altmann , Janet B. Pierrehumbert , Adilson E. Motter

Zipf's law in language lacks a definitive origin, debated across fields. This study explains Zipf-like behavior using geometric mechanisms without linguistic elements. The Full Combinatorial Word Model (FCWM) forms words from a finite…

Methodology · Statistics 2025-11-27 Vladimir Berman

Languages across the world exhibit Zipf's law of abbreviation, namely more frequent words tend to be shorter. The generalized version of the law - an inverse relationship between the frequency of a unit and its magnitude - holds also for…

Information Theory · Computer Science 2016-05-05 R. Ferrer-i-Cancho , C. Bentz , C. Seguin

The Zipf's law is the major regularity of statistical linguistics that served as a prototype for rank-frequency relations and scaling laws in natural sciences. Here we show that the Zipf's law -- together with its applicability for a single…

Data Analysis, Statistics and Probability · Physics 2015-06-15 Armen E. Allahverdyan , Weibing Deng , Q. A. Wang

Despite renewed interest in emergent language simulations with neural networks, little is known about the basic properties of the induced code, and how they compare to human language. One fundamental characteristic of the latter, known as…

Computation and Language · Computer Science 2019-10-16 Rahma Chaabouni , Eugene Kharitonov , Emmanuel Dupoux , Marco Baroni

An important body of quantitative linguistics is constituted by a series of statistical laws about language usage. Despite the importance of these linguistic laws, some of them are poorly formulated, and, more importantly, there is no…

Physics and Society · Physics 2020-11-09 Alvaro Corral , Isabel Serra

The mapping of lexical meanings to wordforms is a major feature of natural languages. While usage pressures might assign short words to frequent meanings (Zipf's law of abbreviation), the need for a productive and open-ended vocabulary,…

Computation and Language · Computer Science 2021-05-04 Tiago Pimentel , Irene Nikkarinen , Kyle Mahowald , Ryan Cotterell , Damián Blasi

Zipf's law is found when the vocabulary of long written texts is ranked according to the frequency of word occurrences, establishing a power-law decay for the frequency vs rank relation. This law is a robust statistical property observed…

Physics and Society · Physics 2020-02-17 Juan Ignacio Perotti , Orlando Vito Billoni

The formation of sentences is a highly structured and history-dependent process. The probability of using a specific word in a sentence strongly depends on the 'history' of word-usage earlier in that sentence. We study a simple…

Physics and Society · Physics 2015-05-28 Stefan Thurner , Rudolf Hanel , Bo Liu , Bernat Corominas-Murtra

Zipf's law is the main regularity of quantitative linguistics. Despite of many works devoted to foundations of this law, it is still unclear whether it is only a statistical regularity, or it has deeper relations with information-carrying…

Computation and Language · Computer Science 2018-09-25 Weibing Deng , Armen E. Allahverdyan

We analyze the occurrence frequencies of over 15 million words recorded in millions of books published during the past two centuries in seven different languages. For all languages and chronological subsets of the data we confirm that two…

Physics and Society · Physics 2012-12-12 Alexander M. Petersen , Joel N. Tenenbaum , Shlomo Havlin , H. Eugene Stanley , Matjaz Perc