English
Related papers

Related papers: Zipf's law arises naturally in structured, high-di…

200 papers

According to Zipf's meaning-frequency law, words that are more frequent tend to have more meanings. Here it is shown that a linear dependency between the frequency of a form and its number of meanings is found in a family of models of…

Computation and Language · Computer Science 2016-10-14 Ramon Ferrer-i-Cancho

Zipf's law states that sequential frequencies of words in a text correspond to a power function. Its probabilistic model is an infinite urn scheme with asymptotically power distribution. The exponent of this distribution must be estimated.…

Statistics Theory · Mathematics 2017-06-15 Mikhail Chebunin , Artyom Kovalevskii

Languages across the world exhibit Zipf's law of abbreviation, namely more frequent words tend to be shorter. The generalized version of the law - an inverse relationship between the frequency of a unit and its magnitude - holds also for…

Information Theory · Computer Science 2016-05-05 R. Ferrer-i-Cancho , C. Bentz , C. Seguin

This work proves that ranks and shares are statistically dependent on one another, based on simple combinatorics. It presents a formula for rank-share distribution and illustrates that Zipfs law, is descended from expected values of various…

Other Statistics · Statistics 2017-05-24 A Shyklo

As the most fundamental empirical law, Zipf's law has been studied from many aspects. But its meaning is still an open problem. Some models have been constructed to explain Zipf's law. In the letter, a new concept named nonsymmetric entropy…

Disordered Systems and Neural Networks · Physics 2007-05-23 Chengshi Liu

It is traditionally assumed that Zipf's law implies the power-law growth of the number of different elements with the total number of elements in a system - the so-called Heaps' law. We show that a careful definition of Zipf's law leads to…

Physics and Society · Physics 2015-06-17 Francesc Font-Clos , Alvaro Corral

A curious observation was made that the rank statistics of scientific citation numbers follows Zipf-Mandelbrot's law. The same pow-like behavior is exhibited by some simple random citation models. The observed regularity indicates not so…

Physics and Society · Physics 2007-05-23 Z. K. Silagadze

Background: Zipf's law and Heaps' law are observed in disparate complex systems. Of particular interests, these two laws often appear together. Many theoretical models and analyses are performed to understand their co-occurrence in real…

Data Analysis, Statistics and Probability · Physics 2010-12-20 Linyuan Lu , Zi-Ke Zhang , Tao Zhou

A set of data with positive values follows a Pareto distribution if the log-log plot of value versus rank is approximately a straight line. A Pareto distribution satisfies Zipf's law if the log-log plot has a slope of -1. Since many types…

Economics · Quantitative Finance 2020-06-04 Ricardo T. Fernholz , Robert Fernholz

Zipf's law is just one out of many universal laws proposed to describe statistical regularities in language. Here we review and critically discuss how these laws can be statistically interpreted, fitted, and tested (falsified). The modern…

Physics and Society · Physics 2016-05-27 Eduardo G. Altmann , Martin Gerlach

In a language corpus, the probability that a word occurs $n$ times is often proportional to $1/n^2$. Assigning rank, $s$, to words according to their abundance, $\log s$ vs $\log n$ typically has a slope of minus one. That simple Zipf's law…

Populations and Evolution · Quantitative Biology 2019-03-27 Steven A. Frank

Why does Zipf's law give a good description of data from seemingly completely unrelated phenomena? Here it is argued that the reason is that they can all be described as outcomes of a ubiquitous random group division: the elements can be…

Physics and Society · Physics 2015-03-19 Seung Ki Baek , Sebastian Bernhardsson , Petter Minnhagen

Zipf's law is found when the vocabulary of long written texts is ranked according to the frequency of word occurrences, establishing a power-law decay for the frequency vs rank relation. This law is a robust statistical property observed…

Physics and Society · Physics 2020-02-17 Juan Ignacio Perotti , Orlando Vito Billoni

Zipf's law is the main regularity of quantitative linguistics. Despite of many works devoted to foundations of this law, it is still unclear whether it is only a statistical regularity, or it has deeper relations with information-carrying…

Computation and Language · Computer Science 2018-09-25 Weibing Deng , Armen E. Allahverdyan

In this second part of our survey on the social and natural distributions, we investigate some models, which intend to explain the statistical regularity of the natural and social distributions. There is a large variety of models and in…

Physics and Society · Physics 2016-07-05 L. Benguigui , M. Marinov

Zipf's power law is a general empirical regularity found in many natural and social systems. A recently developed theory predicts that Zipf's law corresponds to systems that are growing according to a maximally sustainable path in the…

Physics and Society · Physics 2015-05-19 Qunzhi Zhang , Didier Sornette

Zipf's law is a fundamental paradigm in the statistics of written and spoken natural language as well as in other communication systems. We raise the question of the elementary units for which Zipf's law should hold in the most natural way,…

Physics and Society · Physics 2015-07-14 Alvaro Corral , Gemma Boleda , Ramon Ferrer-i-Cancho

The Zipf's law establishes that if the words of a (large) text are ordered by decreasing frequency, the frequency versus the rank decreases as a power law with exponent close to $-1$. Previous work has stressed that this pattern arises from…

Physics and Society · Physics 2019-04-03 Felipe Urbina , Javier Vera

The prevailing maximum likelihood estimators for inferring power law models from rank-frequency data are biased. The source of this bias is an inappropriate likelihood function. The correct likelihood function is derived and shown to be…

Applications · Statistics 2021-07-27 Charlie Pilgrim , Thomas T Hills

The formation of sentences is a highly structured and history-dependent process. The probability of using a specific word in a sentence strongly depends on the 'history' of word-usage earlier in that sentence. We study a simple…

Physics and Society · Physics 2015-05-28 Stefan Thurner , Rudolf Hanel , Bo Liu , Bernat Corominas-Murtra