English
Related papers

Related papers: Zipf's law arises naturally in structured, high-di…

200 papers

In this paper, a statistical analysis of the structure of one blog community, a kind of social networks, is presented. The quantities such as degree distribution, clustering coefficient, average shortest path length are calculated to…

Statistics Theory · Mathematics 2007-06-13 Feng Fu , Lianghuan Liu , Kai Yang , Long Wang

We examine the relationship between two different types of ranked data, frequencies and magnitudes. We consider data that can be sorted out either way, through numbers of occurrences or size of the measures, as it is the case, say, of moon…

Statistical Mechanics · Physics 2017-12-13 Carlos Velarde , Alberto Robledo

We consider a simple model of firm/city/etc. growth based on a multi-item criterion: whenever entity B fares better that entity A on a subset of $M$ items out of $K$, the agent originally in A moves to B. We solve the model analytically in…

Statistical Mechanics · Physics 2018-04-11 José Moran , Jean-Philippe Bouchaud

Well known Simpson's paradox is puzzling and surprising for many, especially for the empirical researchers and users of statistics. However there is no surprise as far as mathematical details are concerned. A lot more is written about the…

Other Statistics · Statistics 2018-04-24 Priyantha Wijayatunga

Using an exhaustive list of Japanese bankruptcy in 1997, we discover a Zipf law for the distribution of total liabilities of bankrupted firms in high debt range. The life-time of these bankrupted firms has exponential distribution in…

Statistical Mechanics · Physics 2009-11-10 Yoshi Fujiwara

Gram's Law describes a pattern that frequently occurs in the distribution of the non-trivial zeros of the Riemann zeta function along the critical line. Whenever Gram's Law holds true, it reduces the difficulty of computing the…

Number Theory · Mathematics 2020-06-02 Cătălin Hanga , Christopher Hughes

Learning is a distinctive feature of intelligent behaviour. High-throughput experimental data and Big Data promise to open new windows on complex systems such as cells, the brain or our societies. Yet, the puzzling success of Artificial…

Machine Learning · Computer Science 2022-05-04 Matteo Marsili , Yasser Roudi

An asymptote is derived from Turing's local reestimation formula for population frequencies, and a local reestimation formula is derived from Zipf's law for the asymptotic behavior of population frequencies. The two are shown to be…

cmp-lg · Computer Science 2008-02-03 Christer Samuelsson

The Zipf distribution also known as scale-free distribution or discrete Pareto distribution, is the particular case of Power Law distribution with support the strictly positive integers. It is a one-parameter distribution with a linear…

Applications · Statistics 2013-04-29 Marta Pérez-Casany , Aina Casellas

We present an impossibility result, called a theorem about facts and words, which pertains to a general communication system. The theorem states that the number of distinct words used in a finite text is roughly greater than the number of…

Information Theory · Computer Science 2022-11-03 Łukasz Dębowski

Background: Zipf's law and Heaps' law are two representatives of the scaling concepts, which play a significant role in the study of complexity science. The coexistence of the Zipf's law and the Heaps' law motivates different understandings…

Physics and Society · Physics 2011-05-26 Lin Wang , Xiang Li , Yi-Qing Zhang , Yan Zhang , Kan Zhang

Tokenization is a fundamental step in natural language processing (NLP) and other sequence modeling domains, where the choice of vocabulary size significantly impacts model performance. Despite its importance, selecting an optimal…

Machine Learning · Computer Science 2025-07-31 Yanjin He , Qingkai Zeng , Meng Jiang

We present an overview of possible reasons for the appearance of heavy-tailed distributions in applications to the natural sciences. These distributions include the laws of Pareto, Lotka, and some new ones. The reasons are illustrated using…

Physics and Society · Physics 2023-01-24 Lev B. Klebanov , Yulia V. Kuvaeva

Background: Zipf's discovery that word frequency distributions obey a power law established parallels between biological and physical processes, and language, laying the groundwork for a complex systems perspective on human communication.…

Computation and Language · Computer Science 2009-11-11 Eduardo G. Altmann , Janet B. Pierrehumbert , Adilson E. Motter

Some of the progress in determining the phase boundaries of the nuclear phase diagram, the location of the critical point of the nuclear fragmentation phase transition, and the values of the critical exponents of this transition is…

Nuclear Theory · Physics 2007-05-23 Wolfgang Bauer , Brandon Alleman , Scott Pratt

In this paper we investigate the value of a social network with respect to the probability mechanism underlying its structure. Specifically, we compute the value for small world and scale free networks. We provide evidence in support of the…

Networking and Internet Architecture · Computer Science 2008-12-16 Sandeep Chalasani

Identifying statistical patterns characterizing human trajectories is crucial for public health, traffic engineering, city planning, and epidemic modeling. Recent developments in global positioning systems and mobile phone networks have…

The distribution of the population of cities has attracted a great deal of attention, in part because it sharply constrains models of local growth. However, to this day, there is no consensus on the distribution below the very upper tail,…

Physics and Society · Physics 2016-03-29 Hernan Rozenfeld , Diego Rybski , Xavier Gabaix , Hernan A. Makse

The frequency of the preferred order for a noun phrase formed by demonstrative, numeral, adjective and noun has received significant attention over the last two decades. We investigate the actual distribution of the 24 possible orders.…

Computation and Language · Computer Science 2026-01-23 Ramon Ferrer-i-Cancho

The law of proportionate growth simply states that the time dependent change of a quantity $x$ is proportional to $x$. Its applicability to a wide range of dynamic phenomena is based on various assumptions for the proportionality factor,…

Physics and Society · Physics 2019-09-04 Frank Schweitzer