English
Related papers

Related papers: Exploring the Zipf Distribution Through the Lens o…

200 papers

With Zipf's law being originally and most famously observed for word frequency, it is surprisingly limited in its applicability to human language, holding over no more than three to four orders of magnitude before hitting a clear break in…

Computation and Language · Computer Science 2015-03-05 Jake Ryland Williams , Paul R. Lessard , Suma Desu , Eric Clark , James P. Bagrow , Christopher M. Danforth , Peter Sheridan Dodds

The Poisson distribution is often used as a standard model for count data. Quite often, however, such data sets are not well fit by a Poisson model because they have more zeros than are compatible with this model. For these situations, a…

Statistics Theory · Mathematics 2008-12-18 M. J. Bayarri , James O. Berger , Gauri S. Datta

Background: Zipf's discovery that word frequency distributions obey a power law established parallels between biological and physical processes, and language, laying the groundwork for a complex systems perspective on human communication.…

Computation and Language · Computer Science 2009-11-11 Eduardo G. Altmann , Janet B. Pierrehumbert , Adilson E. Motter

We consider the following variant of the classic collector's problem: The family of coupon probabilities is the mixing of two subfamilies one of which is the \textit{uniform} family, while the other belongs to the well known \textit{Zipf…

Probability · Mathematics 2019-04-23 Aristides V. Doumas , Vassilis G. Papanicolaou

We investigate the distribution of the depth of a node containing a specific key or, equivalently, the number of steps needed to retrieve an item stored in a randomly grown binary search tree. Using a representation in terms of mixed and…

Probability · Mathematics 2007-05-23 Rudolf Grubel , Nikolce Stefanoski

Mixture distributions are extensively used as a modeling tool in diverse areas from machine learning to communications engineering to physics, and obtaining bounds on the entropy of probability distributions is of fundamental importance in…

Information Theory · Computer Science 2022-12-05 James Melbourne , Saurav Talukdar , Shreyas Bhaban , Mokshay Madiman , Murti V. Salapaka

In this article, I conduct a textual and contextual analysis of the empirical literature on Zipf's law for cities. Building on previous meta-analysis material openly available, I collect full texts and bibliographies of 66 scientific…

Physics and Society · Physics 2022-02-01 Clémentine Cottineau

Stacy distribution defined for the first time in 1961 provides a flexible framework for modelling of a wide range of real-life behaviours. It appears under different names in the scientific literature and contains many useful particular…

Probability · Mathematics 2023-03-21 Pavlina K. Jordanova , Mladen Savov , Assen Tchorbadjieff , Milan Stehlík

A tempered version of the discrete Linnik distribution is introduced in order to obtain integer-valued distribution families connected to stable laws. The proposal constitutes a generalization of the well-known Poisson-Tweedie law, which is…

Statistics Theory · Mathematics 2016-05-10 Lucio Barabesi , Carolina Becatti , Marzia Marcheselli

We show how generalized Gibbs-Shannon entropies can provide new insights on the statistical properties of texts. The universal distribution of word frequencies (Zipf's law) implies that the generalized entropies, computed at the word level,…

Physics and Society · Physics 2017-02-15 Eduardo G. Altmann , Laercio Dias , Martin Gerlach

Based on the probability generating function of stuttering Poisson distribution (SPD), this paper considers some equivalent propositions of SPD. From this, we show that some distributions in the application of non-life insurance actuarial…

Statistics Theory · Mathematics 2015-04-01 Huiming Zhang , Lili Chu , Yu Diao

We investigate the origin of Zipf's law for words in written texts by means of a stochastic dynamical model for text generation. The model incorporates both features related to the general structure of languages and memory effects inherent…

Statistical Mechanics · Physics 2007-05-23 Damián H. Zanette , Marcelo A. Montemurro

We examine a generalization of the binomial distribution associated with a strictly increasing sequence of numbers and we prove its Poisson-like limit. Such generalizations might be found in quantum optics with imperfect detection. We…

Mathematical Physics · Physics 2015-05-28 E. M. F. Curado , J. P. Gazeau , Ligia M. C. S. Rodrigues

We checked that the distribution of words in text should uniform, which gives Heaps' law as natural result, that is, the number of types of words can be expressed as a power law of the number of tokens within text. We developed a…

Physics and Society · Physics 2025-04-16 Kim Chol-jun

This paper presents an extensive survey of regular distributions in natural and social sciences. The survey includes studies from a wide scope of academic disciplines, in order to create an inventory of the different mathematical functions…

Physics and Society · Physics 2015-07-14 L. Benguigui , M. Marinov

We perform a quantitative analysis of extensive chess databases and show that the frequencies of opening moves are distributed according to a power-law with an exponent that increases linearly with the game depth, whereas the pooled…

Physics and Society · Physics 2009-11-18 B. Blasius , R. Toenjes

Count data are omnipresent in many applied fields, often with overdispersion due to an excess of zeroes or extreme values. With mixtures of Poisson distributions representing an elegant and appealing modelling strategy, we focus here on the…

Statistics Theory · Mathematics 2022-04-25 Samuel Valiquette , Frédéric Mortier , Jean Peyhardi , Gwladys Toulemonde

The word-frequency distribution provides the fundamental building blocks that generate discourse in language. It is well known, from empirical evidence, that the word-frequency distribution of almost any text is described by Zipf's law, at…

Physics and Society · Physics 2020-11-09 Alvaro Corral , Montserrat Garcia del Muro

The Poisson distribution is the probability distribution of the number of independent events in a given period of time. Although the Poisson distribution appears ubiquitously in various stochastic dynamics of gene expression, both as…

Statistical Mechanics · Physics 2024-10-02 Julian Lee

A three-parameter discrete distribution is developed to describe the multiplicity distributions observed in total- and limited phase space volumes in different collision processes. The probability law is obtained by the Poisson transform of…

High Energy Physics - Phenomenology · Physics 2009-10-28 S. Hegyi