English
Related papers

Related papers: Randomness versus specifics for word-frequency dis…

200 papers

We analyse a generalisation of the Galam model of binary opinion dynamics in which iterative discussions take place in local groups of individuals and study the effects of random deviations from the group majority. The probability of a…

Physics and Society · Physics 2025-06-24 Gabor Toth

We study universal traits which emerge both in real-world complex datasets, as well as in artificially generated ones. Our approach is to analogize data to a physical system and employ tools from statistical physics and Random Matrix Theory…

Machine Learning · Computer Science 2024-04-08 Noam Levi , Yaron Oz

For words, rank-frequency distributions have long been heralded for adherence to a potentially-universal phenomenon known as Zipf's law. The hypothetical form of this empirical phenomenon was refined by Ben\^{i}ot Mandelbrot to that which…

Computation and Language · Computer Science 2017-10-24 Jake Ryland Williams , Giovanni C. Santia

Words in natural language follow a Zipfian distribution whereby some words are frequent but most are rare. Learning representations for words in the "long tail" of this distribution requires enormous amounts of data. Representations of rare…

Machine Learning · Computer Science 2018-03-08 Dzmitry Bahdanau , Tom Bosc , Stanisław Jastrzębski , Edward Grefenstette , Pascal Vincent , Yoshua Bengio

The task of finding a criterion allowing to distinguish a text from an arbitrary set of words is rather relevant in itself, for instance, in the aspect of development of means for internet-content indexing or separating signals and noise in…

Computation and Language · Computer Science 2007-10-02 D. V. Lande , A. A. Snarskii

In this paper, the joint distribution of the sum and maximum of independent, not necessarily identically distributed, nonnegative random variables is studied for two cases: i) continuous and ii) discrete random variables. First, a recursive…

Probability · Mathematics 2024-07-01 Christos N. Efrem

Probability distributions and densities are derived for the excess and deficiency of the intensity or instantaneous energy (quasi-static power) associated with a $p$-dimensional random vector field. Explicit expressions for the exact…

Data Analysis, Statistics and Probability · Physics 2021-08-27 Luk R. Arnaut

The word-stock of a language is a complex dynamical system in which words can be created, evolve, and become extinct. Even more dynamic are the short-term fluctuations in word usage by individuals in a population. Building on the recent…

Physics and Society · Physics 2013-04-09 Eduardo G. Altmann , Zakary L. Whichard , Adilson E. Motter

We study the girth of Cayley graphs of finite classical groups G on random sets of generators. Our main tool is an essentially best possible bound we obtain on the probability that a given word w takes the value 1 when evaluated in G in…

Group Theory · Mathematics 2019-03-25 Martin W. Liebeck , Aner Shalev

Zipf's law, which states that the probability of an observation is inversely proportional to its rank, has been observed in many domains. While there are models that explain Zipf's law in each of them, those explanations are typically…

Neurons and Cognition · Quantitative Biology 2016-07-06 Laurence Aitchison , Nicola Corradi , Peter E. Latham

The predictions of text classifiers are often driven by spurious correlations -- e.g., the term `Spielberg' correlates with positively reviewed movies, even though the term itself does not semantically convey a positive sentiment. In this…

Machine Learning · Computer Science 2020-10-07 Zhao Wang , Aron Culotta

The normal distribution is used as a unified probability distribution, however, our researcher found that it is not good agreed with the real-life dynamical system's data. We collected and analyzed representative naturally occurring data…

Dynamical Systems · Mathematics 2020-11-06 Wei Ping Cheng , Zhi Hong Zhang , Pu Wang

When generating text from probabilistic models, the chosen decoding strategy has a profound effect on the resulting text. Yet the properties elicited by various decoding strategies do not always transfer across natural language generation…

Computation and Language · Computer Science 2022-03-30 Gian Wiher , Clara Meister , Ryan Cotterell

The different between the inverse power function and the negative exponential function is significant. The former suggests a complex distribution, while the latter indicates a simple distribution. However, the association of the power-law…

Physics and Society · Physics 2018-12-19 Yanguang Chen

Systems as diverse as genetic networks or the world wide web are best described as networks with complex topology. A common property of many large networks is that the vertex connectivities follow a scale-free power-law distribution. This…

Disordered Systems and Neural Networks · Physics 2015-06-25 Albert-Laszlo Barabasi , Reka Albert

The paper revisits the investment simulation based on strategies exhibited by Generalized (m,2)-Zipf law to present an interesting characterization of the wildness in financial time series. The investigations of dominant strategies on each…

Physics and Society · Physics 2008-12-02 Hokky Situngkir , Yohanes Surya

Two large, open source software systems are analyzed from the vantage point of complex adaptive systems theory. For both systems, the full dependency graphs are constructed and their properties are shown to be consistent with the assumption…

Adaptation and Self-Organizing Systems · Physics 2010-01-19 G. A. Kohring

A theoretical framework is proposed for the understanding of verbal perception -- the conversion of words into meaning, modeled as a compromise between lexical demands and contextual constraints -- and the theory is tested against…

Neurons and Cognition · Quantitative Biology 2016-09-19 Francesco Fumarola

It is the common lore to assume that knowing the equation for the probability distribution function (PDF) of a stochastic model as a function of time tells the whole picture defining all other characteristics of the model. We show that this…

Statistical Mechanics · Physics 2013-05-29 Yasmine Meroz , Igor M. Sokolov , Joseph Klafter

When following a sequence - such as reading a text or tracking a user's activity - one can measure how the "dictionary" of distinct elements (types) grows with the number of observations (tokens). When this growth follows a power law, it is…

Physics and Society · Physics 2026-04-21 Célestin Zimmerlin , Thomas Louail , Manuel Moussallam , Marc Barthelemy