English
Related papers

Related papers: Zipf's law arises naturally in structured, high-di…

200 papers

The empirical studies of city-size distribution show that Zipf's law and the hierarchical scaling law are linked in many ways. The rank-size scaling and hierarchical scaling seem to be two different sides of the same coin, but their…

Physics and Society · Physics 2018-12-21 Yanguang Chen

The study of complex systems is limited by the fact that only few variables are accessible for modeling and sampling, which are not necessarily the most relevant ones to explain the systems behavior. In addition, empirical data typically…

Data Analysis, Statistics and Probability · Physics 2013-11-04 Matteo Marsili , Iacopo Mastromatteo , Yasser Roudi

We address the role of multiplicative stochastic processes in modeling the occurrence of power-law city size distributions. As an explanation of the result of Zipf's rank analysis, Simon's model is presented in a mathematically elementary…

Physics and Society · Physics 2007-05-23 Damian H. Zanette

The dependence with text length of the statistical properties of word occurrences has long been considered a severe limitation quantitative linguistics. We propose a simple scaling form for the distribution of absolute word frequencies…

Physics and Society · Physics 2015-06-15 Francesc Font-Clos , Gemma Boleda , Álvaro Corral

Causal processes can give rise to distinctive distributions in the linguistic variables that they affect. Consequently, a secure understanding of a variable's distribution can hold a key to understanding the forces that have causally shaped…

Computation and Language · Computer Science 2021-01-01 Jayden L. Macklin-Cordes , Erich R. Round

We discuss the meaning of Zipf's law in nuclear multifragmentation. We remark that Zipf's law is a consequence of a power law fragment size distribution with exponent $\tau \simeq 2$. We also recall why the presence of such distribution is…

Statistical Mechanics · Physics 2009-11-11 Xavier Campi , Hubert Krivine

The binary many-step Markov chain with the step-like memory function is considered as a model for the analysis of rank distributions of words in stochastic symbolic dynamical systems. We prove that the envelope curve for this distribution…

History and Philosophy of Physics · Physics 2007-05-23 K. E. Kechedzhy O. V. Usatenko , V. A. Yampol'skii

This paper studies the limits of language models' statistical learning in the context of Zipf's law. First, we demonstrate that Zipf-law token distribution emerges irrespective of the chosen tokenization. Second, we show that Zipf…

Computation and Language · Computer Science 2022-11-22 Elizaveta Zhemchuzhina , Nikolai Filippov , Ivan P. Yamshchikov

The spatial distribution of people exhibits clustering across a wide range of scales, from household ($\sim 10^{-2}$ km) to continental ($\sim 10^4$ km) scales. Empirical data indicates simple power-law scalings for the size distribution of…

Physics and Society · Physics 2016-03-23 Henry W. Lin , Abraham Loeb

The availability of large datasets requires an improved view on statistical laws in complex systems, such as Zipf's law of word frequencies, the Gutenberg-Richter law of earthquake magnitudes, or scale-free degree distribution in networks.…

Data Analysis, Statistics and Probability · Physics 2019-04-30 Martin Gerlach , Eduardo G. Altmann

The word-frequency distribution provides the fundamental building blocks that generate discourse in language. It is well known, from empirical evidence, that the word-frequency distribution of almost any text is described by Zipf's law, at…

Physics and Society · Physics 2020-11-09 Alvaro Corral , Montserrat Garcia del Muro

Zipf's law predicts a power-law relationship between word rank and frequency in language communication systems and has been widely reported in a variety of natural language processing applications. However, the emergence of natural language…

Computation and Language · Computer Science 2018-12-05 Bohdan Khomtchouk , Shyam Sudhakaran

We statistically investigate the distribution of share price and the distributions of three common financial indicators using data from approximately 8,000 companies publicly listed worldwide for the period 2004-2013. We find that the…

Economics · Quantitative Finance 2017-02-02 Taisei Kaizoji , Michiko Miyano

The distribution of word probabilities in the monkey model of Zipf's law is associated with two universality properties: (1) the power law exponent converges strongly to $-1$ as the alphabet size increases and the letter probabilities are…

Probability · Mathematics 2016-04-20 Richard Perline , Ronald Perline

The task of text segmentation may be undertaken at many levels in text analysis---paragraphs, sentences, words, or even letters. Here, we focus on a relatively fine scale of segmentation, hypothesizing it to be in accord with a stochastic…

We explore a probabilistic model of an artistic text: words of the text are chosen independently of each other in accordance with a discrete probability distribution on an infinite dictionary. The words are enumerated 1, 2, $\ldots$, and…

Statistics Theory · Mathematics 2019-05-02 Mikhail Chebunin , Artyom Kovalevskii

Zipf's law defines an inverse proportion between a word's ranking in a given corpus and its frequency in it, roughly dividing the vocabulary into frequent words and infrequent ones. Here, we stipulate that within a domain an author's…

Computation and Language · Computer Science 2022-02-24 Osnat Mokryn , Hagit Ben-Shoshan

The evolution of open source software projects in Linux distributions offers a remarkable example of a growing complex self-organizing adaptive system, exhibiting Zipf's law over four full decades. We present three tests of the usually…

Data Analysis, Statistics and Probability · Physics 2014-08-26 T. Maillart , D. Sornette , S. Spaeth , G. Von Krogh

Zipf's law in the field of linguistics is tested in the nuclear disassembly within the framework of isospin dependent lattice gas model. It is found that the average cluster charge (or mass) of rank $n$ in the charge (or mass) list shows…

Nuclear Theory · Physics 2007-05-23 Y. G. Ma

Stochastic equations constitute a major ingredient in many branches of science, from physics to biology and engineering. Not surprisingly, they appear in many quantitative studies of complex systems. In particular, this type of equation is…

Physics and Society · Physics 2023-08-02 Marc Barthelemy
‹ Prev 1 4 5 6 7 8 10 Next ›