English
Related papers

Related papers: A universal model for languages and cities, and th…

200 papers

In this article, we evaluate computational models of natural language with respect to the universal statistical behaviors of natural language. Statistical mechanical analyses have revealed that natural language text is characterized by…

Computation and Language · Computer Science 2019-06-25 Shuntaro Takahashi , Kumiko Tanaka-Ishii

Many complex generative systems use languages to create structured objects. We consider a model of random languages, defined by weighted context-free grammars. As the distribution of grammar weights broadens, a transition is found from a…

Disordered Systems and Neural Networks · Physics 2019-04-03 E. DeGiuli

Cultural competition has throughout our history shaped and reshaped the geography of boundaries between humans. Language and culture are intimately connected and linguists often use distinctive keywords to quantify the dynamics of…

Physics and Society · Physics 2015-05-27 Ludvig Lizana , Namiko Mitarai , Hiizu Nakanishi , Kim Sneppen

We perform a quantitative analysis of extensive chess databases and show that the frequencies of opening moves are distributed according to a power-law with an exponent that increases linearly with the game depth, whereas the pooled…

Physics and Society · Physics 2009-11-18 B. Blasius , R. Toenjes

Using population data of high spatial resolution for a region in the south of Europe, we define cities by aggregating individuals to form connected clusters. The resulting cluster-population distributions show a smooth decreasing behavior…

Physics and Society · Physics 2020-11-10 Alvaro Corral , Frederic Udina , Elsa Arcaute

Motivated by the dramatic disappearance of endangered languages observed in recent years, a great deal of attention has been given to the modeling of language competition in order to understand the factors that promote the disappearance of…

Physics and Society · Physics 2024-01-09 Christos Charalambous , David Sanchez , Raul Toral

We consider a simple model of firm/city/etc. growth based on a multi-item criterion: whenever entity B fares better that entity A on a subset of $M$ items out of $K$, the agent originally in A moves to B. We solve the model analytically in…

Statistical Mechanics · Physics 2018-04-11 José Moran , Jean-Philippe Bouchaud

The task of text segmentation may be undertaken at many levels in text analysis---paragraphs, sentences, words, or even letters. Here, we focus on a relatively fine scale of segmentation, hypothesizing it to be in accord with a stochastic…

We present a broad, phenomenological picture of the distribution of the length of open space linear segments, $l$, derived from maps of 36 cities in 14 different countries. By scaling the Zipf plot of $l$, we obtain two master curves for a…

Statistical Mechanics · Physics 2007-05-23 Rui Carvalho , Alan Penn

Some authors have recently argued that a finite-size scaling law for the text-length dependence of word-frequency distributions cannot be conceptually valid. Here we give solid quantitative evidence for the validity of such scaling law,…

Data Analysis, Statistics and Probability · Physics 2018-04-12 Alvaro Corral , Francesc Font-Clos

The word-frequency distribution provides the fundamental building blocks that generate discourse in language. It is well known, from empirical evidence, that the word-frequency distribution of almost any text is described by Zipf's law, at…

Physics and Society · Physics 2020-11-09 Alvaro Corral , Montserrat Garcia del Muro

The processes leading to change in languages are manifold. In order to reduce ambiguity in the transmission of information, agreement on a set of conventions for recurring problems is favored. In addition to that, speakers tend to use…

Physics and Society · Physics 2015-06-17 Cristina-Maria Pop , Erwin Frey

We introduce an auto-regressive model which captures the growing nature of realistic markets. In our model agents do not trade with other agents, they interact indirectly only through a market. Change of their wealth depends, linearly on…

General Finance · Quantitative Finance 2009-07-28 Urna Basu , P. K. Mohanty

We introduce a new class of models in which a large number of "agents" organize under the influence of an externally imposed coherent noise. The model shows reorganization events whose size distribution closely follows a power law over many…

Condensed Matter · Physics 2009-10-28 Kim Sneppen , M. E. J. Newman

Most of various large-size complex systems in nature and society can be well described as complex networks (graphs) to better understand the evolutional mechanisms and dynamical functions behind themselves. Of some part follow scale-free…

Physics and Society · Physics 2023-08-08 Fei Ma

Using the Schulze model for Monte Carlo simulations of language competition, we include a barrier between the top half and the bottom half of the lattice. We check under which conditions two different languages evolve as dominating in the…

Physics and Society · Physics 2009-11-13 Christian Schulze , Dietrich Stauffer

We show how generalized Gibbs-Shannon entropies can provide new insights on the statistical properties of texts. The universal distribution of word frequencies (Zipf's law) implies that the generalized entropies, computed at the word level,…

Physics and Society · Physics 2017-02-15 Eduardo G. Altmann , Laercio Dias , Martin Gerlach

In this second part of our survey on the social and natural distributions, we investigate some models, which intend to explain the statistical regularity of the natural and social distributions. There is a large variety of models and in…

Physics and Society · Physics 2016-07-05 L. Benguigui , M. Marinov

The joint probability distribution of many degrees of freedom in biological systems, such as firing patterns in neural networks or antibody sequence composition in zebrafish, often follow Zipf's law, where a power law is observed on a…

Neurons and Cognition · Quantitative Biology 2014-08-13 David J. Schwab , Ilya Nemenman , Pankaj Mehta

The article introduces corrections to Zipf's and Heaps' laws based on systematic models of the proportion of hapaxes, i.e., words that occur once. The derivation rests on two assumptions: The first one is the standard urn model which…

Computation and Language · Computer Science 2025-05-27 Łukasz Dębowski