English
Related papers

Related papers: Simple stochastic processes behind Menzerath's Law

200 papers

Mathematical models of biological neural networks are associated to a rich and complex class of stochastic processes. In this paper, we consider a simple {\em plastic} neural network whose {\em connectivity/synaptic strength} $(W(t))$…

Probability · Mathematics 2021-06-30 Philippe Robert , Gaetan Vignoud

We review recent progress in understanding the meaning of mutual information in natural language. Let us define words in a text as strings that occur sufficiently often. In a few previous papers, we have shown that a power-law distribution…

Information Theory · Computer Science 2020-03-11 Łukasz Dębowski

Ultraslow diffusion (i.e. logarithmic diffusion) has been extensively studied theoretically, but has hardly been observed empirically. In this paper, firstly, we find the ultraslow-like diffusion of the time-series of word counts of already…

Physics and Society · Physics 2018-07-25 Hayafumi Watanabe

We analyse a simple discrete-time stochastic process for the theoretical modeling of the evolution of protein lengths. At every step of the process a new protein is produced as a modification of one of the proteins already existing and its…

Populations and Evolution · Quantitative Biology 2009-11-13 C. Destri , C. Miccio

We demonstrate that large texts, representing human (English, Russian, Ukrainian) and artificial (C++, Java) languages, display quantitative patterns characterized by the Benford-like and Zipf laws. The frequency of a word following the…

Computation and Language · Computer Science 2018-03-13 Evgeny Shulzinger , Irina Legchenkova , Edward Bormashenko

We explain the ubiquity and extremely slow evolution of non gaussian out-of-equilibrium distributions for the Hamiltonian Mean-Field model, by means of traditional kinetic theory. Deriving the Fokker-Planck equation for a test particle, one…

Statistical Mechanics · Physics 2009-11-10 Freddy Bouchet , Thierry Dauxois

A curious observation was made that the rank statistics of scientific citation numbers follows Zipf-Mandelbrot's law. The same pow-like behavior is exhibited by some simple random citation models. The observed regularity indicates not so…

Physics and Society · Physics 2007-05-23 Z. K. Silagadze

Frequency-dependent acoustical loss due to a multitude of physical mechanisms is commonly modeled by multiple relaxations. For discrete relaxation distributions, such models correspond with causal wave equations of integer-order temporal…

Mathematical Physics · Physics 2013-03-27 Sven Peter Nasholm

We propose a stochastic model for the number of different words in a given database which incorporates the dependence on the database size and historical changes. The main feature of our model is the existence of two different classes of…

Physics and Society · Physics 2013-05-16 Martin Gerlach , Eduardo G. Altmann

We introduce a stochastic model to explain a double power-law distribution which exhibits two different Paretian behaviors in the upper and the lower tail and widely exists in social and economic systems. The model incorporates fitness…

Physics and Society · Physics 2011-04-25 D. D. Han , J. H. Qian , Y. G. Ma

The Swadesh approach for determining the temporal separation between two languages relies on the stochastic process of words replacement (when a complete new word emerges to represent a given concept). It is well known that the basic…

Computation and Language · Computer Science 2025-10-28 Maurizio Serva

The stochastic properties of variables whose addition leads to $q$-Gaussian distributions $G_q(x)=[1+(q-1)x^2]_+^{1/(1-q)}$ (with $q\in\mathbb{R}$ and where $[f(x)]_+=max\{f(x),0\}$) as limit law for a large number of terms are…

Statistical Mechanics · Physics 2009-11-10 C. Anteneodo

Statistical regularities in human language have fascinated researchers for decades, suggesting deep underlying principles governing its evolution and information structuring for efficient communication. While Zipf's Law describes the…

Physics and Society · Physics 2025-04-29 Alessandro Bellina , Vito D. P. Servedio

This paper develops an improved surrogate data test to show experimental evidence, for all the simple vowels of US English, for both male and female speakers, that Gaussian linear prediction analysis, a ubiquitous technique in current…

Chaotic Dynamics · Physics 2019-10-23 Max Little , Patrick E. McSharry , Irene M. Moroz , Stephen J. Roberts

From a grammar point of view, the role of punctuation marks in a sentence is formally defined and well understood. In semantic analysis punctuation plays also a crucial role as a method of avoiding ambiguity of the meaning. A different…

Computation and Language · Computer Science 2016-11-03 Andrzej Kulig , Jaroslaw Kwapien , Tomasz Stanisz , Stanislaw Drozdz

A multiplicative stochastic process with the lower bound lognormally distributed is investigated. For the process, the model is constructed, and its distribution function (involving four parameters) and the related statistical properties…

Data Analysis, Statistics and Probability · Physics 2024-01-19 Ken Yamamoto , Yoshihiro Yamazaki

The historical and geographical spread from older to more modern languages has long been studied by examining textual changes and in terms of changes in phonetic transcriptions. However, it is more difficult to analyze language change from…

Applications · Statistics 2017-05-19 Davide Pigoli , Pantelis Z. Hadjipantelis , John S. Coleman , John A. D. Aston

The Zipf's law is the major regularity of statistical linguistics that served as a prototype for rank-frequency relations and scaling laws in natural sciences. Here we show that the Zipf's law -- together with its applicability for a single…

Data Analysis, Statistics and Probability · Physics 2015-06-15 Armen E. Allahverdyan , Weibing Deng , Q. A. Wang

We report a detailed and systematic study of wave propagation through a stochastic absorbing random medium. Stochastic absorption is modeled by introducing an attenuation constant per unit length $\alpha$ in the free propagation region of…

Disordered Systems and Neural Networks · Physics 2007-05-23 Sandeep K. Joshi , Debendranath Sahoo , A. M. Jayannavar

We examine the asymptotic behaviour of the sample autocovariance in a continuous-time moving average model with long-range dependence. We show that it is either asymptotically Rosenblatt distributed or stable distributed. This shows that…

Probability · Mathematics 2015-11-24 Felix Spangenberg