English
Related papers

Related papers: Statistical Criticality arises in Most Informative…

200 papers

The problem of assigning probability distributions which objectively reflect the prior information available about experiments is one of the major stumbling blocks in the use of Bayesian methods of data analysis. In this paper the method of…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Ariel Caticha , Roland Preuss

Extropy, a complementary dual of entropy, (proposed by Lad et al. \cite{lad2015extropy} in 2015) has attracted considerable interest from the research community. In this study, we focus on discrete random variables and define conditional…

Information Theory · Computer Science 2025-07-16 Naveen Kumar , Vivek Vijay

We illustrate the mathematical theory of entropy production in repeated quantum measurement processes developed in a previous work by studying examples of quantum instruments displaying various interesting phenomena and singularities. We…

Mathematical Physics · Physics 2021-03-04 Tristan Benoist , Noé Cuneo , Vojkan Jakšić , Claude-Alain Pillet

Zipf's law is found when the vocabulary of long written texts is ranked according to the frequency of word occurrences, establishing a power-law decay for the frequency vs rank relation. This law is a robust statistical property observed…

Physics and Society · Physics 2020-02-17 Juan Ignacio Perotti , Orlando Vito Billoni

Here we sketch a new derivation of Zipf's law for word frequencies based on optimal coding. The structure of the derivation is reminiscent of Mandelbrot's random typing model but it has multiple advantages over random typing: (1) it starts…

Computation and Language · Computer Science 2020-09-24 Ramon Ferrer-i-Cancho

Zipf's law implies the statistical distributions of hyperbolic type, which can describe the properties of stability and entropy loss in linguistics. We present the information theory from which follows that if the system is described by…

Biological Physics · Physics 2014-03-31 K. Lukierska-Walasek , K. Topolski , K. Trojanowski

The Zipf's law establishes that if the words of a (large) text are ordered by decreasing frequency, the frequency versus the rank decreases as a power law with exponent close to $-1$. Previous work has stressed that this pattern arises from…

Physics and Society · Physics 2019-04-03 Felipe Urbina , Javier Vera

Generating function equation has been derived for the probability distribution of the number of nodes with $k \ge 0$ outgoing lines in randomly evolving special trees. The stochastic properties of end-nodes (k=0) have been analyzed, and it…

Statistical Mechanics · Physics 2007-05-23 L. Pal

The task of finding a criterion allowing to distinguish a text from an arbitrary set of words is rather relevant in itself, for instance, in the aspect of development of means for internet-content indexing or separating signals and noise in…

Computation and Language · Computer Science 2007-10-02 D. V. Lande , A. A. Snarskii

A statistical model for the fragmentation of a conserved quantity is analyzed, using the principle of maximum entropy and the theory of partitions. Upper and lower bounds for the restricted partitioning problem are derived and applied to…

Data Analysis, Statistics and Probability · Physics 2015-03-31 Joseph R. Iafrate , Steven J. Miller , Frederick W. Strauch

The optimal (`equilibrium') macroscopic properties of an economy with $N$ industries endowed with different technologies, $P$ commodities and one consumer are derived in the limit $N\to\infty$ with $n=N/P$ fixed using the replica method.…

Disordered Systems and Neural Networks · Physics 2008-12-02 A. De Martino , M. Marsili , I. Perez Castillo

We examine the relationship between two different types of ranked data, frequencies and magnitudes. We consider data that can be sorted out either way, through numbers of occurrences or size of the measures, as it is the case, say, of moon…

Statistical Mechanics · Physics 2017-12-13 Carlos Velarde , Alberto Robledo

We propose a new method for the calculation of the statistical properties, as e.g. the entropy, of unknown generators of symbolic sequences. The probability distribution p(k) of the elements k of a population can be approximated by the…

Statistical Mechanics · Physics 2015-06-24 Thorsten Poeschel , Werner Ebeling , Helge Rose

We study the relative entropy between the empirical estimate of a discrete distribution and the true underlying distribution. If the minimum value of the probability mass function exceeds an $\alpha > 0$ (i.e. when the true underlying…

Statistics Theory · Mathematics 2021-09-21 Alankrita Bhatt , Ankit Pensia

A path information is defined in connection with different possible paths of irregular dynamic systems moving in its phase space between two points. On the basis of the assumption that the paths are physically differentiated by their…

Statistical Mechanics · Physics 2007-05-23 Qiuping A. Wang

Causal processes can give rise to distinctive distributions in the linguistic variables that they affect. Consequently, a secure understanding of a variable's distribution can hold a key to understanding the forces that have causally shaped…

Computation and Language · Computer Science 2021-01-01 Jayden L. Macklin-Cordes , Erich R. Round

The random matrix ensembles (RME) of quantum statistical Hamiltonians, e.g. Gaussian random matrix ensembles (GRME) and Ginibre random matrix ensembles (Ginibre RME), are applied in literature to following quantum statistical systems:…

Statistical Mechanics · Physics 2007-05-23 Maciej M. Duras

We show why the amount of information communicated between the past and future--the excess entropy--is not in general the amount of information stored in the present--the statistical complexity. This is a puzzle, and a long-standing one,…

Statistical Mechanics · Physics 2013-05-29 James P. Crutchfield , Christopher J. Ellison , John R. Mahoney

Quantitative linguistics has provided us with a number of empirical laws that characterise the evolution of languages and competition amongst them. In terms of language usage, one of the most influential results is Zipf's law of word…

Physics and Society · Physics 2009-01-21 Alvaro Corral , Ramon Ferrer-i-Cancho , Gemma Boleda , Albert Diaz-Guilera , .

Data-driven most powerful tests are statistical hypothesis decision-making tools that deliver the greatest power against a fixed null hypothesis among all corresponding data-based tests of a given size. When the underlying data…

Statistics Theory · Mathematics 2023-03-15 Albert Vexler , Alan D. Hutson