English
Related papers

Related papers: Relating Zipf's law to textual information

200 papers

An important body of quantitative linguistics is constituted by a series of statistical laws about language usage. Despite the importance of these linguistic laws, some of them are poorly formulated, and, more importantly, there is no…

Physics and Society · Physics 2020-11-09 Alvaro Corral , Isabel Serra

Zipf's law describes the empirical size distribution of the components of many systems in natural and social sciences and humanities. We show, by solving a statistical model, that Zipf's law co-occurs with the maximization of the diversity…

Statistical Mechanics · Physics 2021-10-05 Onofrio Mazzarisi , Amanda de Azevedo-Lopes , Jeferson J. Arenzon , Federico Corberi

Zipf's law is found when the vocabulary of long written texts is ranked according to the frequency of word occurrences, establishing a power-law decay for the frequency vs rank relation. This law is a robust statistical property observed…

Physics and Society · Physics 2020-02-17 Juan Ignacio Perotti , Orlando Vito Billoni

In this study, we investigate whether speech symbols, learned through deep learning, follow Zipf's law, akin to natural language symbols. Zipf's law is an empirical law that delineates the frequency distribution of words, forming…

Computation and Language · Computer Science 2023-09-19 Shinnosuke Takamichi , Hiroki Maeda , Joonyong Park , Daisuke Saito , Hiroshi Saruwatari

We checked that the distribution of words in text should uniform, which gives Heaps' law as natural result, that is, the number of types of words can be expressed as a power law of the number of tokens within text. We developed a…

Physics and Society · Physics 2025-04-16 Kim Chol-jun

The frequencies at which individual words occur across languages follow power law distributions, a pattern of findings known as Zipf's law. A vast literature argues over whether this serves to optimize the efficiency of human communication,…

Computation and Language · Computer Science 2020-01-16 Michael Ramscar

In his pioneering research, G. K. Zipf formulated a couple of statistical laws on the relationship between the frequency of a word with its number of meanings: the law of meaning distribution, relating the frequency of a word and its…

Computation and Language · Computer Science 2022-01-19 Neus Català , Jaume Baixeries , Ramon Ferrer-Cancho , Lluís Padró , Antoni Hernández-Fernández

Quantitative linguistics has provided us with a number of empirical laws that characterise the evolution of languages and competition amongst them. In terms of language usage, one of the most influential results is Zipf's law of word…

Physics and Society · Physics 2009-01-21 Alvaro Corral , Ramon Ferrer-i-Cancho , Gemma Boleda , Albert Diaz-Guilera , .

Zipf's law is a hallmark of several complex systems with a modular structure, such as books composed by words or genomes composed by genes. In these component systems, Zipf's law describes the empirical power law distribution of component…

Statistical Mechanics · Physics 2018-12-05 Andrea Mazzolini , Alberto Colliva , Michele Caselle , Matteo Osella

Zipf's law for cities is probably the most famous regularity in social sciences. So much that, a hundred years of publication later, its status is not clear: is it a law of social organisation? Is it an instrument of description of city…

Physics and Society · Physics 2017-10-10 Clementine Cottineau

Entity extraction is critical in the intelligent advancement across diverse domains. Nevertheless, a challenge to its effectiveness arises from the data imbalance. This paper proposes a novel approach by viewing the issue through the…

Computation and Language · Computer Science 2023-09-04 Zhenhua Wang , Ming Ren , Dong Gao , Zhuang Li

In his pioneering research, G. K. Zipf observed that more frequent words tend to have more meanings, and showed that the number of meanings of a word grows as the square root of its frequency. He derived this relationship from two…

Computation and Language · Computer Science 2020-09-24 Ramon Ferrer-i-Cancho , Michael S. Vitevitch

Zipf's law in its basic incarnation is an empirical probability distribution governing the frequency of usage of words in a language. As Terence Tao recently remarked, it still lacks a convincing and satisfactory mathematical explanation.…

Information Theory · Computer Science 2013-04-30 Yuri I. Manin

Zipf's law in language lacks a definitive origin, debated across fields. This study explains Zipf-like behavior using geometric mechanisms without linguistic elements. The Full Combinatorial Word Model (FCWM) forms words from a finite…

Methodology · Statistics 2025-11-27 Vladimir Berman

From a grammar point of view, the role of punctuation marks in a sentence is formally defined and well understood. In semantic analysis punctuation plays also a crucial role as a method of avoiding ambiguity of the meaning. A different…

Computation and Language · Computer Science 2016-11-03 Andrzej Kulig , Jaroslaw Kwapien , Tomasz Stanisz , Stanislaw Drozdz

Zipf's law is a paradigm describing the importance of different elements in communication systems, especially in linguistics. Despite the complexity of the hierarchical structure of language, music has in some sense an even more complex…

Physics and Society · Physics 2023-11-20 Marc Serra-Peralta , Joan Serrà , Álvaro Corral

Human language, as a typical complex system, its organization and evolution is an attractive topic for both physical and cultural researchers. In this paper, we present the first exhaustive analysis of the text organization of human speech.…

Computation and Language · Computer Science 2015-01-08 Ruokuang Lin , Qianli D. Y. Ma , Chunhua Bian

We demonstrate that large texts, representing human (English, Russian, Ukrainian) and artificial (C++, Java) languages, display quantitative patterns characterized by the Benford-like and Zipf laws. The frequency of a word following the…

Computation and Language · Computer Science 2018-03-13 Evgeny Shulzinger , Irina Legchenkova , Edward Bormashenko

The pioneering research of G. K. Zipf on the relationship between word frequency and other word features led to the formulation of various linguistic laws. The most popular is Zipf's law for word frequencies. Here we focus on two laws that…

Computation and Language · Computer Science 2020-09-24 Bernardino Casas , Antoni Hernández-Fernández , Neus Català , Ramon Ferrer-i-Cancho , Jaume Baixeries

We explore a probabilistic model of an artistic text: words of the text are chosen independently of each other in accordance with a discrete probability distribution on an infinite dictionary. The words are enumerated 1, 2, $\ldots$, and…

Statistics Theory · Mathematics 2019-05-02 Mikhail Chebunin , Artyom Kovalevskii