English
Related papers

Related papers: Entropy and Long range correlations in literary En…

200 papers

We present results from our quantitative study of statistical and network properties of literary and scientific texts written in two languages: English and Polish. We show that Polish texts are described by the Zipf law with the scaling…

Physics and Society · Physics 2013-12-16 Iwona Grabska-Gradzinska , Andrzej Kulig , Jaroslaw Kwapien , Stanislaw Drozdz

The Boolean lattice of logical statements induces the free distributive lattice of questions. Inclusion on this lattice is based on whether one question answers another. Generalizing the zeta function of the question lattice leads to a…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Kevin H. Knuth

When the difference between changes in energy and entropy at a given temperature is correlated with the ratio between the same changes in energy and entropy at zero average free energy of an ensemble of similar but distinct molecule-sized…

General Physics · Physics 2009-06-17 Petr Zimak , Silvia Terenzi , Peter Strazewski

We briefly survey some concepts related to empirical entropy -- normal numbers, de Bruijn sequences and Markov processes -- and investigate how well it approximates Kolmogorov complexity. Our results suggest $\ell$th-order empirical entropy…

Information Theory · Computer Science 2007-07-16 Travis Gagie

Long-range correlations are found in symbolic sequences from human language, music and DNA. Determining the span of correlations in dolphin whistle sequences is crucial for shedding light on their communicative complexity. Dolphin whistles…

Neurons and Cognition · Quantitative Biology 2014-12-03 Ramon Ferrer-i-Cancho , Brenda McCowan

In this paper, we present a novel method for computing the relative entropy as well as the expected relative entropy using an MCMC chain. The relative entropy from information theory can be used to quantify differences in posterior…

Cosmology and Nongalactic Astrophysics · Physics 2019-04-29 Ahmad Mehrabi , A. Ahmadi

Understanding the complexity of human language requires an appropriate analysis of the statistical distribution of words in texts. We consider the information retrieval problem of detecting and ranking the relevant words of a text by means…

Computation and Language · Computer Science 2008-06-07 Juan P. Herrera , Pedro A. Pury

We consider some questions concerning the monotonicity properties of entropy and mean entropy of states on translationally invariant systems (classical lattice, quantum lattice and quantum continuous). By taking the property of strong…

Mathematical Physics · Physics 2008-11-26 Amanda R. Kay , Bernard S. Kay

New families of Fisher information and entropy power inequalities for sums of independent random variables are presented. These inequalities relate the information in the sum of $n$ independent random variables to the information contained…

Information Theory · Computer Science 2024-05-07 Mokshay Madiman , Andrew Barron

Recent work has sought to quantify large language model uncertainty to facilitate model control and modulate user trust. Previous works focus on measures of uncertainty that are theoretically grounded or reflect the average overt behavior…

Computation and Language · Computer Science 2025-03-18 Kyle Moore , Jesse Roberts , Daryl Watson , Pamela Wisniewski

We show that the Zipf's law for Chinese characters perfectly holds for sufficiently short texts (few thousand different characters). The scenario of its validity is similar to the Zipf's law for words in short English texts. For long…

Computation and Language · Computer Science 2014-03-10 W. B. Deng , A. E. Allahverdyan , B. Li , Q. A. Wang

We study some properties of binary sequences generated by random substitutions of constant length. Specifically, assuming the alphabet $\{0,1\}$, we consider the following asymmetric substitution rule of length $k$: $0 \to \langle 0, 0,…

Probability · Mathematics 2022-03-09 Juan Carlos Nuño , Francisco J. Muñoz

We provide formulas for the entropy of free-string states depending on their mass, charges and size, both in bosonic and superstring theory (IIA or IIB). We properly define these quantities in full-fledged string theory. We then investigate…

High Energy Physics - Theory · Physics 2007-11-13 Diego Chialva

We analyze the rank-frequency distributions of words in selected English and Polish texts. We compare scaling properties of these distributions in both languages. We also study a few small corpora of Polish literary texts and find that for…

Computation and Language · Computer Science 2015-11-11 Stanislaw Drozdz , Jaroslaw Kwapien , Adam Orczyk

This dissertation explores the linguistic and computational aspects of the meaning relations that can hold between two or more complex linguistic expressions (phrases, clauses, sentences, paragraphs). In particular, it focuses on…

Computation and Language · Computer Science 2022-08-11 Venelin Kovatchev

Generalizing the quantifiers used to classify correlations in bipartite systems, we define genuine total, quantum, and classical correlations in multipartite systems. The measure we give is based on the use of relative entropy to quantify…

Quantum Physics · Physics 2011-11-04 Gian Luca Giorgi , Bruno Bellomo , Fernando Galve , Roberta Zambrini

The entropy of network ensembles characterizes the amount of information encoded in the network structure, and can be used to quantify network complexity, and the relevance of given structural properties observed in real network datasets…

Disordered Systems and Neural Networks · Physics 2014-06-18 Kartik Anand , Dimitri Krioukov , Ginestra Bianconi

This paper addresses the question of the fluctuations of the empirical entropy of a chain of infinite order. We assume that the chain takes values on a finite alphabet and loses memory exponentially fast. We consider two possible…

Statistical Mechanics · Physics 2007-05-23 D. Gabrielli , A. Galves , D. Guiol

Finite alphabets of at least three letters permit the construction of square-free words of infinite length. We show that the entropy density is strictly positive and derive reasonable lower and upper bounds. Finally, we present an…

Mathematical Physics · Physics 2007-05-23 Michael Baake , Veit Elser , Uwe Grimm

Languages across the world exhibit Zipf's law of abbreviation, namely more frequent words tend to be shorter. The generalized version of the law - an inverse relationship between the frequency of a unit and its magnitude - holds also for…

Information Theory · Computer Science 2016-05-05 R. Ferrer-i-Cancho , C. Bentz , C. Seguin