English
Related papers

Related papers: Scaling behaviour of entropy estimates

200 papers

We present a simple adaptation of the Lempel Ziv 78' (LZ78) compression scheme ({\em IEEE Transactions on Information Theory, 1978}) that supports efficient random access to the input string. Namely, given query access to the compressed…

Data Structures and Algorithms · Computer Science 2013-01-14 Akashnil Dutta , Reut Levi , Dana Ron , Ronitt Rubinfeld

The concept of entropy connects the number of possible configurations with the number of variables in large stochastic systems. Independent or weakly interacting variables render the number of configurations scale exponentially with the…

Statistical Mechanics · Physics 2020-06-25 Sámuel G. Balogh , Gergely Palla , Péter Pollner , Dániel Czégel

The large deviations theory for heavy-tailed processes has seen significant advances in the recent past. In particular, Rhee et al. (2019) and Bazhba et al. (2020) established large deviation asymptotics at the sample-path level for L\'evy…

Probability · Mathematics 2024-10-29 Zhe Su , Chang-Han Rhee

We study the scaling behavior of period doublings in two unidirectionally-coupled one-dimensional maps near a bicritical point where two critical lines of period-doubling transition to chaos in both subsystems meet. Note that the bicritical…

chao-dyn · Physics 2009-10-31 Sang-Yoon Kim

We propose a new sensitivity analysis methodology for complex stochastic dynamics based on the Relative Entropy Rate. The method becomes computationally feasible at the stationary regime of the process and involves the calculation of…

Mathematical Physics · Physics 2013-04-16 Yannis Pantazis , Markos A. Katsoulakis

We study analytically the corrections to the leading terms in the Renyi entropy of a massive lattice theory, showing significant deviations from naive expectations. In particular, we show that finite size and finite mass effects give rise…

High Energy Physics - Theory · Physics 2012-05-31 Elisa Ercolessi , Stefano Evangelisti , Fabio Franchini , Francesco Ravanini

The refined composite multiscale-entropy algorithm was applied to the time-dependent behavior of the Weierstrass functions, colored noise, and Logistic map to provide fresh insight into the dynamics of these fluctuating phenomena. For the…

Data Analysis, Statistics and Probability · Physics 2018-10-17 Jamieson Brechtl , Xie Xie , Karen A. Dahmen , Peter K. Liaw

We define an algorithm that parses multidimensional arrays sequentially into mainly unrepeated but nested multidimensional sub-arrays of increasing size, and show that the resulting sub-block pointer encoder compresses almost every…

Information Theory · Computer Science 2014-08-20 Tyll Krueger , Guido Montufar , Ruedi Seiler , Rainer Siegmund-Schultze

Feedback effects due to spin fluctuation induced precursors in the fermionic quasiparticle spectrum are taken into account in the description of a quantum critical point of itinerant spin systems. A correlation length dependent spin damping…

Strongly Correlated Electrons · Physics 2007-05-23 Joerg Schmalian

When following a sequence - such as reading a text or tracking a user's activity - one can measure how the "dictionary" of distinct elements (types) grows with the number of observations (tokens). When this growth follows a power law, it is…

Physics and Society · Physics 2026-04-21 Célestin Zimmerlin , Thomas Louail , Manuel Moussallam , Marc Barthelemy

The critical brain hypothesis posits that neural circuitry operates near criticality to reap the computational benefits of accessing a wide range of timescales. The theory of critical phenomena generally predicts heavy-tailed (power-law)…

Neurons and Cognition · Quantitative Biology 2025-12-23 Jacob T. Crosser , Braden A. W. Brinkman

We evaluated the impact of changing the observation scale over the entropy measures for text descriptions. MIDI coded Music, computer code and two human natural languages were studied at the scale of characters, words, and at the…

Information Theory · Computer Science 2017-01-13 Gerardo Febres , Klaus Jaffe

It is known that maximal entropy random walks and partition functions that count long paths on graphs tend to become localized near nodes with a high degree. Here, we revisit the simplest toy model of such a localization: a regular tree of…

Statistical Mechanics · Physics 2023-09-22 Alexey V. Gulyaev , Mikhail V. Tamm

In this paper we perform an analytical and numerical study of Extreme Value distributions in discrete dynamical systems that have a singular measure. Using the block maxima approach described in Faranda et al. [2011] we show that,…

Dynamical Systems · Mathematics 2011-06-14 Davide Faranda , Valerio Lucarini , Giorgio Turchetti , Sandro Vaienti

We consider the extreme value statistics of correlated random variables that arise from a Langevin equation. Recently, it was shown that the extreme values of the Ornstein-Uhlenbeck process follow a different distribution than those…

Statistical Mechanics · Physics 2021-08-17 Lior Zarfaty , Eli Barkai , David A. Kessler

We carry out a numerical study of the bi-partite entanglement entropy in the gapped regime of two paradigmatic quantum spin chain models: the Ising chain in an external magnetic field and the anti-ferromagnetic XXZ model. The universal…

High Energy Physics - Theory · Physics 2013-10-30 Emanuele Levi , Olalla A. Castro-Alvaredo , Benjamin Doyon

We introduce a family of scale-invariant entropy statistics derived from logarithmically aggregated distance distributions of point processes, with prime numbers serving as a motivating example. The construction associates to each finite…

Methodology · Statistics 2026-04-06 Mohamed Gewily

A measure of how sensitive the entanglement entropy is in a quantum system, has been proposed and its information geometric origin is discussed. It has been demonstrated for two exactly solvable spin systems, that thermodynamic criticality…

Statistical Mechanics · Physics 2025-10-02 Pritam Sarkar

We study the evolution of the probability density of ensembles of iterates of the logistic map that advance towards and finally remain at attractors of representative dynamical regimes. We consider the mirror families of superstable…

Statistical Mechanics · Physics 2021-03-17 Alvaro Diaz-Ruelas , Fulvio Baldovin , Alberto Robledo

We obtain a formula for the determinant of a block Toeplitz matrix associated with a quadratic fermionic chain with complex coupling. Such couplings break reflection symmetry and/or charge conjugation symmetry. We then apply this formula to…

Quantum Physics · Physics 2015-11-04 F. Ares , J. G. Esteve , F. Falceto , A. R. de Queiroz