English
Related papers

Related papers: Entropy of finite random binary sequences with wea…

200 papers

The estimation of entropy rates for stationary discrete-valued stochastic processes is a well studied problem in information theory. However, estimating the entropy rate for stationary continuous-valued stochastic processes has not received…

Information Theory · Computer Science 2021-05-26 Andrew Feutrill , Matthew Roughan

We study the time evolution of a chain of nonlinear oscillators. We focus on the fractal features of the spectral entropy and analyze its characteristic intermediate timescales as a function of the nonlinear coupling. A Brownian motion is…

Statistical Mechanics · Physics 2009-11-07 A. Scardicchio , P. Facchi , S. Pascazio

We study a system of $N$ interacting particles on $\bf{Z}$. The stochastic dynamics consists of two components: a free motion of each particle (independent random walks) and a pair-wise interaction between particles. The interaction belongs…

Probability · Mathematics 2011-10-25 A. Manita , V. Shcherbakov

We study the Shannon entropy of the probability distribution resulting from the ground-state wave function of a one-dimensional quantum model. This entropy is related to the entanglement entropy of a Rokhsar-Kivelson-type wave function…

Strongly Correlated Electrons · Physics 2009-11-25 Jean-Marie Stéphan , Shunsuke Furukawa , Grégoire Misguich , Vincent Pasquier

We study the entanglement entropy of the quantum trajectories of a free fermion chain under continuous monitoring of local occupation numbers. We propose a simple theory for entanglement entropy evolution from disentangled and highly…

Statistical Mechanics · Physics 2019-08-28 Xiangyu Cao , Antoine Tilloy , Andrea De Luca

We study analytically the corrections to the leading terms in the Renyi entropy of a massive lattice theory, showing significant deviations from naive expectations. In particular, we show that finite size and finite mass effects give rise…

High Energy Physics - Theory · Physics 2012-05-31 Elisa Ercolessi , Stefano Evangelisti , Fabio Franchini , Francesco Ravanini

We prove an invariance principle for non-stationary random processes and establish a rate of convergence under a new type of mixing condition. The dependence is exponentially decaying in the gap between the past and the future and is…

Probability · Mathematics 2024-12-23 Ion Grama , Émile Le Page , Marc Peigné

We study the entanglement entropy of random partitions in one- and two-dimensional critical fermionic systems. In an infinite system we consider a finite, connected (hypercubic) domain of linear extent $L$, the points of which with…

Disordered Systems and Neural Networks · Physics 2022-02-18 Gergö Roósz , István A. Kovács , Ferenc Iglói

The stochastic entropy generated during the evolution of a system interacting with an environment may be separated into three components, but only two of these have a non-negative mean. The third component of entropy production is…

Statistical Mechanics · Physics 2013-05-30 Ian J. Ford , Richard E. Spinney

The probability distribution of the total entropy production in the non-equilibrium steady state follows a symmetry relation called the fluctuation theorem. When a certain part of the system is masked or hidden, it is difficult to infer the…

Statistical Mechanics · Physics 2020-04-29 Deepak Gupta , Sanjib Sabhapandit

We study the permutation complexity of finite-state stationary stochastic processes based on a duality between values and orderings between values. First, we establish a duality between the set of all words of a fixed length and the set of…

Chaotic Dynamics · Physics 2011-12-13 Taichi Haruna , Kohei Nakajima

We compute the entanglement entropy in a composite system separated by a finitely ramified boundary with the structure of a self-similar lattice graph. We derive the entropy as a function of the decimation factor which determines the…

Quantum Physics · Physics 2018-11-14 Ibrahim Akal

We study the probability distribution of entanglement in the Quantum Symmetric Simple Exclusion Process, a model of fermions hopping with random Brownian amplitudes between neighboring sites. We consider a protocol where the system is…

Statistical Mechanics · Physics 2021-07-30 Denis Bernard , Lorenzo Piroli

This work contains two single-letter upper bounds on the entropy rate of a discrete-valued stationary stochastic process, which only depend on second-order statistics, and are primarily suitable for models which consist of relatively large…

Information Theory · Computer Science 2022-03-11 Ran Tamir

We consider rapidly mixing dynamical systems and link the decay of the shortest distance between multiple orbits with the generalized fractal dimension. We apply this result to multidimensional expanding maps and extend it to the realm of…

Dynamical Systems · Mathematics 2019-12-17 Vanessa Barros , Jerome Rousseau

Entropy production is often interpreted as a proxy for microscopic disorder or environmental roughness in stochastic systems. We test this interpretation using controlled simulations of overdamped stochastic dynamics on curved surfaces in…

Statistical Mechanics · Physics 2026-02-23 Patrick Romanescu

Estimating the entropy based on data is one of the prototypical problems in distribution property testing and estimation. For estimating the Shannon entropy of a distribution on $S$ elements with independent samples, [Paninski2004] showed…

Machine Learning · Computer Science 2018-09-25 Yanjun Han , Jiantao Jiao , Chuan-Zheng Lee , Tsachy Weissman , Yihong Wu , Tiancheng Yu

It is known that maximal entropy random walks and partition functions that count long paths on graphs tend to become localized near nodes with a high degree. Here, we revisit the simplest toy model of such a localization: a regular tree of…

Statistical Mechanics · Physics 2023-09-22 Alexey V. Gulyaev , Mikhail V. Tamm

Non-equilibrium stochastic dynamics of several active Brownian systems are modeled in terms of non-linear velocity dependent force. In general, this force may consist of both even and odd functions of velocity. We derive the expression for…

Statistical Mechanics · Physics 2016-09-14 Debasish Chaudhuri

The log-periodic equation for the entropy $S = - (k/a) \sum_{i=1}^{N} p_{i} \sin(a \ln p_{i})$, based on the forgotten Sharma-Taneja entropy measure, is studied for the first time with $N$ the total number of system states and $p_{i}$ the…

Data Analysis, Statistics and Probability · Physics 2014-01-21 E. Canessa