English
Related papers

Related papers: On the Entropy Rate of Pattern Processes

200 papers

Motivated by the established notion of storage codes, we consider sets of infinite sequences over a finite alphabet such that every $k$-tuple of consecutive entries is uniquely recoverable from its $l$-neighborhood in the sequence. We…

Information Theory · Computer Science 2022-03-08 Ohad Elishco , Alexander Barg

Employing the stochastic wave function method, we study quantum features of stochastic entropy production in nonequilibrium processes of open systems. It is demonstarted that continuous measurements on the environment introduce an…

Quantum Physics · Physics 2013-10-16 B. Leggio , A. Napoli , A. Messina , H. -P. Breuer

The effect of unstable quasiparticles in the out-of-equilibrium dynamics of certain integrable systems has been the subject of several recent studies. In this paper we focus on the stationary value of the entanglement entropy density, its…

High Energy Physics - Theory · Physics 2023-04-24 David X. Horvath , Pasquale Calabrese , Olalla A. Castro-Alvaredo

We consider a wide class of linear stochastic problems driven off the equilibrium by a multiplicative asymmetric force. The force brakes detailed balance, maintained otherwise, thus producing entropy. The large deviation function of the…

Chaotic Dynamics · Physics 2009-11-11 K. Turitsyn , M. Chertkov , V. Y. Chernyak , A. Puliafito

We study the convergence rate to stationarity for a class of exchangeable partition-valued Markov chains called cut-and-paste chains. The law governing the transitions of a cut-and-paste chain are determined by products of i.i.d. stochastic…

Probability · Mathematics 2012-09-25 Harry Crane , Steven P. Lalley

We study convexity properties of R\'{e}nyi entropy as function of $\alpha>0$ on finite alphabets. We also describe robustness of the R\'{e}nyi entropy on finite alphabets, and it turns out that the rate of respective convergence depends on…

Probability · Mathematics 2021-03-09 Filipp Buryak , Yuliya Mishura

We consider a section of a half-filled chain of free electrons and its entanglement with the rest of the system in the presence of one or two interface defects. We find a logarithmic behaviour of the entanglement entropy with constants…

Statistical Mechanics · Physics 2009-11-11 Ingo Peschel

Even simply-defined, finite-state generators produce stochastic processes that require tracking an uncountable infinity of probabilistic features for optimal prediction. For processes generated by hidden Markov chains the consequences are…

Statistical Mechanics · Physics 2021-09-15 Alexandra M. Jurgens , James P. Crutchfield

A version of ``preferential attachment'' random graphs, corresponding to linear ``weights'' with random ``edge additions,'' which generalizes some previously considered models, is studied. This graph model is embedded in a continuous-time…

Probability · Mathematics 2007-05-23 K. B. Athreya , A. P. Ghosh , S. Sethuraman

Using elementary methods, we prove that for a countable Markov chain $P$ of ergodic degree $d > 0$ the rate of convergence towards the stationary distribution is subgeometric of order $n^{-d}$, provided the initial distribution satisfies…

Probability · Mathematics 2007-05-23 Stefano Isola

We study the long time behaviour of the speed of a particle moving in $\mathbb{R}^d$ under the influence of a random time-dependent potential representing the particle's environment. The particle undergoes successive scattering events that…

Probability · Mathematics 2014-09-09 Emilie Soret , Stephan De Bievre

We derive the asymptotic distribution of ordinal-pattern frequencies under weak dependence conditions and investigate the long-run covariance matrix not only analytically for moving-average, Gaussian, and the novel generalized coin-tossing…

Statistics Theory · Mathematics 2025-07-24 Angelika Silbernagel , Christian Weiß

A stochastic model of excitatory and inhibitory interactions which bears universality traits is introduced and studied. The endogenous component of noise, stemming from finite size corrections, drives robust inter-nodes correlations, that…

Disordered Systems and Neural Networks · Physics 2017-08-16 Clement Zankoc , Duccio Fanelli , Francesco Ginelli , Roberto Livi

In this paper we continue our earlier investigations into the asymptotic behaviour of infinite systems of coupled differential equations. Under the mild assumption that the so-called characteristic function of our system is completely…

Functional Analysis · Mathematics 2020-10-01 Lassi Paunonen , David Seifert

We construct mixing processes over an infinite alphabet and ergodic processes over a finite alphabet for which Shannon mutual information between adjacent blocks of length $n$ grows as $n^\beta$, where $\beta\in(0,1)$. The processes are a…

Information Theory · Computer Science 2020-03-11 Łukasz Dębowski

We study the stochastic thermodynamics of an overdamped harmonic chain, which can be viewed equivalently as a 1D Rouse chain or as an approximate model of single file diffusion. We discuss mainly two levels of description of this system:…

Statistical Mechanics · Physics 2015-06-23 David Lacoste , Michael A. Lomholt

We extend the notion of estimation entropy of autonomous dynamical systems proposed by Liberzon and Mitra [1] to nonlinear dynamical systems with uncertain inputs with bounded variation. We call this new notion the {$\epsilon$}-estimation…

Systems and Control · Electrical Eng. & Systems 2023-11-14 Hussein Sibai , Sayan Mitra

In this paper we introduce and exploit the real replica approach for a minimal generalization of the Hopfield model, by assuming the learned patterns to be distributed accordingly to a standard unit Gaussian. We consider the high storage…

Disordered Systems and Neural Networks · Physics 2009-11-19 Adriano Barra , Francesco Guerra

Motivated by stability questions on piecewise deterministic Markov models of bacterial chemotaxis, we study the long time behavior of a variant of the classic telegraph process having a non-constant jump rate that induces a drift towards…

Probability · Mathematics 2012-04-27 Joaquin Fontbona , Hélène Guérin , Florent Malrieu

Discrete stationary classical processes as well as quantum lattice states are asymptotically confined to their respective typical support, the exponential growth rate of which is given by the (maximal ergodic) entropy. In the iid case the…

Probability · Mathematics 2009-11-13 I. Bjelakovic , J. -D. Deuschel , T. Krueger , R. Seiler , Ra. Siegmund-Schultze , A. Szkola