English
Related papers

Related papers: Entropy of finite random binary sequences with wea…

200 papers

This paper considers the speed of convergence (mixing) of a finite Markov kernel $P$ with respect to the Kullback-Leibler divergence (entropy). Given a Markov kernel one defines either a discrete-time Markov chain (with the $n$-step…

Probability · Mathematics 2024-09-13 Pietro Caputo , Zongchen Chen , Yuzhou Gu , Yury Polyanskiy

We obtain a perfect sampling characterization of weak ergodicity for backward products of finite stochastic matrices, and equivalently, simultaneous tail triviality of the corresponding nonhomogeneous Markov chains. Applying these ideas to…

Statistics Theory · Mathematics 2016-01-07 Nick Whiteley , Anthony Lee

Using elementary methods, we prove that for a countable Markov chain $P$ of ergodic degree $d > 0$ the rate of convergence towards the stationary distribution is subgeometric of order $n^{-d}$, provided the initial distribution satisfies…

Probability · Mathematics 2007-05-23 Stefano Isola

We consider a system of binary interacting chains describing the dynamics of a group of $N$ components that, at each time unit, either send some signal to the others or remain silent otherwise. The interactions among the chains are encoded…

Statistics Theory · Mathematics 2025-04-18 Julien Chevallier , Eva Löcherbach , Guilherme Ost

A theory of symbolic dynamic systems with long-range correlations based on the consideration of the binary N-step Markov chains developed earlier in Phys. Rev. Lett. 90, 110601 (2003) is generalized to the biased case (non equal numbers of…

Data Analysis, Statistics and Probability · Physics 2015-06-26 Z. A. Mayzelis , S. S. Apostolov , S. S. Mel'nyk , O. V. Usatenko , V. A. Yampol'skii

We study the entanglement and Renyi entropies of two disjoint intervals in minimal models of conformal field theory. We use the conformal block expansion and fusion rules of twist fields to define a systematic expansion in the elliptic…

High Energy Physics - Theory · Physics 2015-06-03 M. A. Rajabpour , F. Gliozzi

We study the statistical properties of Ising spin chains with finite (although arbitrary large) range of interaction between the elements. We examine mesoscopic subsystems (fragments of an Ising chain) with the lengths comparable with the…

Statistical Mechanics · Physics 2009-11-13 S. S. Apostolov , Z. A. Mayzelis , O. V. Usatenko , V. A. Yampol'skii

We consider continuous-space, discrete-time Markov chains on $\mathbb{R}^d$, that admit a finite number $N$ of metastable states. Our main motivation for investigating these processes is to analyse random Poincar\'e maps, which describe…

Probability · Mathematics 2025-08-19 Nils Berglund

The entropy of a binary symmetric Hidden Markov Process is calculated as an expansion in the noise parameter epsilon. We map the problem onto a one-dimensional Ising model in a large field of random signs and calculate the expansion…

Information Theory · Computer Science 2009-11-11 O. Zuk , I. Kanter , E. Domany

Motivated by robotic surveillance applications, this paper studies the novel problem of maximizing the return time entropy of a Markov chain, subject to a graph topology with travel times and stationary distribution. The return time entropy…

Optimization and Control · Mathematics 2018-05-29 Xiaoming Duan , Mishel George , Francesco Bullo

We use the $f-divergence$ also called relative entropy as a measure of diversity between probability densities and review its basic properties. In the sequence we define a few objects which capture relevant information from the sample of a…

Statistics Theory · Mathematics 2012-06-20 A. R. Baigorri , C. R. Goncalves , P. A. A. Resende

Using Brownian dynamics simulations, we study the migration of long charged chains in an electrophoretic microchannel device consisting of an array of microscopic entropic traps with alternating deep regions and narrow constrictions. Such a…

Biological Physics · Physics 2007-05-23 Martin Streek , Friederike Schmid , Thanh Tu Duong , Alexandra Ros

We study some properties of binary sequences generated by random substitutions of constant length. Specifically, assuming the alphabet $\{0,1\}$, we consider the following asymmetric substitution rule of length $k$: $0 \to \langle 0, 0,…

Probability · Mathematics 2022-03-09 Juan Carlos Nuño , Francisco J. Muñoz

We propose a compression-based version of the empirical entropy of a finite string over a finite alphabet. Whereas previously one considers the naked entropy of (possibly higher order) Markov processes, we consider the sum of the…

Information Theory · Computer Science 2011-04-05 Paul M. B. Vitányi

Fluctuations in parameters that are typically treated as fixed play a crucial role in the behavior of complex systems. However, to date, we lack a general non-equilibrium thermodynamic treatment of such a complex system. In this Letter, to…

Statistical Mechanics · Physics 2026-03-31 Tuan Pham , Deepak Gupta

We analyse diffusion dynamics on weakly-coupled networks (interconnected networks) by means of separation of time scales. Using an adiabatic approximation we reduced the system dynamics to a Markov chain with aggregated variables and…

Chaotic Dynamics · Physics 2018-12-14 Grzegorz Siudem , Janusz A. Hołyst

We describe an efficient theoretical criterion, suitable for indistinguishable particles to quantify the quantum correlations of any pure two-fermion state, based on the Slater rank concept. It represents the natural generalization of the…

Quantum Physics · Physics 2007-05-23 Fabrizio Buscemi , Paolo Bordone , Andrea Bertoni

Kolmogorov complexity of a finite binary word reflects both algorithmic structure and the empirical distribution of symbols appearing in the word. Words with symbol frequencies far from one half have smaller combinatorial richness and…

Computation · Statistics 2025-12-25 Brani Vidakovic

Let $\{X_n\}$ be a stationary and ergodic time series taking values from a finite or countably infinite set ${\cal X}$. Assume that the distribution of the process is otherwise unknown. We propose a sequence of stopping times $\lambda_n$…

Probability · Mathematics 2008-06-19 G. Morvai , B. Weiss

Consider a sequence (indexed by n) of Markov chains Z^n in R^d characterized by transition kernels that approximately (in n) depend only on the rescaled state n^{-1} Z^n. Subject to a smoothness condition, such a family can be closely…

Probability · Mathematics 2009-08-17 Kamil Szczegot