English
Related papers

Related papers: Entropy Contractions in Markov Chains: Half-Step, …

200 papers

Determining entropy rates of stochastic processes is a fundamental and difficult problem, with closed-form solutions known only for specific cases. This paper pushes the state-of-the-art by solving the problem for Hidden Markov Models…

Information Theory · Computer Science 2017-09-29 Joachim Breitner , Maciej Skorski

The inference of thermodynamic quantities from the description of an only partially accessible physical system is a central challenge in stochastic thermodynamics. A common approach is coarse-graining, which maps the dynamics of such a…

Statistical Mechanics · Physics 2022-08-19 Jann van der Meer , Benjamin Ertel , Udo Seifert

A transition matrix can be constructed through the partial contraction of two given quantum states. We analyze and compare four different definitions of entropy for transition matrices, including (modified) pseudo entropy, SVD entropy, and…

High Energy Physics - Theory · Physics 2025-08-21 Zhaohui Chen , Rene Meyer , Zhuo-Yu Xian

A quantity of interest to characterise continuous-valued stochastic processes is the differential entropy rate. The rate of convergence of many properties of LRD processes is slower than might be expected, based on the intuition for…

Information Theory · Computer Science 2021-11-02 Andrew Feutrill , Matthew Roughan

We investigate the problem of minimizing the entropy production for a physical process that can be described in terms of a Markov jump dynamics. We show that, without any further constraints, a given time-evolution may be realized at…

Statistical Mechanics · Physics 2022-02-16 Andreas Dechant

In the paper, we study a new rate of convergence estimate for homogeneous discrete-time nonlinear Markov chains based on the Markov-Dobrushin condition. This result generalizes the convergence estimates for any positive number of transition…

Probability · Mathematics 2021-10-22 Aleksandr A. Shchegolev

In this paper we develop a statistical estimation technique to recover the transition kernel $P$ of a Markov chain $X=(X_m)_{m \in \mathbb N}$ in presence of censored data. We consider the situation where only a sub-sequence of $X$ is…

Statistics Theory · Mathematics 2014-05-05 Flavia Barsotti , Yohann De Castro , Thibault Espinasse , Paul Rochet

Quantification of information content and its temporal variation in intracellular calcium spike trains in neurons helps one understand functions such as memory, learning, and cognition. Such quantification could also reveal pathological…

Signal Processing · Electrical Eng. & Systems 2021-02-02 Sathish Ande , Srinivas Avasarala , Jayanth R Regatti , Neha Pandey , Sarpras Swain , Ajith Karunarathne , Lopamudra Giri , Soumya Jana

We derive explicit upper bounds for the $\bar{d}$-distance between a chain of infinite order and its canonical $k$-steps Markov approximation. Our proof is entirely constructive and involves a "coupling from the past" argument. The new…

Probability · Mathematics 2012-01-16 Sandro Gallo , Matthieu Lerasle , Daniel Yasumasa Takahashi

The stochastic entropy generated during the evolution of a system interacting with an environment may be separated into three components, but only two of these have a non-negative mean. The third component of entropy production is…

Statistical Mechanics · Physics 2013-05-30 Ian J. Ford , Richard E. Spinney

We consider piecewise deterministic Markov processes with degenerate transition kernels of the "house-of-cards"-type. We use a splitting scheme based on jump times to prove the absolute continuity, as well as some regularity, of the…

Probability · Mathematics 2016-01-27 Eva Löcherbach

We define the quantum $p$-divergences and introduce Beckner's inequalities for primitive quantum Markov semigroups on a finite-dimensional matrix algebra satisfying the detailed balance condition. Such inequalities quantify the convergence…

Operator Algebras · Mathematics 2023-07-07 Bowen Li , Jianfeng Lu

We consider continuous-time (not necessarily finite) Markov chains on discrete spaces and identify a curvature-dimension inequality, the condition $CD_\Upsilon(\kappa,\infty)$, which serves as a natural analogue of the classical…

Probability · Mathematics 2020-07-03 Frederic Weber , Rico Zacher

The length-scale dependence of the dynamic entropy is studied in a molecular dynamics simulation of a binary Lennard-Jones liquid above the mode-coupling critical temperature $T_c$. A number of methods exist for estimating the entropy of…

Soft Condensed Matter · Physics 2009-10-31 Paolo Allegrini , Jack F. Douglas , Sharon C. Glotzer

Functional inequalities such as the Poincar\'e and log-Sobolev inequalities quantify convergence to equilibrium in continuous-time Markov chains by linking generator properties to variance and entropy decay. However, many applications,…

Probability · Mathematics 2026-02-20 Bastian Hilder , Patrick van Meurs , Upanshu Sharma

Using elementary methods, we prove that for a countable Markov chain $P$ of ergodic degree $d > 0$ the rate of convergence towards the stationary distribution is subgeometric of order $n^{-d}$, provided the initial distribution satisfies…

Probability · Mathematics 2007-05-23 Stefano Isola

Hoeffding's inequality is a fundamental tool widely applied in probability theory, statistics, and machine learning. In this paper, we establish Hoeffding's inequalities specifically tailored for an irreducible and positive recurrent…

Probability · Mathematics 2024-04-24 Jinpeng Liu , Yuanyuan Liu , Lin Zhou

We study the statistics of first passage times (FPTs) of trajectory observables in both classical and quantum Markov processes. We consider specifically the FPTs of counting observables, that is, the times to reach a certain threshold of a…

Statistical Mechanics · Physics 2024-05-17 George Bakewell-Smith , Federico Girotti , Mădălin Guţă , Juan P. Garrahan

A divide-and-conquer approach to analyzing Markov chains (MCs) is not utilized as widely as it could be, despite its potential benefits. One primary reason for this is the fact that most MC decomposition approaches involve a complex and…

Probability · Mathematics 2021-02-25 Katsunobu Sasanuma , Robert Hampshire , Alan Scheller-Wolf

We provide explicit expressions for the constants involved in the characterisation of ergodicity of sub-geometric Markov chains. The constants are determined in terms of those appearing in the assumed drift and one-step minorisation…

Probability · Mathematics 2014-03-18 Christophe Andrieu , Gersende Fort , Matti Vihola