English
Related papers

Related papers: Information Symmetries in Irreversible Processes

200 papers

Irreversible processes accomplished in a fixed time involve nonlinearly coupled flows of matter, energy, and information. Here, using entropy production as an example, we show how thermodynamic uncertainty relations and speed limits on…

Statistical Mechanics · Physics 2021-05-12 Schuyler B. Nicholson , Jason R. Green

Stochastic chains represent a wide and key variety of phenomena in many branches of science within the context of Information Theory and Thermodynamics. They are typically approached by a sequence of independent events or by a memoryless…

Statistical Mechanics · Physics 2017-03-06 J. Ricardo Arias-Gonzalez

We propose a novel method to directly learn a stochastic transition operator whose repeated application provides generated samples. Traditional undirected graphical models approach this problem indirectly by learning a Markov chain model…

Machine Learning · Statistics 2017-11-08 Anirudh Goyal , Nan Rosemary Ke , Surya Ganguli , Yoshua Bengio

We propose and investigate a method for identifying timescales of dissipation in nonequilibrium steady states modeled as discrete-state Markov jump processes. The method is based on how the irreversibility-measured by the statistical…

Statistical Mechanics · Physics 2023-07-24 Freddy A. Cisneros , Nikta Fakhri , Jordan M. Horowitz

We consider a general honest homogeneous continuous-time Markov process with restarts. The process is forced to restart from a given distribution at time moments generated by an independent Poisson process. The motivation to study such…

Probability · Mathematics 2012-06-26 Konstantin Avrachenkov , Alexei Piunovskiy , Zhang Yi

Even simply-defined, finite-state generators produce stochastic processes that require tracking an uncountable infinity of probabilistic features for optimal prediction. For processes generated by hidden Markov chains the consequences are…

Statistical Mechanics · Physics 2021-09-15 Alexandra M. Jurgens , James P. Crutchfield

A prediction makes a claim about a system's future given knowledge of its past. A retrodiction makes a claim about its past given knowledge of its future. The bidirectional machine is an ambidextrous hidden Markov chain that does both…

Statistical Mechanics · Physics 2025-06-24 Alexandra Jurgens , James P. Crutchfield

We show the variational convergence of an irreversible Markov jump process describing a finite stochastic particle system to the solution of a countable infinite system of deterministic time-inhomogeneous quadratic differential equations…

Analysis of PDEs · Mathematics 2025-07-08 Jasper Hoeksema , Chun Yin Lam , André Schlichting

The training algorithms for AI systems all introduce far-from-equilibrium dynamical processes, and understanding the irreversibility of these algorithms is a fundamental step towards understanding the learning dynamics of modern AI systems.…

Statistical Mechanics · Physics 2026-05-22 Liu Ziyin , Yuanjie Ren , Adam Levine , Isaac Chuang

We examine stochastic processes that are used to model nonequilibrium processes (e.g, pulling RNA or dragging colloids) and so deliberately violate detailed balance. We argue that by combining an information-theoretic measure of…

Statistical Mechanics · Physics 2009-11-13 R. A. Blythe

We propose a method to approximate continuous-time, continuous-state stochastic processes by a discrete-time Markov chain defined on a nonuniform grid. Our method provides exact moment matching for processes whose first and second moments…

Probability · Mathematics 2025-11-27 Do Hyun Kim , Ahmet Cetinkaya

A simple model of an irreversible process is introduced. The equation of iterations in the model includes a noise generation term. We study the properties of the system when the noise generation term is a stochastic process (e.g. a random…

Chaotic Dynamics · Physics 2007-05-23 M. A. Sozanski , J. J. Zebrowski

Reversible computing is a new paradigm that has emerged recently and extends the traditional forwards-only computing mode with the ability to execute in backwards, so that computation can run in reverse as easily as in forward. Two…

Formal Languages and Automata Theory · Computer Science 2023-09-07 Nataliya Gribovskaya , Irina Virbitskaite

The article contains an overview over locally stationary processes. At the beginning time varying autoregressive processes are discussed in detail - both as as a deep example and an important class of locally stationary processes. In the…

Statistics Theory · Mathematics 2012-02-06 Rainer Dahlhaus

For discrete-state stochastic systems obeying Markovian dynamics, we establish the counterpart of the conditional reversibility theorem obtained by Gallavotti for deterministic systems [Ann. de l'Institut Henri Poincar\'e (A) 70, 429…

Statistical Mechanics · Physics 2016-02-10 Marcus V. S. Bonança , Christopher Jarzynski

Extreme value functionals of stochastic processes are inverse functionals of the first passage time -- a connection that renders their probability distribution functions equivalent. Here, we deepen this link and establish a framework for…

Statistical Mechanics · Physics 2019-05-30 David Hartich , Aljaz Godec

Time irreversibility, defined as the lack of invariance of the statistical properties of a system or time series under the operation of time reversal, has received an increasing attention during the last decades, thanks to the information…

Data Analysis, Statistics and Probability · Physics 2021-11-03 Massimiliano Zanin

The entropy production is commonly interpreted as measuring the distance from equilibrium. However, this explanation lacks a rigorous description due to the absence of a natural equilibrium measure. The present analysis formalizes this…

Statistical Mechanics · Physics 2025-10-23 David Andrieux

In a real life process evolving over time, the relationship between its relevant variables may change. Therefore, it is advantageous to have different inference models for each state of the process. Asymmetric hidden Markov models fulfil…

Machine Learning · Computer Science 2023-05-16 Carlos Puerto-Santana , Pedro Larrañaga , Concha Bielza

The $\epsilon$-machine is a stochastic process' optimal model -- maximally predictive and minimal in size. It often happens that to optimally predict even simply-defined processes, probabilistic models -- including the $\epsilon$-machine --…

Statistical Mechanics · Physics 2021-12-15 Alexandra M. Jurgens , James P. Crutchfield