English
Related papers

Related papers: Sampling rare fluctuations of discrete-time Markov…

200 papers

We consider a class of discrete time Markov chains with state space [0,1] and the following dynamics. At each time step, first the direction of the next transition is chosen at random with probability depending on the current location. Then…

Probability · Mathematics 2014-12-04 Shaun McKinlay , Konstantin Borovkov

Coarse-grained models are widely used to explain the effective behavior of partially observable physical systems with hidden degrees of freedom. Reduction procedures in state space typically disrupt Markovianity and a fluctuation relation…

Statistical Mechanics · Physics 2024-09-24 Alberto Garilli , Pedro E. Harunari , Matteo Polettini

The linear response of a dynamical system refers to changes to properties of the system when small external perturbations are applied. We consider the little-studied question of selecting an optimal perturbation so as to (i) maximise the…

Dynamical Systems · Mathematics 2018-04-04 Fadi Antown , Davor Dragičević , Gary Froyland

We study analytically giant fluctuations and temporal intermittency in a stochastic one-dimensional model with diffusion and aggregation of masses in the bulk, along with influx of single particles and outflux of aggregates at the…

Statistical Mechanics · Physics 2015-06-17 Himani Sachdeva , Mustansir Barma

We study the large deviations of the time-integrated current for a driven diffusion on the circle, often used as a model of nonequilibrium systems. We obtain the large deviation functions describing the current fluctuations using a…

Statistical Mechanics · Physics 2016-09-28 Pelerine Tsobgni Nyawo , Hugo Touchette

In this note, we present few examples of Piecewise Deterministic Markov Processes and their long time behavior. They share two important features: they are related to concrete models (in biology, networks, chemistry,. . .) and they are…

Probability · Mathematics 2014-12-24 Florent Malrieu

The problem of efficiently sampling from a set of (undirected, or directed) graphs with a given degree sequence has many applications. One approach to this problem uses a simple Markov chain, which we call the switch chain, to perform the…

Discrete Mathematics · Computer Science 2017-09-13 Catherine Greenhill , Matteo Sfragara

The reduction of a continuous Markov process with multiple metastable states to a discrete rate process is investigated in the presence of slow time dependent parameters such as periodic external forces or slowly fluctuating barrier…

Statistical Mechanics · Physics 2009-11-10 Peter Talkner , Jerzy Luczka

Many fluctuating systems consist of macroscopic structures in addition to noisy signals. Thus, for this class of fluctuating systems, the scaling behaviors are very complicated. Such phenomena are quite commonly observed in Nature, ranging…

Statistical Mechanics · Physics 2007-05-23 Ning-Ning Pang , Hisen-Ching Kao , Wen-Jer Tzeng

In a recent paper, Shah [arXiv:2502.03073] derived an explicit expression for the distribution of occupancy times for a two-state Markov chain, using a method based on enumerating sample paths. We consider here the more general problem of…

Probability · Mathematics 2025-04-01 Phil Pollett

Continuous-time Markov chains on non-negative integers can be used for modeling biological systems, population dynamics, and queueing models. Qualitative behaviors of birth-and-death models, typical examples of such one-dimensional…

Probability · Mathematics 2025-10-24 Minjun Kim , Seokhwan Moon , Jinsu Kim

We analyse how the sampling dynamics of distributions evolve in score-based diffusion models using cross-fluctuations, a centered-moment statistic from statistical physics. Specifically, we show that starting from an unbiased isotropic…

Machine Learning · Computer Science 2026-05-04 Sai Niranjan Ramachandran , Manish Krishan Lal , Suvrit Sra

In this paper we establish a large deviations type estimate for strongly mixing Markov chains with respect to the Lp norm. As applications we derive such estimates for the iterates of a locally constant random cocycle with mixed rank, as…

Dynamical Systems · Mathematics 2026-02-10 Anselmo Pontes

Filtering is concerned with the sequential estimation of the state, and uncertainties, of a Markovian system, given noisy observations. It is particularly difficult to achieve accurate filtering in complex dynamical systems, such as those…

Probability · Mathematics 2015-12-14 Wonjung Lee , Andrew Stuart

We study the weakly asymmetric simple exclusion process on the integer lattice. Under suitable constraints on the strength of the weak asymmetry of the dynamics, we prove moderate deviation principles for the fluctuation fields when the…

Probability · Mathematics 2024-05-28 Linjie Zhao

In any Markov chain with finite state space the distribution of transition records always belongs to the exponential family. This observation is used to prove a fluctuation theorem, and to show that the dynamical entropy of a stationary…

Statistical Mechanics · Physics 2009-11-11 Jan Naudts , Erik Van der Straeten

We establish an abstract, effective, exponential large deviations type estimate for Markov systems satisfying a weaker form of mixing. We employ this result to derive such estimates, as well as a central limit theorem, for the skew product…

Dynamical Systems · Mathematics 2025-07-17 Ao Cai , Pedro Duarte , Silvius Klein

Consider longitudinal networks whose edges turn on and off according to a discrete-time Markov chain with exponential-family transition probabilities. We characterize when their joint distributions are also exponential families with the…

Methodology · Statistics 2024-03-12 William K. Schwartz , Sonja Petrović , Hemanshu Kaul

In this paper we consider the field of local times of a discrete-time Markov chain on a general state space, and obtain uniform (in time) upper bounds on the total variation distance between this field and the one of a sequence of $n$…

Probability · Mathematics 2019-03-25 Diego F. de Bernardini , Christophe Gallesco , Serguei Popov

We present a general method to identify an arbitrary number of fluctuating quantities which satisfy a detailed fluctuation theorem for all times within the framework of time-inhomogeneous Markovian jump processes. In doing so we provide a…

Statistical Mechanics · Physics 2018-10-11 Riccardo Rao , Massimiliano Esposito