English
Related papers

Related papers: Optimal Fluctuations for Discrete-time Markov Jump…

200 papers

Motivated by entropic optimal transport, time reversal of Markov jump processes in $\mathbb{R}^n$ is investigated. Relying on an abstract integration by parts formula for the carr\'e du champ of a Markov process recently obtained by…

Probability · Mathematics 2022-09-05 Giovanni Conforti , Christian Léonard

We study the statistics of first passage times (FPTs) of trajectory observables in both classical and quantum Markov processes. We consider specifically the FPTs of counting observables, that is, the times to reach a certain threshold of a…

Statistical Mechanics · Physics 2024-05-17 George Bakewell-Smith , Federico Girotti , Mădălin Guţă , Juan P. Garrahan

Many complex real world phenomena exhibit abrupt, intermittent or jumping behaviors, which are more suitable to be described by stochastic differential equations under non-Gaussian L\'evy noise. Among these complex phenomena, the most…

Numerical Analysis · Mathematics 2023-09-15 Wei Wei , Ting Gao , Jinqiao Duan , Xiaoli Chen

This work introduces and studies a new family of velocity jump Markov processes directly amenable to exact simulation with the following two properties: i) trajectories converge in law when a time-step parameter vanishes towards a given…

Numerical Analysis · Mathematics 2020-09-15 Pierre Monmarché , Mathias Rousset , Pierre-André Zitt

In the course of Darwinian evolution of a population, punctualism is an important phenomenon whereby long periods of genetic stasis alternate with short periods of rapid evolutionary change. This paper provides a mathematical interpretation…

Probability · Mathematics 2009-03-17 Nicolas Champagnat

In this paper, we study a continuous-time discounted jump Markov decision process with both controlled actions and observations. The observation is only available for a discrete set of time instances. At each time of observation, one has to…

Optimization and Control · Mathematics 2019-07-16 Yunhan Huang , Veeraruna Kavitha , Quanyan Zhu

The time it takes the fastest searcher out of $N\gg1$ searchers to find a target determines the timescale of many physical, chemical, and biological processes. This time is called an extreme first passage time (FPT) and is typically much…

Probability · Mathematics 2019-12-10 Sean D Lawley

We derive various exact results for Markovian systems that spontaneously relax to a non-equilibrium steady-state by using joint probability distributions symmetries of different entropy production decompositions. The analytical approach is…

Statistical Mechanics · Physics 2012-02-10 Reinaldo García-García , Vivien Lecomte , A. B. Kolton , D. Domínguez

The search for hidden targets is a fundamental problem in many areas of science, engineering, and other fields. Studies of search processes often adopt a probabilistic framework, in which a searcher randomly explores a spatial domain for a…

Probability · Mathematics 2021-03-16 Sean D Lawley

The study of time-inhomogeneous Markov jump processes is a traditional topic within probability theory that has recently attracted substantial attention in various applications. However, their flexibility also incurs a substantial…

Probability · Mathematics 2023-11-03 Martin Bladt , Oscar Peralta

Using the Feynman-Kac and Cameron-Martin-Girsanov formulas, we obtain a generalized integral fluctuation theorem (GIFT) for discrete jump processes by constructing a time-invariable inner product. The existing discrete IFTs can be derived…

Statistical Mechanics · Physics 2009-06-11 Fei Liu , Yu-Pin Luo , Ming-Chang Huang , Zhong-can Ou-Yang

This paper introduces a novel methodology for the identification of switching dynamics for switched autoregressive linear models. Switching behavior is assumed to follow a Markov model. The system's outputs are contaminated by possibly…

Signal Processing · Electrical Eng. & Systems 2019-03-28 Sarah Hojjatinia , Constantino M. Lagoa

We consider the inverse problem of reconstructing the posterior measure over the trajec- tories of a diffusion process from discrete time observations and continuous time constraints. We cast the problem in a Bayesian framework and derive…

Machine Learning · Statistics 2016-12-21 Botond Cseke , David Schnoerr , Manfred Opper , Guido Sanguinetti

Piecewise-deterministic Markov processes form a general class of non-diffusion stochastic models that involve both deterministic trajectories and random jumps at random times. In this paper, we state a new characterization of the jump rate…

Methodology · Statistics 2017-05-03 Romain Azaïs , Alexandre Genadot

Although higher-order interactions are known to affect the typical state of dynamical processes giving rise to new collective behavior, how they drive the emergence of rare events and fluctuations is still an open problem. We investigate…

Disordered Systems and Neural Networks · Physics 2024-09-09 Leonardo Di Gaetano , Giorgio Carugno , Federico Battiston , Francesco Coghi

This paper considers the optimal control of time varying continuous time Markov chains whose transition rates are themselves Markov processes. In one set of problems the solution of an ordinary differential equation is shown to determine…

Systems and Control · Computer Science 2015-09-02 Manish Gupta

We study the probability distribution and the escape rate in systems with delayed dissipation that comes from the coupling to a thermal bath. To logarithmic accuracy in the fluctuation intensity, the problem is reduced to a variational…

Statistical Mechanics · Physics 2015-06-04 M. I. Dykman , I. B. Schwartz

In 2008, T\'oth and Vet\H{o} defined the self-repelling random walk with directed edges as a non-Markovian random walk on $\mathbb{Z}$: in this model, the probability that the walk moves from a point of $\mathbb{Z}$ to a given neighbor…

Probability · Mathematics 2026-01-14 Laure Marêché

Markov processes with stochastic resetting towards the origin generically converge towards non-equilibrium steady-states. Long dynamical trajectories can be thus analyzed via the large deviations at Level 2.5 for the joint probability of…

Statistical Mechanics · Physics 2021-05-07 Cecile Monthus

In a growing number of strongly disordered and dense systems, the dynamics of a particle pulled by an external force field exhibits super-diffusion. In the context of glass forming systems, super cooled glasses and contamination spreading…

Statistical Mechanics · Physics 2019-12-18 Wanli Wang , Alessandro Vezzani , Raffaella Burioni , Eli Barkai