English
Related papers

Related papers: Finite Markov chains coupled to general Markov pro…

200 papers

Focusing on stochastic systems arising in mean-field models, the systems under consideration belong to the class of switching diffusions, in which continuous dynamics and discrete events coexist and interact. The discrete events are modeled…

Probability · Mathematics 2019-01-18 Son L. Nguyen , George Yin , Tuan A. Hoang

Using the renewal approach we prove exponential inequalities for additive functionals and empirical processes of ergodic Markov chains, thus obtaining counterparts of inequalities for sums of independent random variables. The inequalities…

Probability · Mathematics 2013-10-18 Radosław Adamczak , Witold Bednorz

A sequence of real numbers (x_n) is Benford if the significands, i.e. the fraction parts in the floating-point representation of (x_n) are distributed logarithmically. Similarly, a discrete-time irreducible and aperiodic finite-state Markov…

Probability · Mathematics 2010-03-05 Bahar Kaynar , Arno Berger , Theodore P. Hill , Ad Ridder

In this short note we provide an elementary proof that a certain type of nonuniform sequential Doeblin minorization condition implies non-uniform sequential "geometric" ergodicity. Using this result several limit theorems for inhomogeneous…

Probability · Mathematics 2025-10-20 Yeor Hafouta , Brenden Williams

Maximal couplings are (probabilistic) couplings of Markov processes such that the tail probabilities of the coupling time attain the total variation lower bound (Aldous bound) uniformly for all time. Markovian (or immersion) couplings are…

Probability · Mathematics 2016-03-29 Sayan Banerjee , Wilfrid S. Kendall

Convergence diagnosis for Markov chain Monte Carlo is a matter of fundamental importance in computational statistics: it determines the resources allocated to a particular sampling problem and influences the practitioner's view of the…

Computation · Statistics 2026-05-14 Buu Phan , Gergely Flamich , Ashish Khisti , Shahab Asoodeh

We study a simple model of a random walker in d dimensions moving in the presence of a local heterogeneous attracting factor expressed in terms of an assigned space-dependent "attractiveness function", a situation frequently encountered in…

Statistical Mechanics · Physics 2017-06-21 Hardi Veermäe , Marco Patriarca

A theory of symbolic dynamic systems with long-range correlations based on the consideration of the binary N-step Markov chains developed earlier in Phys. Rev. Lett. 90, 110601 (2003) is generalized to the biased case (non equal numbers of…

Data Analysis, Statistics and Probability · Physics 2015-06-26 Z. A. Mayzelis , S. S. Apostolov , S. S. Mel'nyk , O. V. Usatenko , V. A. Yampol'skii

Movements of molecular motors on cytoskeletal filaments are described by directed walks on a line. Detachment from this line is allowed to occur with a small probability. Motion in the surrounding fluid is described by symmetric random…

Statistical Mechanics · Physics 2007-05-23 Theo M. Nieuwenhuizen , Stefan Klumpp , Reinhard Lipowsky

We prove an averaging principle which asserts convergence of diffusion processes on domains separated by semi-permeable membranes, when diffusion coefficients tend to infinity while the flux through the membranes remains constant. In the…

Functional Analysis · Mathematics 2019-08-08 Adam Bobrowski , Bogdan Kazmierczak , Markus Kunze

The diffusion properties of self-propelled particles which move at constant speed and, in addition, reverse their direction of motion repeatedly are investigated. The internal dynamics of particles triggering these reversal processes is…

Biological Physics · Physics 2016-05-30 Robert Großmann , Fernando Peruani , Markus Bär

The formal verification of large probabilistic models is important and challenging. Exploiting the concurrency that is often present is one way to address this problem. Here we study a restricted class of asynchronous distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-08-06 Sumit Kumar Jha , Madhavan Mukund , Ratul Saha , P S Thiagarajan

We exhibit conditions under which the flow of marginal distributions of a discontinuous semimartingale $\xi$ can be matched by a Markov process, whose infinitesimal generator is expressed in terms of the local characteristics of $\xi$. Our…

Probability · Mathematics 2012-05-17 Amel Bentata , Rama Cont

We establish a local martingale $M$ associate with $f(X,Y)$ under some restrictions on $f$, where $Y$ is a process of bounded variation (on compact intervals) and either $X$ is a jump diffusion (a special case being a L\'evy process) or $X$…

Probability · Mathematics 2017-11-22 Offer Kella , Marc Yor

We introduce the Space-Time Markov Chain Approximation (STMCA) for a general diffusion process on a finite metric graph $\Gamma$. The STMCA is a doubly asymmetric (in both time and space) random walk defined on a subdivisions of $\Gamma$,…

Probability · Mathematics 2025-08-01 Alexis Anagnostakis

We present a coupling framework to upper bound the total variation mixing time of various Metropolis-adjusted, gradient-based Markov kernels in the `high acceptance regime'. The approach uses a localization argument to boost local mixing of…

Probability · Mathematics 2024-06-24 Nawaf Bou-Rabee , Stefan Oberdörster

We study the asymptotics of a two-dimensional stochastic differential system with a degenerate diffusion matrix. This system describes the dynamics of a population where individuals contribute to the degradation of their environment through…

Dynamical Systems · Mathematics 2024-05-06 Pierre Collet , Claire Ecotière , Sylvie Méléard

In this work, we consider a finite-state inhomogeneous-time Markov chain whose probabilities of transition from one state to another tend to decrease over time. This can be seen as a cooling of the dynamics of an underlying Markov chain. We…

Probability · Mathematics 2017-05-08 Florian Bouguet , Bertrand Cloez

We study a kinetic toy model for a spray of particles immersed in an ambient fluid, subject to some additional random forcing given by a mixing, space-dependent Markov process. Using the perturbed test function method, we derive the…

Analysis of PDEs · Mathematics 2020-05-20 Arnaud Debussche , Angelo Rosello , Julien Vovelle

This paper aims at improving the convergence to equilibrium of finite ergodic Markov chains via permutations and projections. First, we prove that a specific mixture of permuted Markov chains arises naturally as a projection under the KL…

Probability · Mathematics 2025-07-22 Michael C. H. Choi , Max Hird , Youjia Wang