English
Related papers

Related papers: Up-down chains and scaling limits: application to …

200 papers

Second order recurrence of a $d$-dimensional diffusion with an additive Wiener process, with switching, and with one recurrent and one transient regime and constant switching intensities is established under suitable conditions. The…

Probability · Mathematics 2024-06-25 Alexander Veretennikov

Ordinary differential equations obtained as limits of Markov processes appear in many settings. They may arise by scaling large systems, or by averaging rapidly fluctuating systems, or in systems involving multiple time-scales, by a…

Probability · Mathematics 2014-03-24 Hye-Won Kang , Thomas G. Kurtz , Lea Popovic

In this short paper, we consider discrete-time Markov chains on lattices as approximations to continuous-time diffusion processes. The approximations can be interpreted as finite difference schemes for the generator of the process. We…

Probability · Mathematics 2016-11-08 Christoph Reisinger

A diffusion taking value in probability measures on a graph with a vertex set $V$, $\sum_{i\in V}x_i\delta_i$, is studied. The masses on each vertices satisfy the stochastic differential equation of the form $dx_i=\sum_{j\in…

Probability · Mathematics 2023-03-13 Shuhei Mano

The time to converge to the steady state of a finite Markov chain can be greatly reduced by a lifting operation, which creates a new Markov chain on an expanded state space. For a class of quadratic objectives, we show an analogous behavior…

Machine Learning · Statistics 2017-03-14 Guilherme França , José Bento

The main purpose of this article is to establish moderate deviation principles for additive functionals of bifurcating Markov chains. Bifurcating Markov chains are a class of processes which are indexed by a regular binary tree. They can be…

Probability · Mathematics 2021-05-21 S. Valère Bitseki Penda , Gorgui Gackou

The first aim of this paper is to introduce a class of Markov chains on $\mathbb{Z}_+$ which are discrete self-similar in the sense that their semigroups satisfy an invariance property expressed in terms of a discrete random dilation…

Probability · Mathematics 2022-03-08 Laurent Miclo , Pierre Patie , Rohan Sarkar

We study Markov chains for $\alpha$-orientations of plane graphs, these are orientations where the outdegree of each vertex is prescribed by the value of a given function $\alpha$. The set of $\alpha$-orientations of a plane graph has a…

Combinatorics · Mathematics 2023-06-22 Stefan Felsner , Daniel Heldt

We determine the scaling limit for permutations conditioned to have longest decreasing subsequence of length at most $d$. These permutations are also said to avoid the pattern $(d+1)d \cdots 2 1$ and they can be written as a union of $d$…

Probability · Mathematics 2023-01-09 Christopher Hoffman , Douglas Rizzolo , Erik Slivken

We introduce the Space-Time Markov Chain Approximation (STMCA) for a general diffusion process on a finite metric graph $\Gamma$. The STMCA is a doubly asymmetric (in both time and space) random walk defined on a subdivisions of $\Gamma$,…

Probability · Mathematics 2025-08-01 Alexis Anagnostakis

We give computable bounds on the rate of convergence of the transition probabilities to the stationary distribution for a certain class of geometrically ergodic Markov chains. Our results are different from earlier estimates of Meyn and…

Probability · Mathematics 2007-05-23 Peter H. Baxendale

The paper is devoted to studies of perturbed Markov chains commonly used for description of information networks. In such models, the matrix of transition probabilities for the corresponding Markov chain is usually regularised by adding a…

For downward skip-free continuous-time Markov chains on non-negative integers stopped at zero, existence of a quasi-stationary distribution is studied. The scale function for these processes is introduced and the boundary is classified by a…

Probability · Mathematics 2023-03-03 Kosuke Yamato

We consider a simple but important class of metastable discrete time Markov chains, which we call perturbed Markov chains. Basically, we assume that the transition matrices depend on a parameter $\varepsilon$, and converge as $\varepsilon$.…

Probability · Mathematics 2014-12-23 Volker Betz , Stéphane Le Roux

In this paper we consider large state space continuous time Markov chains (MCs) arising in the field of systems biology. For density dependent families of MCs that represent the interaction of large groups of identical objects, Kurtz has…

Performance · Computer Science 2015-03-04 Alessio Angius , Gianfranco Balbo , Marco Beccuti , Enrico Bibbona , Andras Horvath , Roberta Sirovich

Perturbation theory for Markov chains addresses the question how small differences in the transitions of Markov chains are reflected in differences between their distributions. We prove powerful and flexible bounds on the distance of the…

Computation · Statistics 2017-02-27 Daniel Rudolf , Nikolaus Schweizer

We consider uniform random permutations in classes having a finite combinatorial specification for the substitution decomposition. These classes include (but are not limited to) all permutation classes with a finite number of simple…

Motivated by robotic surveillance applications, this paper studies the novel problem of maximizing the return time entropy of a Markov chain, subject to a graph topology with travel times and stationary distribution. The return time entropy…

Optimization and Control · Mathematics 2018-05-29 Xiaoming Duan , Mishel George , Francesco Bullo

Recently it has been demonstrated that the connectivity transition from microscopic connectivity to macroscopic connectedness, known as percolation, is generically announced by a cascade of microtransitions of the percolation order…

Disordered Systems and Neural Networks · Physics 2016-01-25 Malte Schröder , Wei Chen , Jan Nagler

This study investigates the upward transport of waterborne pollutants from a lower container to an upper container through vertically falling water streams. While previous analyses have primarily focused on inclined channels, we extend the…

Fluid Dynamics · Physics 2025-04-24 D. Suárez-Fontanella , A. Cabo Montes de Oca