English
Related papers

Related papers: Markov chain approximations for nonsymmetric proce…

200 papers

In this paper, we study an approximation scheme for L\'evy processes with drift in terms of a representation that is akin to the celebrated Mehler formula for L\'evy-Ornstein-Uhlenbeck processes. The approximation scheme is based on a…

Probability · Mathematics 2025-11-25 Max Nendel

In this paper we investigate the continuum limits of a class of Markov chains. The investigation of such limits is motivated by the desire to model very large networks. We show that under some conditions, a sequence of Markov chains…

Networking and Internet Architecture · Computer Science 2011-06-22 Yang Zhang , Edwin K. P. Chong , Jan Hannig , Donald Estep

In this paper we study an asymptotic expansion for the distribution of a random motion of a particle driven by a Markov process in diffusion approximation. We show that the singularly perturbed equation of a Markovian random motion can be…

Probability · Mathematics 2012-03-21 A. Pogorui

We derive explicit upper bounds for the $\bar{d}$-distance between a chain of infinite order and its canonical $k$-steps Markov approximation. Our proof is entirely constructive and involves a "coupling from the past" argument. The new…

Probability · Mathematics 2012-01-16 Sandro Gallo , Matthieu Lerasle , Daniel Yasumasa Takahashi

In this article we consider a family of real-valued diffusion processes on the time interval $[0,1]$ indexed by their prescribed initial value $x \in \mathbb{R}$ and another point in space, $y \in \mathbb{R}$. We first present an…

Probability · Mathematics 2019-06-03 Florian Hildebrandt , Sylvie Rœlly

Diffusion processes have been widely used for approximations in the queueing theory. There are different types of diffusion approximations. Among them, we are interested in those obtained through limits of a sequence of models which…

Probability · Mathematics 2015-01-20 Masakiyo Miyazawa

We give conditions under which near-critical stochastic processes on the half-line have infinitely many or finitely many cutpoints, generalizing existing results on nearest-neighbour random walks to adapted processes with bounded increments…

Probability · Mathematics 2022-03-21 Chak Hei Lo , Mikhail V. Menshikov , Andrew R. Wade

In this paper, we study the asymptotic of exit problem for controlled Markov diffusion processes with random jumps and vanishing diffusion terms, where the random jumps are introduced in order to modify the evolution of the controlled…

Dynamical Systems · Mathematics 2018-02-08 Getachew K. Befekadu

We propose a new classification scheme for diffusion processes for which the backward Kolmogorov equation is solvable in analytically closed form by reduction to hypergeometric equations of the Gaussian or confluent type. The construction…

Probability · Mathematics 2009-09-29 Claudio Albanese , Alexey Kuznetsov

Irreversible drift-diffusion processes are very common in biochemical reactions. They have a non-equilibrium stationary state (invariant measure) which does not satisfy detailed balance. For the corresponding Fokker-Planck equation on a…

Numerical Analysis · Mathematics 2023-04-12 Yuan Gao , Jian-Guo Liu

We study the quenched invariance principle for random conductance models with long range jumps on $\Z^d$, where the transition probability from $x$ to $y$ is, on average, comparable to $|x-y|^{-(d+\alpha)}$ with $\alpha\in (0,2)$ but is…

Probability · Mathematics 2020-05-01 Xin Chen , Takashi Kumagai , Jian Wang

The Dirichlet form is a generalization of the Laplacian, heavily used in the study of many diffusion-like processes. In this paper we present a nonstandard representation theorem for the Dirichlet form, showing that the usual Dirichlet form…

Probability · Mathematics 2020-10-07 Robert M. Anderson , Haosui Duanmu , Aaron Smith

Random metastability occurs when an externally forced or noisy system possesses more than one state of apparent equilibrium. This work investigates fluctuations in a class of random dynamical systems, arising from randomly perturbing a…

Dynamical Systems · Mathematics 2025-05-30 Cecilia González-Tokman , Joshua Peters

We consider elliptic diffusion processes on $\mathbb R^d$. Assuming that the drift contracts distances outside a compact set, we prove that, at a sufficiently high temperature, the Markov semi-group associated to the process is a…

Probability · Mathematics 2023-07-20 Pierre Monmarché

We propose a particle system of diffusion processes coupled through a chain-like network structure described by an infinite-dimensional, nonlinear stochastic differential equation of McKean-Vlasov type. It has both (i) a local chain…

Probability · Mathematics 2019-07-18 Nils Detering , Jean-Pierre Fouque , Tomoyuki Ichiba

Hybrid systems, and Piecewise Deterministic Markov Processes in particular, are widely used to model and numerically study systems exhibiting multiple time scales in biochemical reaction kinetics and related areas. In this paper an almost…

Numerical Analysis · Mathematics 2011-12-07 Martin G. Riedler

The maximum likelihood approach is adapted to the problem of estimation of drift and diffusion functions of stochastic processes from measured time series. We reconcile a previously devised iterative procedure [Kleinhans et al., Physics…

Data Analysis, Statistics and Probability · Physics 2009-11-13 D. Kleinhans , R. Friedrich

We consider processes which are functions of finite-state Markov chains. It is well known that such processes are rarely Markov. However, such processes are often regular in the following sense: the distant past values of the process have…

Probability · Mathematics 2021-01-05 Steven Berghout , Evgeny Verbitskiy

In this paper, we focus on numerical approximations of Piecewise Diffusion Markov Processes (PDifMPs), particularly when the explicit flow maps are unavailable. Our approach is based on the thinning method for modelling the jump mechanism…

Numerical Analysis · Mathematics 2024-08-23 Evelyn Buckwar , Amira Meddah

We prove the existence of limiting distributions for a large class of Markov chains on a general state space in a random environment. We assume suitable versions of the standard drift and minorization conditions. In particular, the system…

Probability · Mathematics 2020-12-04 Attila Lovas , Miklós Rásonyi