English
Related papers

Related papers: Finite Markov chains coupled to general Markov pro…

200 papers

In this work, we are concerned with existence and uniqueness of invariant measures for path-dependent random diffusions and their time discretizations. The random diffusion here means a diffusion process living in a random environment…

Probability · Mathematics 2017-06-20 Jianhai Bao , Jinghai Shao , Chenggui Yuan

We address the problem of likelihood based inference for correlated diffusion processes using Markov chain Monte Carlo (MCMC) techniques. Such a task presents two interesting problems. First, the construction of the MCMC scheme should…

Statistical Finance · Quantitative Finance 2008-12-02 Konstantinos Kalogeropoulos , Petros Dellaportas , Gareth O. Roberts

We raise a question on whether a dynamical system driven by Markov process is Markovian, for which we are able to propose a criterion and examples of positive case. This investigation leads us to develop (i) a general construction of…

Probability · Mathematics 2019-08-22 Motoya Machida

Daily, are reported systems in nature that present anomalous diffusion phenomena due to irregularities of medium, traps or reactions process. In this scenario, the diffusion with traps or localised--reactions emerge through various…

Statistical Mechanics · Physics 2019-05-01 Maike A. F. dos Santos

In this paper, we utilize event-triggered coupling configuration to realize synchronization of linearly coupled dynamical systems. Here, the diffusion couplings are set up from the latest observations of the nodes of its neighborhood and…

Adaptation and Self-Organizing Systems · Physics 2015-02-13 Wenlian Lu , Yujuan Han , Tianping Chen

We develop a convergent variational perturbation theory for conditional probability densities of Markov processes. The power of the theory is illustrated by applying it to the diffusion of a particle in an anharmonic potential.

Condensed Matter · Physics 2009-11-07 Hagen Kleinert , Axel Pelster , Mihai V. Putz

In this note, we propose two different approaches to rigorously justify a pseudo-Markov property for controlled diffusion processes which is often (explicitly or implicitly) used to prove the dynamic programming principle in the stochastic…

Probability · Mathematics 2015-01-19 Julien Claisse , Denis Talay , Xiaolu Tan

We consider the problem of learning two families of time-evolving random measures from indirect observations. In the first model, the signal is a Fleming--Viot diffusion, which is reversible with respect to the law of a Dirichlet process,…

Statistics Theory · Mathematics 2014-11-19 Omiros Papaspiliopoulos , Matteo Ruggiero , Dario Spanò

A Markov chain (MC) formalism is used to investigate the mean-square displacement (MSD) of a random walker on Newman-Watts (NW) networks. It leads to a precise analysis of the conditions for the emergence of anomalous sub- or…

The aim of this article is to prove that diffusion processes in $\mathbb{R}^d$ with a drift can be approximated by suitable Markov chains on $n^{-1}\mathbb{Z}^d$. Moreover, we investigate sufficient conditions on the conductances which…

Probability · Mathematics 2022-05-03 Marvin Weidner

We study the dynamical exponents $d_{w}$ and $d_{s}$ for a particle diffusing in a disordered medium (modeled by a percolation cluster), from the regime of extreme disorder (i.e., when the percolation cluster is a fractal at $p=p_{c}$) to…

Condensed Matter · Physics 2009-10-22 Sonali Mukherjee , Hisao Nakanishi , Norman H. Fuchs

We study ergodic properties of some Markov chains models in random environments when the random Markov kernels that define the dynamic satisfy some usual drift and small set conditions but with random coefficients. In particular, we adapt a…

Probability · Mathematics 2021-08-16 Lionel Truquet

The extremes of a univariate Markov chain with regulary varying stationary marginal distribution and asymptotically linear behavior are known to exhibit a multiplicative random walk structure called the tail chain. In this paper, we extend…

Probability · Mathematics 2014-02-04 Anja Janßen , Johan Segers

We present a novel approach to quantizing Markov chains. The approach is based on the Markov chain coupling method, which is frequently used to prove fast mixing. Given a particular coupling, e.g., a grand coupling, we construct a…

Quantum Physics · Physics 2025-12-24 Kristan Temme , Pawel Wocjan

We consider a sequence of Markov chains weakly convergent to a diffusion. We suppose that a drift term contains a linearly increasing component. The usual parametrix method fails because of this unbounded drift term. We show how to modify…

Probability · Mathematics 2014-12-05 V. Konakov , A. Markova

We connect known results about diffusion limits of Markov chain Monte Carlo (MCMC) algorithms to the Computer Science notion of algorithm complexity. Our main result states that any diffusion limit of a Markov process implies a…

Probability · Mathematics 2014-11-05 Gareth O. Roberts , Jeffrey S. Rosenthal

In this paper we establish a diffusion limit for a multivariate continuous time Markov chain whose components are indexed by vertices of a finite graph. The components take values in a common finite set of non-negative integers and evolve…

Probability · Mathematics 2025-09-15 Anatolii Puhalskii , Vadim Shcherbakov

We consider a sequence of additive functionals {\phi_n}, set on a sequence of Markov chains {X_n} that weakly converges to a Markov process X. We give sufficient condition for such a sequence to converge in distribution, formulated in terms…

Probability · Mathematics 2007-05-23 Yuri N. Kartashov , Alexey M. Kulik

In this note we consider a Markov chain formed by a finite system of interacting birth-and-death processes on a finite state space. We study an asymptotic behaviour of the Markov chain as its state space becomes large. In particular, we…

Probability · Mathematics 2016-11-14 Vadim Shcherbakov , Anatoly Yambartsev

Continuous time random walks are non-Markovian stochastic processes, which are only partly characterized by single-time probability distributions. We derive a closed evolution equation for joint two-point probability density functions of a…

Statistical Mechanics · Physics 2009-11-13 A. Baule , R. Friedrich
‹ Prev 1 3 4 5 6 7 10 Next ›