Related papers: Markov chain approximations for nonsymmetric proce…
We introduce a class of Markov chains, that contains the model of stochastic approximation by averaging and non-averaging. Using martingale approximation method, we establish various deviation inequalities for separately Lipschitz functions…
We consider sequences $(X_t^N)_{t\geq0}$ of Markov processes in two dimensions whose fluid limit is a stable solution of an ordinary differential equation of the form $\dot{x}_t=b(x_t)$, where $b(x)={\pmatrix{-\mu 0 0 \lambda}}x+\tau(x)$…
Oscillatory systems of interacting Hawkes processes with Erlang memory kernels were introduced in Ditlevsen (2017). They are piecewise deterministic Markov processes (PDMP) and can be approximated by a stochastic diffusion. First, a strong…
Many applications in networked control require intermittent access of a controller to a system, as in event-triggered systems or information constrained control applications. Motivated by such applications and extending previous work on…
We present discrete-time approximation of optimal control policies for infinite horizon discounted/ergodic control problems for controlled diffusions in $\Rd$\,. In particular, our objective is to show near optimality of optimal policies…
The problem of efficiently sampling from a set of(undirected) graphs with a given degree sequence has many applications. One approach to this problem uses a simple Markov chain, which we call the switch chain, to perform the sampling. The…
This paper introduces Discrete Markov Probabilistic Models (DMPMs), a novel discrete diffusion algorithm for discrete data generation. The algorithm operates in discrete bit space, where the noising process is a continuous-time Markov chain…
This review paper provides an introduction of Markov chains and their convergence rates which is an important and interesting mathematical topic which also has important applications for very widely used Markov chain Monte Carlo (MCMC)…
We study distributions of meeting times for finite symmetric Markov chains. For Markov kernels defined on large state spaces which satisfy certain weak inhomogeneity in return probabilities of points up to large numbers of steps, we obtain…
We present a recurrence-transience classification for discrete-time Markov chains on manifolds with negative curvature. Our classification depends only on geometric quantities associated to the increments of the chain, defined via the…
In this paper, we study discrete approximation of reflected Brownian motions on domains in Euclidean space. Our approximation is given by a sequence of Markov chains on partitions of the domain, where we allow uneven or random partitions.…
Convergence rate to the stationary distribution for continuous-time Markov processes can be studied using Lyapunov functions. Recent work by the author provided explicit rates of convergence in special case of a reflected jump-diffusion on…
For a class of stochastic differential equations with reflection for which a certain ${\mathbb{L}}^p$ continuity condition holds with $p>1$, it is shown that any weak solution that is a strong Markov process can be decomposed into the sum…
We consider a hidden Markov model, where the signal process, given by a diffusion, is only indirectly observed through some noisy measurements. The article develops a variational method for approximating the hidden states of the signal…
We study the local regularity and multifractal nature of the sample paths of jump diffusion processes, which are solutions to a class of stochastic differential equations with jumps. This article extends the recent work of Barral {\it et…
The statement of the mean field approximation theorem in the mean field theory of Markov processes particularly targets the behaviour of population processes with an unbounded number of agents. However, in most real-world engineering…
We study the symmetry of large deviation functions associated with time-integrated currents in Markov pure jump processes. One current known to have this symmetry is the fluctuating entropy production and this is the content of the…
In a first part, we prove Bernstein-type deviation inequalities for bifurcating Markov chains (BMC) under a geometric ergodicity assumption, completing former results of Guyon and Bitseki Penda, Djellout and Guillin. These preliminary…
We consider nonlinear drift-diffusion equations (both porous medium equations and fast diffusion equations) with a measure-valued external force. We establish existence of nonnegative weak solutions satisfying gradient estimates, provided…
This paper deals with a copies-based continuously differentiable and strictly decreasing estimator of the drift function for stochastic differential equations defining recurrent diffusion processes. The first part of our paper deals with…