Related papers: Ergodic BSDEs driven by Markov Chains
The consistency of the Bayesian estimation of a parameter is shown for a class of ergodic discrete Markov chains. J.L. Doob's method was used, offered earlier for the i.i.d. situation. The result may be useful in the reliability theory for…
Given access to a single long trajectory generated by an unknown irreducible Markov chain $M$, we simulate an $\alpha$-lazy version of $M$ which is ergodic. This enables us to generalize recent results on estimation and identity testing…
We introduce and analyze a new class of monotone stochastic recursions in a regenerative environment which is essentially broader than that of Markov chains. We prove stability theorems and apply our results {to three canonical models in…
Applying quantitative perturbation theory for linear operators, we prove non-asymptotic limit theorems for Markov chains whose transition kernel has a spectral gap in an arbitrary Banach algebra of functions X . The main results are…
Markov chains are fundamental models for stochastic dynamics, with applications in a wide range of areas such as population dynamics, queueing systems, reinforcement learning, and Monte Carlo methods. Estimating the transition matrix and…
In this short note we consider RBSDE with Lipschitz drivers and barrier processes that are optional and right upper semicontinuous. We treat the case when the barrier can be represented as a decreasing limit of cadlag barriers. We combine…
We develop a theory of weak Poincar\'e inequalities to characterize convergence rates of ergodic Markov chains. Motivated by the application of Markov chains in the context of algorithms, we develop a relevant set of tools which enable the…
We study inhomogeneous continuous-time weakly ergodic Markov chains with a finite state space. We introduce the notion of a Markov chain with the regular structure of an infinitesimal matrix and study the sharp upper bounds on the rate of…
We show that singular stochastic delay differential equations (SDDEs) induce cocycle maps on a field of Banach spaces. A general Multiplicative Ergodic Theorem on fields of Banach spaces is proved and applied to linear SDDEs. In Part II of…
In this paper, we consider dynamic risk measures induced by backward stochastic differential equations (BSDEs). We discuss different examples that come up in the literature, including the entropic risk measure and the risk measure arising…
The authors consider stochastic aspects of the stabilization problem for two and three-dimensional Oseen equations with help of feedback control defined on a part of the fluid boundary. Stochastic issues arise when inevitable unpredictable…
We introduce a class of Markov chains, that contains the model of stochastic approximation by averaging and non-averaging. Using martingale approximation method, we establish various deviation inequalities for separately Lipschitz functions…
It is well known that stationary geometrically ergodic Markov chains are $\beta$-mixing (absolutely regular) with geometrically decaying mixing coefficients. Furthermore, for initial distributions other than the stationary one, geometric…
In this paper, we establish novel concentration inequalities for additive functionals of geometrically ergodic Markov chains similar to Rosenthal inequalities for sums of independent random variables. We pay special attention to the…
In this paper, we study a collection of mean-reflected backward stochastic differential equations driven by $G$-Brownian motions ($G$-BSDEs), where $G$-expectations are constrained in some time-dependent intervals. To establish…
In this paper we study the ergodicity properties of some adaptive Markov chain Monte Carlo algorithms (MCMC) that have been recently proposed in the literature. We prove that under a set of verifiable conditions, ergodic averages calculated…
Motivated by a model presented by S. Gudder, we study a quantum generalization of Markov chains and discuss the relation between these maps and open quantum random walks, a class of quantum channels described by S. Attal et al. We consider…
For the stochastic differential equation (SDE) which has piecewise continuous arguments (PCAs), is driven by multiplicative noises and its drift coefficients are dissipative, we show that the solution at integer time is a Markov chain and…
In this paper, we prove the validity of an averaging principle for multi-valued stochastic differential equations (MSDEs) driven by G-Brownian motion with non-Lipschitz coefficients. The convergence theorem between the solution of the…
We provide a criterion for establishing lower bounds on the rate of convergence in $f$-variation of a continuous-time ergodic Markov process to its invariant measure. The criterion consists of novel super- and submartingale conditions for…