Related papers: Regular perturbation of V -geometrically ergodic M…
The use of higher-order stochastic processes such as nonlinear Markov chains or vertex-reinforced random walks is significantly growing in recent years as they are much better at modeling high dimensional data and nonlinear dynamics in…
For a discrete time Markov chain and in line with Strotz' consistent planning we develop a framework for problems of optimal stopping that are time-inconsistent due to the consideration of a non-linear function of an expected reward. We…
Through this paper we analyze the ergodic properties of continuous time Markov chains with values on the one-dimensional spin lattice 1,...,d}^N (also known as the Bernoulli space). Initially, we consider as the infinitesimal generator the…
Non-linear Hawkes processes with memory kernels given by the sum of Erlang kernels are considered. It is shown that their stability properties can be studied in terms of an associated class of piecewise deterministic Markov processes,…
Recently, an Enskog-type kinetic theory for Vicsek-type models for self-propelled particles has been proposed [T. Ihle, Phys. Rev. E 83, 030901 (2011)]. This theory is based on an exact equation for a Markov chain in phase space and is not…
For both continuous-time and discrete-time Markov Chains, we provide criteria for inverse problems of classical types of ergodicity: (ordinary) erogodicity, algebraic ergodicity, exponential ergodicity and strong ergodicity. Our criteria…
We study a class of stochastic models of mass transport on discrete vertex set $V$. For these models, a one-parameter family of homogeneous product measures $\otimes_{i\in V} \nu_\theta$ is reversible. We prove that the set of mixtures of…
We consider a stochastic conservation law on the line with solution-dependent diffusivity, a super-linear, sub-quadratic Hamiltonian, and smooth, spatially-homogeneous kick-type random forcing. We show that this Markov process admits a…
In this paper we find nonasymptotic exponential upper bounds for the deviation in the ergodic theorem for families of homogeneous Markov processes. We find some sufficient conditions for geometric ergodicity uniformly over a parametric…
The paper is devoted to the estimation of the rate of of exponential convergence of nonhomogeneous queues exhibiting different types of ergodicity. The main tool of our study is the method, which was proposed by the second author in the…
Ergodic properties of the signal-filtering pair are studied for continuous time finite Markov chains, observed in white noise. The obtained law of large numbers is applied to the stability problem of the nonlinear filter with respect to…
We justify and discuss expressions for joint lower and upper expectations in imprecise probability trees, in terms of the sub- and supermartingales that can be associated with such trees. These imprecise probability trees can be seen as…
The asymptotic normality in multi-dimension of the nonparametric estimator of the transition probabilities of a Markov renewal chain is proved, and is applied to that of other nonparametric estimators involved with the associated…
We study a class of dynamical systems generated by random substitutions, which contains both intrinsically ergodic systems and instances with several measures of maximal entropy. In this class, we show that the measures of maximal entropy…
This work aims to investigate the well-posedness and the existence of ergodic invariant measures for a class of third grade fluid equations in bounded domain $D\subset\mathbb{R}^d,d=2,3,$ in the presence of a multiplicative noise. First, we…
Certain steady states of the Vlasov-Poisson system can be characterized as minimizers of an energy-Casimir functional, and this fact implies a nonlinear stability property of such steady states. In previous investigations by Y. Guo and the…
It is known that state-dependent, multi-step Lyapunov bounds lead to greatly simplified verification theorems for stability for large classes of Markov chain models. This is one component of the "fluid model" approach to stability of…
We consider a bivariate stationary Markov chain $(X_n,Y_n)_{n\ge0}$ in a Polish state space, where only the process $(Y_n)_{n\ge0}$ is presumed to be observable. The goal of this paper is to investigate the ergodic theory and stability…
A 3D stochastic Navier-Stokes equation with a suitable non degenerate additive noise is considered. The regularity in the initial conditions of every Markov transition kernel associated to the equation is studied by a simple direct…
This work aims to investigate the existence of ergodic invariant measures and its uniqueness, associated with obstacle problems governed by a T-monotone operator defined on Sobolev spaces and driven by a multiplicative noise in a bounded…