相关论文: Stable states of perturbed Markov chains

A discrete-time Markov chain can be transformed into a new Markov chain by looking at its states along iterations of an almost surely finite stopping time. By the optional stopping theorem, any bounded harmonic function with respect to the…

A spectral method for identifying lumping in large Markov chains is presented. Identification of meta stable states is treated as a special case. The method is based on spectral analysis of a self-adjoint matrix that is a function of the…

We consider randomly forced 2D Navier-Stokes equations in a bounded domain with smooth boundary. It is assumed that the random perturba- tion is non-degenerate, and its law is periodic in time and has a support localised with respect to…

We address a class of Markov jump linear systems that are characterized by the underlying Markov process being time-inhomogeneous with a priori unknown transition probabilities. Necessary and sufficient conditions for uniform stochastic…

This work investigates the almost sure stabilization of a class of regime-switching systems based on discrete-time observations of both continuous and discrete components. It develops Shao's work [SIAM J. Control Optim., 55(2017), pp.…

From the perspective of probability, the stability of growing network is studied in the present paper. Using the DMS model as an example, we establish a relation between the growing network and Markov process. Based on the concept and…

For a Markov decision process with countably infinite states, the optimal value may not be achievable in the set of stationary policies. In this paper, we study the existence conditions of an optimal stationary policy in a countable-state…

In this paper we consider the global stability of solutions of an affine stochastic differential equation. The differential equation is a perturbed version of a globally stable linear autonomous equation with unique zero equilibrium where…

We consider a class of parametrically forced Hamiltonian systems with one-and-a-half degrees of freedom and study the stability of the dynamics when the frequency of the forcing is relatively high or low. We show that, provided the…

We consider the stabilization of an unstable discrete-time linear system that is observed over a channel corrupted by continuous multiplicative noise. Our main result shows that if the system growth is large enough, then the system cannot…

We revisit processes generated by iterated random functions driven by a stationary and ergodic sequence. Such a process is called strongly stable if a random initialization exists, for which the process is stationary and ergodic, and for…

We study the stable behaviour of discrete dynamical systems where the map is convex and monotone with respect to the standard positive cone. The notion of tangential stability for fixed points and periodic points is introduced, which is…

In this paper we continue our work on adiabatic time of time-inhomogeneous Markov chains first introduced in Kovchegov (2010) and Bradford and Kovchegov (2011). Our study is an analog to the well-known Quantum Adiabatic (QA) theorem which…

We introduce the notion of order of magnitude reversibility (OM-reversibility) in Markov chains that are parametrized by a positive parameter $\ep$. OM-reversibility is a weaker condition than reversibility, and requires only the knowledge…

We consider continuous-time Markov chains which display a family of wells at the same depth. We provide sufficient conditions which entail the convergence of the finite-dimensional distributions of the order parameter to the ones of a…

In this paper we consider random dynamical systems formed by concatenating maps acting on the unit interval $[0,1]$ in an iid fashion. Considered as a stationary Markov process, the random dynamical system possesses a unique stationary…

We investigate the uniform stability properties of discrete-time linear switched systems subject to arbitrary switching, focusing on the "marginally unstable" regime in which the system is not Lyapunov stable but in which trajectories…

We study a large class of reversible Markov chains with discrete state space and transition matrix $P_N$. We define the notion of a set of {\it metastable points} as a subset of the state space $\G_N$ such that (i) this set is reached from…

We consider Backward Stochastic Differential Equations in a setting where noise is generated by a countable state, continuous time Markov chain, and the terminal value is prescribed at a stopping time. We show that, given sufficient…

During the past 15 years, several extensions of the concepts noise sensitivity and noise stability, first coined in~\cite{schramm2000}, has been studied. The purpose in this paper is to give definitions of this concepts in the setting of…