English
Related papers

Related papers: Stable states of perturbed Markov chains

200 papers

A hidden Markov model is called observable if distinct initial laws give rise to distinct laws of the observation process. Observability implies stability of the nonlinear filter when the signal process is tight, but this need not be the…

Probability · Mathematics 2009-08-10 Ramon van Handel

Metastability is a physical phenomenon ubiquitous in first order phase transitions. A fruitful mathematical way to approach this phenomenon is the study of rare transitions Markov chains. For Metropolis chains associated with Statistical…

Probability · Mathematics 2015-09-30 Emilio Cirillo , Francesca Nardi , Julien Sohier

We address the problem of estimating the mixing time $t_{\mathsf{mix}}$ of an arbitrary ergodic finite-state Markov chain from a single trajectory of length $m$. The reversible case was addressed by Hsu et al. [2019], who left the general…

Statistics Theory · Mathematics 2022-08-17 Geoffrey Wolfer , Aryeh Kontorovich

Our recent interest is focused on establishing the necessary and sufficient conditions that guarantee a long-term stable evolution of both natural and artificial systems. Two necessary conditions, called global and local boundedness, are…

Statistical Mechanics · Physics 2007-05-23 Maria K. Koleva , L. A. Petrov

The influence of small random perturbations on a deterministic dynamical system with a locally stable equilibrium is considered. The perturbed system is described by the It\^{o} stochastic differential equation. It is assumed that the noise…

Mathematical Physics · Physics 2016-02-18 Oskar Sultanov

Many dynamical systems, including thermal, fluid, and multi-agent systems, can be represented as weighted graphs. In this paper we consider whether the unstable states of such systems can be observed from limited discrete-time measurement,…

Systems and Control · Electrical Eng. & Systems 2022-09-28 Uduak Inyang-Udoh , Michael Shanks , Neera Jain

This paper proposes a new approach to describe the stability of linear time-invariant systems via the torsion $\tau(t)$ of the state trajectory. For a system $\dot{r}(t)=Ar(t)$ where $A$ is invertible, we show that (1) if there exists a…

Optimization and Control · Mathematics 2020-01-07 Yuxin Wang , Huafei Sun , Yueqi Cao , Shiqiang Zhang

This paper presents new sufficient conditions for convergence and asymptotic or exponential stability of a stochastic discrete-time system, under which the constructed Lyapunov function always decreases in expectation along the system's…

Systems and Control · Computer Science 2019-06-05 Yuzhen Qin , Ming Cao , Brian D. O. Anderson

We present a general non-perturbative method to determine the exact steady state of open quantum systems under perturbation. The method works for systems with a unique steady state and the perturbation may be time-independent or periodic,…

Quantum Physics · Physics 2025-07-22 Omar Nagib , Thad G. Walker

In this paper we consider the global stability of solutions of a nonlinear stochastic differential equation. The differential equation is a perturbed version of a globally stable linear autonomous equation with unique zero equilibrium where…

Probability · Mathematics 2013-10-10 John A. D. Appleby , Jian Cheng , Alexandra Rodkina

We establish new conditions for obtaining uniform bounds on the moments of discrete-time stochastic processes. Our results require a weak negative drift criterion along with a state-dependent restriction on the sizes of the one-step jumps…

Probability · Mathematics 2022-06-02 Arnab Ganguly , Debasish Chatterjee

In this work, we study finite-time stability of switched and hybrid systems in the presence of unstable modes. We present sufficient conditions in terms of multiple Lyapunov functions for the origin of the system to be finite time stable.…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Kunal Garg , Dimitra Panagou

We consider perturbations of interval maps with indifferent fixed points, which we refer to as wobbly interval intermittent maps, for which stable laws for general H\"older observables fail. We obtain limit laws for such maps and H\"older…

Dynamical Systems · Mathematics 2020-11-24 Douglas Coates , Mark Holland , Dalia Terhesiu

An autonomous system of ordinary differential equations describing nonlinear oscillations on the plane is considered. The influence of time-dependent perturbations decaying at infinity in time is investigated. It is assumed that the…

Dynamical Systems · Mathematics 2023-05-29 Oskar A. Sultanov

We compute the stationary distribution of a continuous-time Markov chain which is constructed by gluing together two finite, irreducible Markov chains by identifying a pair of states of one chain with a pair of states of the other and…

Probability · Mathematics 2015-10-22 Bence Mélykúti , Peter Pfaffelhuber

This paper derives a somewhat surprising but interesting enough result on the stabilizability of discrete-time parameterized uncertain systems. Contrary to an intuition, it shows that the growth rate of a discrete-time stabilizable system…

Optimization and Control · Mathematics 2018-10-19 Zhaobo Liu , Chanying Li

A family $\{Q_{\beta}\}_{\beta \geq 0}$ of Markov chains is said to exhibit $\textit{metastable mixing}$ with $\textit{modes}$ $S_{\beta}^{(1)},\ldots,S_{\beta}^{(k)}$ if its spectral gap (or some other mixing property) is very close to the…

Probability · Mathematics 2021-07-01 Oren Mangoubi , Natesh S. Pillai , Aaron Smith

This work is concerned with the stability properties of linear stochastic differential equations with random (drift and diffusion) coefficient matrices, and the stability of a corresponding random transition matrix (or exponential…

Probability · Mathematics 2019-05-02 Adrian N. Bishop , Pierre Del Moral

A noisy damping parameter in the equation of motion of a nonlinear oscillator renders the fixed point of the system unstable when the amplitude of the noise is sufficiently large. However, the stability diagram of the system can not be…

Chaotic Dynamics · Physics 2016-08-16 Nicolas Leprovost , Sébatien Aumaitre , Kirone Mallick

This paper addresses stochastic stabilization in case where implementation of control policies is digital, i. e., when the dynamical system is treated continuous, whereas the control actions are held constant in predefined time steps. In…

Dynamical Systems · Mathematics 2022-11-08 Pavel Osinenko , Grigory Yaremenko
‹ Prev 1 4 5 6 7 8 10 Next ›