English
Related papers

Related papers: Stable states of perturbed Markov chains

200 papers

Linear systems governed by continuous-time difference equations cover a wide class of linear systems. From the Lyapunov-Krasovskii approach, we investigate stability for such a class of systems. Sufficient conditions, and in some particular…

Optimization and Control · Mathematics 2013-12-30 S. Damak , M. Di Loreto , W. Lombardi , V Andrieu

We consider the computational task of sampling a bit string $x$ from a distribution $\pi(x)=|\langle x|\psi\rangle|^2$, where $\psi$ is the unique ground state of a local Hamiltonian $H$. Our main result describes a direct link between the…

Quantum Physics · Physics 2023-11-09 Sergey Bravyi , Giuseppe Carleo , David Gosset , Yinchen Liu

A sequence of real numbers (x_n) is Benford if the significands, i.e. the fraction parts in the floating-point representation of (x_n) are distributed logarithmically. Similarly, a discrete-time irreducible and aperiodic finite-state Markov…

Probability · Mathematics 2010-03-05 Bahar Kaynar , Arno Berger , Theodore P. Hill , Ad Ridder

In this paper, we focus on discrete-time stochastic systems modelled by nonlinear stochastic difference equations and propose robust abstractions for verifying probabilistic linear temporal specifications. The current literature focuses on…

Probability · Mathematics 2022-05-05 Yiming Meng , Jun Liu

We present a linear stability analysis of stationary states (or fixed points) in large dynamical systems defined on random directed graphs with a prescribed distribution of indegrees and outdegrees. We obtain two remarkable results for such…

Statistical Mechanics · Physics 2024-05-22 Izaak Neri , Fernando Lucas Metz

We introduce the problem of stability verification of quantum sources which are non-i.i.d.. The problem consists in ascertaining whether a given quantum source is stable or not, in the sense that it produces always a desired quantum state…

Quantum Physics · Physics 2023-08-28 Esteban Martínez-Vargas

We address the stability problem for linear switching systems with mode-dependent restrictions on the switching intervals. Their lengths can be bounded as from below (the guaranteed dwell-time) as from above. The upper bounds make this…

Optimization and Control · Mathematics 2022-06-01 Vladimir Yu. Protasov , Rinat Kamalov

For a discrete time Markov chain and in line with Strotz' consistent planning we develop a framework for problems of optimal stopping that are time-inconsistent due to the consideration of a non-linear function of an expected reward. We…

Optimization and Control · Mathematics 2020-01-23 Sören Christensen , Kristoffer Lindensjö

Perturbation analysis of Markov chains provides bounds on the effect that a change in a Markov transition matrix has on the corresponding stationary distribution. This paper compares and analyzes bounds found in the literature for finite…

Probability · Mathematics 2024-04-03 Karim Abbas , Joost Berkhout , Bernd Heidergott

This paper continues the discussion on the stability of time-inhomogeneous Markov chains. In particular, this paper defines a time-inhomogeneous, discrete-time Markov chain governed by a continuous evolution in the appropriate martrix…

Probability · Mathematics 2015-07-23 Kyle Bradford

We derive a sufficient condition for stability in probability of an equilibrium of a randomly perturbed map in ${\mathbb R}^d$. This condition can be used to stabilize weakly unstable equilibria by random forcing. Analytical results on…

Dynamical Systems · Mathematics 2017-05-16 Pawel Hitczenko , Georgi S. Medvedev

In real-world networks the interactions between network elements are inherently time-delayed. These time-delays can not only slow the network but can have a destabilizing effect on the network's dynamics leading to poor performance. The…

Optimization and Control · Mathematics 2024-09-23 David Reber , Benjamin Webb

Time delays are a common perturbation in systems with many states, such as networked, distributed, or decentralized systems. Current methods analyzing the stability of large systems with time delay typically produce very conservative…

Systems and Control · Computer Science 2017-10-31 George Armanious , Rick Lind

Randomly-assembled dynamical systems are theoretically predicted to be unstable upon crossing a critical threshold of complexity, as first shown by May. Yet, empirical complex systems exhibit remarkable stability, indicating the presence of…

Disordered Systems and Neural Networks · Physics 2026-03-31 Francesco Ferraro , Christian Grilletta , Amos Maritan , Samir Suweis , Sandro Azaele

We consider Markov chains that obey the following general non-linear state space model: $\Phi_{k+1} = F(\Phi_k, \alpha(\Phi_k, U_{k+1}))$ where the function $F$ is $C^1$ while $\alpha$ is typically discontinuous and $\{U_k: k \in…

Probability · Mathematics 2019-02-07 Alexandre Chotard , Anne Auger

We study limit theorems for partial sums of instantaneous functions of a homogeneous Markov chain on a general state space. The summands are heavy-tailed and the limits are stable distributions. The conditions imposed on the transition…

Probability · Mathematics 2018-08-14 Mohamed El Machkouri , Adam Jakubowski , Dalibor Volný

Under natural assumptions, an unstable equilibrium of a difference equation can be stabilized by a bounded multiplicative noise, identically distributed at each step. This includes stabilization of an otherwise unstable positive equilibrium…

Dynamical Systems · Mathematics 2022-08-22 Elena Braverman , Alexandra Rodkina

The paper is largely of a review nature. It considers two main methods used to study stability and obtain appropriate quantitative estimates of perturbations of (inhomogeneous) Markov chains with continuous time and a finite or countable…

Probability · Mathematics 2020-02-17 Alexander Zeifman , Victor Korolev , Yacov Satin

Perturbation theory for Markov chains addresses the question how small differences in the transitions of Markov chains are reflected in differences between their distributions. We prove powerful and flexible bounds on the distance of the…

Computation · Statistics 2017-02-27 Daniel Rudolf , Nikolaus Schweizer

Fixed-time stable dynamical systems are capable of achieving exact convergence to an equilibrium point within a fixed time that is independent of the initial conditions of the system. This property makes them highly appealing for designing…

Systems and Control · Electrical Eng. & Systems 2025-10-01 Michael Tang , Miroslav Krstic , Jorge Poveda