Related papers: Quasi-Stationary Distributions for Stochastic Appr…
This paper considers a stochastic approximation algorithm, with decreasing step size and martingale difference noise. Under very mild assumptions, we prove the non convergence of this process toward a certain class of repulsive sets for the…
In a conformal invariant one-dimensional stochastic model, a certain non-local perturbation takes the system to a new massless phase of a special kind. The ground-state of the system is an adsorptive state. Part of the finite-size scaling…
Quasi-stationary distributions, as discussed by Darroch & Seneta (1965), have been used in biology to describe the steady state behaviour of population models which, while eventually certain to become extinct, nevertheless maintain an…
Quasi-stationary distributions, as discussed by Darroch & Seneta (1965), have been used in biology to describe the steady state behaviour of population models which, while eventually certain to become extinct, nevertheless maintain an…
We present a distributional approach to theoretical analyses of reinforcement learning algorithms for constant step-sizes. We demonstrate its effectiveness by presenting simple and unified proofs of convergence for a variety of…
We study numerically statistical distributions of sums of chaotic orbit coordinates, viewed as independent random variables, in weakly chaotic regimes of three multi-dimensional Hamiltonian systems: Two Fermi-Pasta-Ulam (FPU-$\beta$)…
For Markov processes with absorption, we provide general criteria ensuring the existence and the exponential non-uniform convergence in total variation norm to a quasi-stationary distribution. We also characterize a subset of its domain of…
We investigate the stationary distribution of asymmetric and weakly asymmetric simple exclusion processes with open boundaries. We project the stationary distribution onto a subinterval, whose size is allowed to grow with the length of the…
In this paper we study the asymptotic behavior of the normalized weighted empirical occupation measures of a diffusion process on a compact manifold which is killed at a smooth rate and then regenerated at a random location, distributed…
The application of the quasi-steady-state approximation to the Michaelis-Menten reaction embedded in large open chemical reaction networks is a popular model reduction technique in deterministic and stochastic simulations of biochemical…
The paper considers distributed stochastic optimization over randomly switching networks, where agents collaboratively minimize the average of all agents' local expectation-valued convex cost functions. Due to the stochasticity in gradient…
The quasi-steady-state approximation (or stochastic averaging principle) is a useful tool in the study of multiscale stochastic systems, giving a practical method by which to reduce the number of degrees of freedom in a model. The method is…
We study quasi-stationary distributions and quasi-limiting behavior of Markov chains in general reducible state spaces with absorption. We propose a set of assumptions dealing with particular situations where the state space can be…
We consider an irreducible pure jump Markov process with rates Q=(q(x,y)) on \Lambda\cup\{0\} with \Lambda countable and 0 an absorbing state. A quasi-stationary distribution (qsd) is a probability measure \nu on \Lambda that satisfies:…
Rare trajectories of stochastic systems are important to understand -- because of their potential impact. However, their properties are by definition difficult to sample directly. Population dynamics provides a numerical tool allowing their…
We introduce the notion of a quasistatic dynamical system, which generalizes that of an ordinary dynamical system. Quasistatic dynamical systems are inspired by the namesake processes in thermodynamics, which are idealized processes where…
We present a theoretical analysis of stochastic optimization methods in terms of their sensitivity with respect to the step size. We identify a key quantity that, for each method, describes how the performance degrades as the step size…
In a first part, we prove a Lyapunov-type criterion for the $\xi\_1$-positive recurrence of absorbed birth and death processes and provide new results on the domain of attraction of the minimal quasi-stationary distribution. In a second…
This paper considers a class of reinforcement-learning that belongs to the family of Learning Automata and provides a stochastic-stability analysis in strategic-form games. For this class of dynamics, convergence to pure Nash equilibria has…
We construct the {\it quasi-stationary} (QS) probability distribution for the Domany-Kinzel stochastic cellular automaton (DKCA), a discrete-time Markov process with an absorbing state. QS distributions are derived at both the one- and…