Related papers: Asymptotically exponential hitting times and metas…
In the framework of time series analysis with recurrence networks, we introduce a self-adaptive method that determines the elusive recurrence threshold and identifies metastable states in complex real-world time series. As initial step, we…
This study in centered on models accounting for stochastic deformations of sample paths of random walks, embedded either in $\mathbb{Z}^2$ or in $\mathbb{Z}^3$. These models are immersed in multi-type particle systems with exclusion.…
The main contribution of the current study is two-fold. First, we investigate the energy landscape of the Ising and Potts models on finite two-dimensional lattices without external fields in the low temperature regime. The complete analysis…
We study the asymptotic behaviour of Markov chains $(X_n,\eta_n)$ on $\mathbb{Z}_+ \times S$, where $\mathbb{Z}_+$ is the non-negative integers and $S$ is a finite set. Neither coordinate is assumed to be Markov. We assume a moments bound…
The objective of this work is to study continuous-time Markov decision processes on a general Borel state space with both impulsive and continuous controls for the infinite-time horizon discounted cost. The continuous-time controlled…
In this article, we analyze three classes of time-reversal of a Markov process with Gaussian noise on a manifold. We first unveil a commutativity constraint for the most general of these time-reversals to be well defined. Then we give a…
The first hitting times of a stochastic process, i.e., the first time a process reaches a particular level, are of significant interest across various scientific disciplines, including biology, chemistry, and economics. We modify the…
We consider irreducible reversible discrete time Markov chains on a finite state space. Mixing times and hitting times are fundamental parameters of the chain. We relate them by showing that the mixing time of the lazy chain is equivalent…
Reinforcement Learning Algorithms are predominantly developed for stationary environments, and the limited literature that considers nonstationary environments often involves specific assumptions about changes that can occur in transition…
We link two phenomena concerning the asymptotical behavior of stochastic processes: (i) abrupt convergence or cut-off phenomenon, and (ii) the escape behavior usually associated to exit from metastability. The former is characterized by…
We consider a class of stochastic dynamical systems, called piecewise deterministic Markov processes, with states $(x, \s)\in \O\times \G$, $\O$ being a region in $\bbR^d$ or the $d$--dimensional torus, $\G$ being a finite set. The…
The probability that a max-stable process {\eta} in C[0, 1] with identical marginal distribution function F hits x \in R with 0 < F (x) < 1 is the hitting probability of x. We show that the hitting probability is always positive, unless the…
We consider the hard-core model with Metropolis transition probabilities on finite grid graphs and investigate the asymptotic behavior of the first hitting time between its two maximum-occupancy configurations in the low-temperature regime.…
We analyse the metastable behaviour of the dilute Curie-Weiss model subject to a Glauber dynamics. The model is a random version of a mean-field Ising model, where the coupling coefficients are Bernoulli random variables with mean $p\in…
In this paper, we study, in a nonlinear setting, the asymptotic behaviour of a generalized viscosity approximation method associated with a countable family of nonexpansive mappings satisfying resolvent-like conditions. We apply proof…
We study the contact process on the configuration model with a power law degree distribution, when the exponent is smaller than or equal to two. We prove that the extinction time grows exponentially fast with the size of the graph and prove…
This article deals with stochastic processes endowed with the Markov (memoryless) property and evolving over general (uncountable) state spaces. The models further depend on a non-deterministic quantity in the form of a control input, which…
In this paper, we focus on the hitting times of a stochastic epidemic model presented by \cite{Gray}. Under the help of the auxiliary stopping times, we investigate the asymptotic limits of the hitting times by the variations of calculus…
We introduce the concept of asymptotic period for an irreducible and aperiodic, discrete-time Markov chain X on a countable state space, and develop the theory leading to its formal definition. The asymptotic period of X equals one - its…
We study the metastable behavior of diffusion processes in narrow tube domains, where the metastability is induced by entropic barriers. We identify a sequence of characteristic time scales $\{T_\epsilon^i\}_{1 \leq i \leq \abs{V'}}$ and…