相关论文: Strong memoryless times and rare events in Markov …

We consider stochastic processes arising from dynamical systems simply by evaluating an observable function along the orbits of the system and study marked point processes associated to extremal observations of such time series…

We study a stochastic multiplicative process with reset events. It is shown that the model develops a stationary power-law probability distribution for the relevant variable, whose exponent depends on the model parameters. Two qualitatively…

The paper is concerned with approximating the distribution of a sum W of n integer valued random variables Y_i, whose distributions depend on the state of an underlying Markov chain X. The approximation is in terms of a translated Poisson…

We study a family of memory-based persistent random walks and we prove weak convergences after space-time rescaling. The limit processes are not only Brownian motions with drift. We have obtained a continuous but non-Markov process $(Z_t)$…

We prove a dichotomy for Manneville-Pomeau maps $f:[0,1]\to [0, 1]$: given any point $\zeta\in [0,1]$, either the Rare Events Point Processes (REPP), counting the number of exceedances, which correspond to entrances in balls around $\zeta$,…

We study scaling limits of non-increasing Markov chains with values in the set of non-negative integers, under the assumption that the large jump events are rare and happen at rates that behave like a negative power of the current state. We…

In the setting of non-reversible Markov chains on finite or countable state space, exact results on the distribution of the first hitting time to a given set $G$ are obtained. A new notion of "strong metastability time" is introduced to…

We study an open-boundary version of the on-off zero-range process introduced in Hirschberg et al. [Phys. Rev. Lett. 103, 090602 (2009)]. This model includes temporal correlations which can promote the condensation of particles, a situation…

We give computable bounds on the rate of convergence of the transition probabilities to the stationary distribution for a certain class of geometrically ergodic Markov chains. Our results are different from earlier estimates of Meyn and…

In this paper, we present a numerical framework for constructing bounds on stationary performance measures of random walks in the positive orthant using the Markov reward approach. These bounds are established in terms of stationary…

Generic non-Markovian quantum processes have infinitely long memory, implying an exact description that grows exponentially in complexity with observation time. Here, we present a finite memory ansatz that approximates (or recovers) the…

We are concerned with the asymptotics of the Markov chain given by the post-jump locations of a certain piecewise-deterministic Markov process with a state-dependent jump intensity. We provide sufficient conditions for such a model to…

In this paper we prove two results. First we show that dynamical systems with a $\phi$-mixing measure have in the limit Poisson distributed return times almost everywhere. We use the Chen-Stein method to also obtain rates of convergence.…

Via operator theoretic methods, we formalize the concentration phenomenon for a given observable `$r$' of a discrete time Markov chain with `$\mu_{\pi}$' as invariant ergodic measure, possibly having support on an unbounded state space. The…

Recently the so-called Prabhakar generalization of the fractional Poisson counting process attracted much interest for his flexibility to adapt real world situations. In this renewal process the waiting times between events are IID…

We consider the almost semi-continuous processes defined on a finite Markov chain. The representation of the moment generating functions for the absolute maximum after achievement positive level and for the recovery time are obtained.…

We study reinforcement learning for continuous-time Markov decision processes (MDPs) in the finite-horizon episodic setting. In contrast to discrete-time MDPs, the inter-transition times of a continuous-time MDP are exponentially…

Estimating the entropy based on data is one of the prototypical problems in distribution property testing and estimation. For estimating the Shannon entropy of a distribution on $S$ elements with independent samples, [Paninski2004] showed…

Many integrable stochastic particle systems in one space dimension (such as TASEP - Totally Asymmetric Simple Exclusion Process - and its $q$-deformation, the $q$-TASEP) remain integrable if we equip each particle with its own speed…

We present a general method to derive the metastable behavior of weakly mixing Markov chains. This approach is based on properties of the resolvent equations and can be applied to metastable dynamics which do not satisfy the mixing…