English
Related papers

Related papers: Joint Hitting-Time Densities for Finite State Mark…

200 papers

We consider the behavior of extremal particles in $K$-symmetric exclusion on $\mathbb{Z}$ when the process starts from certain infinite-particle step configurations where there are no particles to the right of a maximal one. In such a…

Probability · Mathematics 2025-06-17 Michael Conroy , Adrián González Casanova , Sunder Sethuraman

For continuous-time ergodic Markov processes, the Kemeny time $\tau_*$ is the characteristic time needed to converge towards the steady state $P_*(x)$ : in real-space, the Kemeny time $\tau_*$ corresponds to the average of the…

Statistical Mechanics · Physics 2023-06-12 Alain Mazzolo , Cecile Monthus

Many probabilistic inference problems such as stochastic filtering or the computation of rare event probabilities require model analysis under initial and terminal constraints. We propose a solution to this bridging problem for the widely…

Systems and Control · Electrical Eng. & Systems 2021-05-28 Michael Backenköhler , Luca Bortolussi , Gerrit Großmann , Verena Wolf

In this article, we obtain properties of the law associated to the first hitting time of a threshold by a one-dimensional uniformly elliptic diffusion process and to the associated process stopped at the threshold. Our methodology relies on…

Probability · Mathematics 2016-09-30 Noufel Frikha , Arturo Kohatsu-Higa , Libo Li

Motivated by applications in telecommunications, computer scienceand physics, we consider a discrete-time Markov process withrestart. At each step the process eitherwith a positive probability restarts from a given distribution, orwith the…

Performance · Computer Science 2017-03-13 Konstantin Avrachenkov , Alexey Piunovskiy , Yi Zhang

For one-dimensional symmetric L\'{e}vy processes, which hit every point with positive probability, we give sharp bounds for the tail function of the first hitting time of B which is either a single point or an interval. The estimates are…

Probability · Mathematics 2016-12-02 Tomasz Grzywny , Michał Ryznar

We make use of matrix representations of completely positive maps in order to study open quantum dynamics on graphs, with emphasis on quantum walks and the associated trajectories obtained via a monitoring of the position. We discuss the…

Mathematical Physics · Physics 2019-01-08 Carlos F. Lardizabal

For a spectrally positive strictly stable process with index in (1,2), the paper obtains i) the density of the time when the process makes first exit from an interval by hitting the interval's lower end point before jumping over its upper…

Probability · Mathematics 2018-06-21 Zhiyi Chi

In this research paper, the relationship between finite / countable state space stochastic processes and point processes is explored. Utilizing the known relationship between Poisson processes and continuous time Markov chains, finite /…

Statistics Theory · Mathematics 2012-04-24 Garimella Rama Murthy

Probability generating functions for first passage times of Markov chains are found using the method of collective marks. A system of equations is found which can be used to obtain moments of the first passage times.

Probability · Mathematics 2019-08-14 Yiping ZHANG , Myron HLYNKA , Percy H. BRILL

This paper is a step in the direction of understanding the behavior of non-intersecting Brownian motions on the real line, when the number of particles becomes large. Consider 2k non-intersecting Brownian motions, all starting at the…

Probability · Mathematics 2007-05-23 Mark Adler , Pierre van Moerbeke

We study quantitative recurrence to rare events in Countable Markov Shifts with recurrent potentials, focusing on return-time statistics to natural target sets for every point. In the positive recurrent case, return-time processes…

Dynamical Systems · Mathematics 2025-12-16 Dylan Bansard-Tresse

We consider additive functionals of Markov processes in continuous time with general (metric) state spaces. We derive concentration bounds for their exponential moments and moments of finite order. Applications include diffusions,…

Probability · Mathematics 2022-02-18 Frank Redig , Florian Völlering

This paper analyzes a method to approximate the first passage time probability density function which turns to be particularly useful if only sample data are available. The method relies on a Laguerre-Gamma polynomial approximation and…

Probability · Mathematics 2022-12-14 Elvira Di Nardo , Giuseppe D'Onofrio , Tommaso Martini

In this paper we study the iterated birth process of which we examine the first-passage time distributions and the hitting probabilities. Furthermore, linear birth processes, linear and sublinear death processes at Poisson times are…

Probability · Mathematics 2016-03-23 L. Beghin , E. Orsingher

We propose a constructive approach to building temporal point processes that incorporate dependence on their history. The dependence is modeled through the conditional density of the duration, i.e., the interval between successive event…

Methodology · Statistics 2025-10-31 Xiaotian Zheng , Athanasios Kottas , Bruno Sansó

Random $K$-satisfiability ($K$-SAT) is a model system for studying typical-case complexity of combinatorial optimization. Recent theoretical and simulation work revealed that the solution space of a random $K$-SAT formula has very rich…

Disordered Systems and Neural Networks · Physics 2015-05-13 Haijun Zhou

Consider a stationary discrete random process with alphabet size d, which is assumed to be the output process of an unknown stationary Hidden Markov Model (HMM). Given the joint probabilities of finite length strings of the process, we are…

Machine Learning · Computer Science 2015-12-15 Qingqing Huang , Rong Ge , Sham Kakade , Munther Dahleh

In this paper, a study of random times on filtered probability spaces is undertaken. The main message is that, as long as distributional properties of optional processes up to the random time are involved, there is no loss of generality in…

Probability · Mathematics 2015-03-17 Constantinos Kardaras

Processes having the same bridges as a given reference Markov process constitute its {\it reciprocal class}. In this paper we study the reciprocal class of compound Poisson processes whose jumps belong to a finite set $\mathcal{A} \subset…

Probability · Mathematics 2014-07-01 Giovanni Conforti , Paolo Dai Pra , Sylvie Roelly