English
Related papers

Related papers: A note on the jump locations of Markov processes

200 papers

Markov jump processes are continuous-time stochastic processes with a wide range of applications in both natural and social sciences. Despite their widespread use, inference in these models is highly non-trivial and typically proceeds via…

Machine Learning · Computer Science 2023-06-01 Patrick Seifner , Ramses J. Sanchez

We are concerned with the absolute continuity of stationary distributions corresponding to some piecewise deterministic Markov process, being typically encountered in biological models. The process under investigation involves a…

Probability · Mathematics 2024-03-26 Dawid Czapla , Katarzyna Horbacz , Hanna Wojewódka-Ściążko

In the paper we consider some piecewise deterministic Markov process whose continuous component evolves according to semiflows, which are switched at the jump times of a Poisson process. The associated Markov chain describes the states of…

Probability · Mathematics 2023-10-06 Dawid Czapla , Sander C. Hille , Katarzyna Horbacz , Hanna Wojewódka-Ściążko

In this paper, we consider a subclass of piecewise deterministic Markov processes with a Polish state space that involve a deterministic motion punctuated by random jumps, occurring in a Poisson-like fashion with some state-dependent rate,…

Probability · Mathematics 2024-05-28 Dawid Czapla

Piecewise-deterministic Markov processes form a general class of non-diffusion stochastic models that involve both deterministic trajectories and random jumps at random times. In this paper, we state a new characterization of the jump rate…

Methodology · Statistics 2017-05-03 Romain Azaïs , Alexandre Genadot

Markov jump processes (or continuous-time Markov chains) are a simple and important class of continuous-time dynamical systems. In this paper, we tackle the problem of simulating from the posterior distribution over paths in these models,…

Computation · Statistics 2013-10-21 Vinayak Rao , Yee Whye Teh

We are interested in the connection between a metastable continuous state space Markov process (satisfying e.g. the Langevin or overdamped Langevin equation) and a jump Markov process in a discrete state space. More precisely, we use the…

Probability · Mathematics 2017-02-08 Giacomo Di Gesù , Tony Lelièvre , Dorian Le Peutrec , Boris Nectoux

We study a one-dimensional Markov modulated random walk with jumps. It is assumed that amplitudes of jumps as well as a chosen velocity regime are random and depend on a time spent by the process at a previous state of the underlying Markov…

Probability · Mathematics 2013-03-13 Nikita Ratanov

We study a class of Piecewise Deterministic Markov Processes with state space Rd x E where E is a finite set. The continuous component evolves according to a smooth vector field that is switched at the jump times of the discrete coordinate.…

Probability · Mathematics 2014-04-08 Michel Benaïm , Stéphane Le Borgne , Florent Malrieu , Pierre-André Zitt

A piecewise-deterministic Markov process, specified by random jumps and switching semi-flows, as well as the associated Markov chain given by its post-jump locations, are investigated in this paper. The existence of an exponentially…

Probability · Mathematics 2020-12-07 Dawid Czapla , Katarzyna Horbacz , Hanna Wojewódka-Ściążko

We investigate a piecewise-deterministic Markov process, evolving on a Polish metric space, whose deterministic behaviour between random jumps is governed by some semi-flow, and any state right after the jump is attained by a randomly…

Probability · Mathematics 2020-12-04 Dawid Czapla , Sander C. Hille , Katarzyna Horbacz , Hanna Wojewódka-Ściążko

We compute the stationary distribution of a continuous-time Markov chain which is constructed by gluing together two finite, irreducible Markov chains by identifying a pair of states of one chain with a pair of states of the other and…

Probability · Mathematics 2015-10-22 Bence Mélykúti , Peter Pfaffelhuber

This paper discusses tractable development and statistical estimation of a continuous time stochastic process with a finite state space having non-Markov property. The process is formed by a finite mixture of right-continuous Markov jump…

Statistics Theory · Mathematics 2019-02-04 H. Frydman , B. A. Surya

We study a limit behavior of a sequence of Markov processes (or Markov chains) such that their distributions outside of any neighborhood of a "singular" point attract to some probability law. In any neighborhood of this point the behavior…

Probability · Mathematics 2015-09-14 Andrey Pilipenko , Yuriy Prykhodko

We propose a unified framework that extends the inference methods for classical hidden Markov models to continuous settings, where both the hidden states and observations occur in continuous time. Two different settings are analyzed: hidden…

Methodology · Statistics 2021-06-18 Qingcan Wang , Weinan E

We present sufficient conditions, in terms of the jumping kernels, for two large classes of conservative Markov processes of pure-jump type to be purely discontinuous martingales with finite second moment. As an application, we establish…

Probability · Mathematics 2020-09-01 Yuichi Shiozawa , Jian Wang

Among random sampling methods, Markov Chain Monte Carlo algorithms are foremost. Using a combination of analytical and numerical approaches, we study their convergence properties towards the steady state, within a random walk Metropolis…

Statistical Mechanics · Physics 2024-01-08 Alexei D. Chepelianskii , Satya N. Majumdar , Hendrik Schawe , Emmanuel Trizac

We study a recently introduced gradient-based Markov chain Monte Carlo method based on 'Barker dynamics'. We provide a full derivation of the method from first principles, placing it within a wider class of continuous-time Markov jump…

Computation · Statistics 2021-09-03 Max Hird , Samuel Livingstone , Giacomo Zanella

We study continuous time Markov processes on graphs. The notion of frequency is introduced, which serves well as a scaling factor between any Markov time of a continuous time Markov process and that of its jump chain. As an application, we…

Probability · Mathematics 2007-05-23 Jianjun Tian , Xiao-Song Lin

It is well-known that 0 is the absorbing state for a branching system. Each particle in the system lives a random long time and gives a random number of new particles at its death time. It stops when the system has no particle. This paper…

Probability · Mathematics 2022-10-31 Yanyun Li , Junping Li
‹ Prev 1 2 3 10 Next ›