English
Related papers

Related papers: A note on the jump locations of Markov processes

200 papers

In the context of nonparametric Bayesian estimation a Markov chain Monte Carlo algorithm is devised and implemented to sample from the posterior distribution of the drift function of a continuously or discretely observed one-dimensional…

Computation · Statistics 2017-06-08 Frank van der Meulen , Moritz Schauer , Harry van Zanten

The present paper focuses on the problem of sampling from a given target distribution $\pi$ defined on some general state space. To this end, we introduce a novel class of non-reversible Markov chains, each chain being defined on an…

Computation · Statistics 2023-05-16 Randal Douc , Alain Durmus , Aurélien Enfroy , Jimmy Olsson

This paper presents a nonparametric method for estimating the conditional density associated to the jump rate of a piecewise-deterministic Markov process. In our framework, the estimation needs only one observation of the process within a…

Statistics Theory · Mathematics 2012-07-12 Romain Azaïs , François Dufour , Anne Gégout-Petit

We present a new method for simulating Markovian jump processes with time-dependent transitions rates, which avoids the transformation of random numbers by inverting time integrals over the rates. It relies on constructing a sequence of…

Statistical Mechanics · Physics 2015-05-20 Viktor Holubec , Petr Chvosta , Mario Einax , Philipp Maass

We investigate a branching random walk where the displacements are independent from the branching mechanism and have a stretched exponential distribution. We describe the positions of the particles in the vicinity of the rightmost particle…

Probability · Mathematics 2024-01-26 Piotr Dyszewski , Nina Gantert

Continuous time random walks (CTRWs) are versatile models for anomalous diffusion processes that have found widespread application in the quantitative sciences. Their scaling limits are typically non-Markovian, and the computation of their…

Probability · Mathematics 2014-07-25 Mark M. Meerschaert , Peter Straka

We consider a Markov jump process on a general state space to which we apply a time-dependent weak perturbation over a finite time interval. By martingale-based stochastic calculus, under a suitable exponential moment bound for the…

Probability · Mathematics 2024-05-14 Alessandra Faggionato , Vittoria Silvestri

Markov jump processes and continuous time Bayesian networks are important classes of continuous time dynamical systems. In this paper, we tackle the problem of inferring unobserved paths in these models by introducing a fast auxiliary…

Methodology · Statistics 2012-02-20 Vinayak Rao , Yee Whye Teh

We propose moment-based variational inference as a flexible framework for approximate smoothing of latent Markov jump processes. The main ingredient of our approach is to partition the set of all transitions of the latent process into…

Machine Learning · Computer Science 2019-05-15 Christian Wildner , Heinz Koeppl

We define the probability structure of a continuous-time time-homogeneous Markov jump process, on a finite graph, that represents the continuous-time counterpart of the so-called Ruelle-Bowen discrete-time random walk. It constitutes the…

Optimization and Control · Mathematics 2018-02-14 Yongxin Chen , Tryphon T. Georgiou , Michele Pavon

We study the long time behaviour of a Markov process evolving in $\mathbb{N}$ and conditioned not to hit 0. Assuming that the process comes back quickly from infinity, we prove that the process admits a unique quasi-stationary distribution…

Probability · Mathematics 2013-04-04 Servet Martinez , Jaime San Martin , Denis Villemonais

We consider piecewise deterministic Markov processes with degenerate transition kernels of the "house-of-cards"-type. We use a splitting scheme based on jump times to prove the absolute continuity, as well as some regularity, of the…

Probability · Mathematics 2016-01-27 Eva Löcherbach

In this paper, we develop a general law of large numbers and central limit theorem for cumulative reward processes associated with finite state Markov jump processes with non-stationary transition rates. Such models commonly arise in…

Probability · Mathematics 2025-10-15 Monte Fischer , Peter W. Glynn

The random numbers driving Markov chain Monte Carlo (MCMC) simulation are usually modeled as independent U(0,1) random variables. Tribble [Markov chain Monte Carlo algorithms using completely uniformly distributed driving sequences (2007)…

Statistics Theory · Mathematics 2011-05-11 S. Chen , J. Dick , A. B. Owen

A continuous-time Markov process $X$ can be conditioned to be in a given state at a fixed time $T > 0$ using Doob's $h$-transform. This transform requires the typically intractable transition density of $X$. The effect of the $h$-transform…

Probability · Mathematics 2024-09-16 Marc Corstanje , Frank van der Meulen , Moritz Schauer

We investigate piecewise deterministic Markov processes (PDMP), where the deterministic dynamics follows a scalar conservation law and random jumps in the system are characterized by changes in the flux function. We show under which…

Probability · Mathematics 2019-01-30 Stephan Knapp

The purpose of this paper is to consider the exit-time problem for a finite-range Markov jump process, i.e, the distance the particle can jump is bounded independent of its location. Such jump diffusions are expedient models for anomalous…

Probability · Mathematics 2015-01-29 Nathanial Burch , Marta D'Elia , R. B. Lehoucq

The estimation of absorption time distributions of Markov jump processes is an important task in various branches of statistics and applied probability. While the time-homogeneous case is classic, the time-inhomogeneous case has recently…

Statistics Theory · Mathematics 2022-07-26 Jamaal Ahmad , Martin Bladt , Mogens Bladt

We investigate the Poisson regression method for Markov and semi-Markov jump processes from a nonparametric angle, allowing the lengths of the time and duration intervals in the partition to vary with the number of observations. Imposing no…

Statistics Theory · Mathematics 2026-05-06 Martin Bladt , Rasmus Frigaard Lemvig

The study of time-inhomogeneous Markov jump processes is a traditional topic within probability theory that has recently attracted substantial attention in various applications. However, their flexibility also incurs a substantial…

Probability · Mathematics 2023-11-03 Martin Bladt , Oscar Peralta