English
Related papers

Related papers: Transient regime of piecewise deterministic Monte …

200 papers

We investigate a piecewise-deterministic Markov process, evolving on a Polish metric space, whose deterministic behaviour between random jumps is governed by some semi-flow, and any state right after the jump is attained by a randomly…

Probability · Mathematics 2020-12-04 Dawid Czapla , Sander C. Hille , Katarzyna Horbacz , Hanna Wojewódka-Ściążko

As a special example of piecewise deterministic Markov process, bouncy particle sampler is a rejection-free, irreversible Markov chain Monte Carlo algorithm and can draw samples from target distribution efficiently. We generalize bouncy…

Computation · Statistics 2017-06-20 Changye Wu , Christian P. Robert

Piecewise deterministic Markov processes (PDMPs) can be used to model complex dynamical industrial systems. The counterpart of this modeling capability is their simulation cost, which makes reliability assessment untractable with standard…

Computation · Statistics 2023-06-08 Guillaume Chennetier , Hassane Chraibi , Anne Dutfoy , Josselin Garnier

We extend the hypocoercivity framework for piecewise-deterministic Markov process (PDMP) Monte Carlo established in [Andrieu et. al. (2018)] to heavy-tailed target distributions, which exhibit subgeometric rates of convergence to…

Probability · Mathematics 2021-06-03 Christophe Andrieu , Paul Dobson , Andi Q. Wang

Incorporating information about the target distribution in proposal mechanisms generally produces efficient Markov chain Monte Carlo algorithms (or at least, algorithms that are more efficient than uninformed counterparts). For instance, it…

Computation · Statistics 2021-08-27 Philippe Gagnon

In most sampling algorithms, including Hamiltonian Monte Carlo, transition rates between states correspond to the probability of making a transition in a single time step, and are constrained to be less than or equal to 1. We derive a…

Machine Learning · Statistics 2015-10-13 Andrew B. Berger , Mayur Mudigonda , Michael R. DeWeese , Jascha Sohl-Dickstein

In piecewise-deterministic Markov processes (PDMPs) the state of a finite-dimensional system evolves continuously, but the evolutive equation may change randomly as a result of discrete switches. A running cost is integrated along the…

Optimization and Control · Mathematics 2023-02-27 Elliot Cartee , Antonio Farah , April Nellis , Jacob van Hook , Alexander Vladimirsky

Bayesian inference for Markov jump processes (MJPs) where available observations relate to either system states or jumps typically relies on data-augmentation Markov Chain Monte Carlo. State-of-the-art developments involve representing MJP…

Computation · Statistics 2019-04-18 Iker Perez , Theodore Kypraios

Reversible jump Markov chain Monte Carlo (RJMCMC) proposals that achieve reasonable acceptance rates and mixing are notoriously difficult to design in most applications. Inspired by recent advances in deep neural network-based normalizing…

Computation · Statistics 2023-02-28 Laurence Davies , Robert Salomone , Matthew Sutton , Christopher Drovandi

We present recent results on Piecewise Deterministic Markov Processes (PDMPs), involved in biological modeling. PDMPs, first introduced in the probabilistic literature by Davis (1984), are a very general class of Markov processes and are…

Control theory plays a pivotal role in understanding and optimizing the behavior of complex dynamical systems across various scientific and engineering disciplines. Two key frameworks that have emerged for modeling and solving control…

Methodology · Statistics 2025-04-15 Alice Cleynen , Benoîte de Saporta , Orlane Rossini , Régis Sabbadin , Amélie Vernay

We propose a new Monte Carlo method for efficiently sampling trajectories with fixed initial and final conditions in a system with discrete degrees of freedom. The method can be applied to any stochastic process with local interactions,…

Statistical Mechanics · Physics 2012-03-30 Thierry Mora , Aleksandra M. Walczak , Francesco Zamponi

We introduce a Monte Carlo algorithm to efficiently compute transport properties of chaotic dynamical systems. Our method exploits the importance sampling technique that favors trajectories in the tail of the distribution of displacements,…

Statistical Mechanics · Physics 2018-05-25 Diego Tapias , David P. Sanders , Eduardo G. Altmann

Reversible jump Markov chain Monte Carlo (RJMCMC) is a Bayesian model estimation method which has been used for trans-dimensional sampling. In this study, we propose utilization of RJMCMC beyond trans-dimensional sampling. This new…

Signal Processing · Electrical Eng. & Systems 2020-05-06 Oktay Karakuş , Ercan E. Kuruoğlu , Mustafa A. Altınkaya

We present an investigation of stochastic evolution in which a family of evolution equations in $L^1$ are driven by continuous-time Markov processes. These are examples of so-called piecewise deterministic Markov processes (PDMP's) on the…

Probability · Mathematics 2020-12-01 Paweł Klimasara , Michael C. Mackey , Andrzej Tomski , Marta Tyran-Kamińska

Recently, a class of stochastic processes known as piecewise deterministic Markov processes has been used to define continuous-time Markov chain Monte Carlo algorithms with a number of attractive properties, including compatibility with…

Computation · Statistics 2019-06-03 Alexander Terenin , Daniel Thorngren

This paper introduces a novel stochastic framework for modelling tax evasion dynamics by extending the deterministic model of Bertotti and Modanese (2018) through the use of Piecewise Deterministic Markov Processes (PDMPs). A key limitation…

Physics and Society · Physics 2026-05-26 Jonas Mayr , Amira Meddah , Irene Tubikanec

In the context of nonparametric Bayesian estimation a Markov chain Monte Carlo algorithm is devised and implemented to sample from the posterior distribution of the drift function of a continuously or discretely observed one-dimensional…

Computation · Statistics 2017-06-08 Frank van der Meulen , Moritz Schauer , Harry van Zanten

Gaussian processes (GPs) are frequently used in machine learning and statistics to construct powerful models. However, when employing GPs in practice, important considerations must be made, regarding the high computational burden,…

Computation · Statistics 2021-03-08 Karla Monterrubio-Gómez , Sara Wade

We present a numerical method to compute the survival function and the moments of the exit time for a piecewise-deterministic Markov process (PDMP). Our approach is based on the quantization of an underlying discrete-time Markov chain…

Probability · Mathematics 2011-08-31 Adrien Brandejsky , Benoîte de Saporta , François Dufour