English
Related papers

Related papers: Qualitative properties of certain piecewise determ…

200 papers

A novel class of non-reversible Markov chain Monte Carlo schemes relying on continuous-time piecewise-deterministic Markov Processes has recently emerged. In these algorithms, the state of the Markov process evolves according to a…

Methodology · Statistics 2018-05-16 Paul Vanetti , Alexandre Bouchard-Côté , George Deligiannidis , Arnaud Doucet

We extend Monte Carlo samplers based on piecewise deterministic Markov processes (PDMP samplers) by formally defining different boundary conditions such as sticky floors, soft and hard walls and teleportation portals. This allows PDMP…

Computation · Statistics 2023-03-15 Joris Bierkens , Sebastiano Grazzi , Gareth Roberts , Moritz Schauer

In this work we investigate the long-time behavior, that is the existence and characterization of invariant measures as well as convergence of transition probabilities, for Markov processes obtained as the unique mild solution to stochastic…

Probability · Mathematics 2022-03-17 Balint Fárkas , Martin Friesen , Barbara Rüdiger , Dennis Schroers

In this paper is described the general aspect of a numerical method for piecewise determin-istic Markov processes with boundary. Under very natural hypotheses, a crucial result about uniqueness of solution of a generalized Kolmogorov…

Analysis of PDEs · Mathematics 2018-10-25 Ludovic Goudenège

The paper deals with the asymptotic properties of a random jump process in a high contrast periodic medium in $\mathbb R^d$, $d\geq 1$. We show that if the coordinates of the random jump process in $\mathbb R^d$ are equipped with an extra…

Probability · Mathematics 2024-02-13 Andrey Piatnitski , Elena Zhizhina

We study existence and uniqueness of invariant probability measures for continuous-time Markov processes on general state spaces. Existence is obtained from tightness of time averages under a weak regularity assumption inspired by…

Probability · Mathematics 2026-01-21 Jean-Gabriel Attali

We establish new conditions for obtaining uniform bounds on the moments of discrete-time stochastic processes. Our results require a weak negative drift criterion along with a state-dependent restriction on the sizes of the one-step jumps…

Probability · Mathematics 2022-06-02 Arnab Ganguly , Debasish Chatterjee

We introduce a novel class of generative models based on piecewise deterministic Markov processes (PDMPs), a family of non-diffusive stochastic processes consisting of deterministic motion and random jumps at random times. Similarly to…

Machine Learning · Statistics 2024-11-06 Andrea Bertazzi , Dario Shariatian , Umut Simsekli , Eric Moulines , Alain Durmus

We construct and study branching Markov processes on the space of finite configurations of the state space of a given standard process, controlled by a branching kernel and a killing one. In particular, we may start with a superprocess,…

Probability · Mathematics 2015-08-03 Lucian Beznea , Oana Lupascu

The problem of existence and uniqueness of absolutely continuous invariant measures for a class of piecewise deterministic Markov processes is investigated using the theory of substochastic semigroups obtained through the Kato--Voigt…

Probability · Mathematics 2015-12-03 Weronika Biedrzycka , Marta Tyran-Kaminska

In piecewise-deterministic Markov processes (PDMPs) the state of a finite-dimensional system evolves continuously, but the evolutive equation may change randomly as a result of discrete switches. A running cost is integrated along the…

Optimization and Control · Mathematics 2023-02-27 Elliot Cartee , Antonio Farah , April Nellis , Jacob van Hook , Alexander Vladimirsky

We propose moment-based variational inference as a flexible framework for approximate smoothing of latent Markov jump processes. The main ingredient of our approach is to partition the set of all transitions of the latent process into…

Machine Learning · Computer Science 2019-05-15 Christian Wildner , Heinz Koeppl

There has been substantial interest in developing Markov chain Monte Carlo algorithms based on piecewise-deterministic Markov processes. However existing algorithms can only be used if the target distribution of interest is differentiable…

Statistics Theory · Mathematics 2021-11-12 Augustin Chevallier , Sam Power , Andi Q. Wang , Paul Fearnhead

In this paper we consider a control problem for a Partially Observable Piecewise Deterministic Markov Process of the following type: After the jump of the process the controller receives a noisy signal about the state and the aim is to…

Optimization and Control · Mathematics 2021-07-21 Nicole Bäuerle , Dirk Lange

Understanding and predicting the dynamical properties of systems involving dry friction is a major concern in physics and engineering. It abounds in many mechanical processes, from the sound produced by a violin to the screeching of chalk…

Probability · Mathematics 2023-05-16 Josselin Garnier , Ziyu Lu , Laurent Mertz

We characterize the class of exchangeable Feller processes evolving on partitions with boundedly many blocks. In continuous-time, the jump measure decomposes into two parts: a $\sigma$-finite measure on stochastic matrices and a collection…

Probability · Mathematics 2014-09-04 Harry Crane

Designing efficient and rigorous numerical methods for sequential decision-making under uncertainty is a difficult problem that arises in many applications frameworks. In this paper we focus on the numerical solution of a subclass of…

Statistics Theory · Mathematics 2025-11-07 Alice Cleynen , Benoîte de Saporta

We consider a change-point detection problem for a simple class of Piecewise Deterministic Markov Processes (PDMPs). A continuous-time PDMP is observed in discrete time and through noise, and the aim is to propose a numerical method to…

Optimization and Control · Mathematics 2017-09-28 Alice Cleynen , Benoîte de Saporta

This paper develops a new class of conditional Markov jump processes with regime switching and paths dependence. The key novel feature of the developed process lies on its ability to switch the transition rate as it moves from one state to…

Methodology · Statistics 2021-07-16 Budhi Surya

In this paper, we derive a simple drift condition for the stability of a class of two-dimensional Markov processes, for which one of the coordinates (also referred to as the {\em phase} for convenience) has a well understood behaviour…

Probability · Mathematics 2020-10-01 Stella Kapodistria , Seva Shneer