English
Related papers

Related papers: Approximations of Piecewise Deterministic Markov P…

200 papers

In this paper we study a particular class of Piecewise deterministic Markov processes (PDMP's) which are semi-stochastic catastrophe versions of deterministic population growth models. In between successive jumps the process follows a flow…

Probability · Mathematics 2021-06-09 Branda Goncalves , Thierry Huillet , Eva Löcherbach

Piecewise-deterministic Markov processes form a general class of non-diffusion stochastic models that involve both deterministic trajectories and random jumps at random times. In this paper, we state a new characterization of the jump rate…

Methodology · Statistics 2017-05-03 Romain Azaïs , Alexandre Genadot

In this paper, we consider a piecewise deterministic Markov process (PDMP), with known flow and deterministic transition measure, and unknown jump rate $\lambda$. To estimate nonparametrically the jump rate, we first construct an adaptive…

Statistics Theory · Mathematics 2020-12-09 Nathalie Krell , Emeline Schmisser

We present a short introduction into the framework of piecewise deterministic Markov processes. We illustrate the abstract mathematical setting with a series of examples related to dispersal of biological systems, cell cycle models, gene…

Probability · Mathematics 2015-12-08 Ryszard Rudnicki , Marta Tyran-Kaminska

In this paper, we analyse piecewise deterministic Markov processes, as introduced in Davis (1984). Many models in insurance mathematics can be formulated in terms of the general concept of piecewise deterministic Markov processes. In this…

Probability · Mathematics 2019-01-23 Peter Kritzer , Gunther Leobacher , Michaela Szölgyenyi , Stefan Thonhauser

This papers deals with the constrained discounted control of piecewise deterministic Markov process (PDMPs) in general Borel spaces. The control variable acts on the jump rate and transition measure, and the goal is to minimize the total…

Optimization and Control · Mathematics 2014-02-26 Oswaldo Costa , François Dufour

Piecewise-deterministic Markov processes (PDMPs) are often used to model abrupt changes in the global environment or capabilities of a controlled system. This is typically done by considering a set of "operating modes" (each with its own…

Optimization and Control · Mathematics 2025-02-13 Marissa Gee , Alexander Vladimirsky

In this note, we present few examples of Piecewise Deterministic Markov Processes and their long time behavior. They share two important features: they are related to concrete models (in biology, networks, chemistry,. . .) and they are…

Probability · Mathematics 2014-12-24 Florent Malrieu

Recently non-reversible samplers based on simulating piecewise deterministic Markov processes (PDMPs) have shown potential for efficient sampling in Bayesian inference problems. However, there remains a lack of guidance on how to best…

Methodology · Statistics 2021-12-28 Matthew Sutton , Paul Fearnhead

We consider the class of Piecewise Deterministic Markov Processes (PDMP), whose state space is $\R\_{+}^{*}$, that possess an increasing deterministic motion and that shrink deterministically when they jump. Well known examples for this…

Statistics Theory · Mathematics 2015-03-12 Nathalie Krell

Control theory plays a pivotal role in understanding and optimizing the behavior of complex dynamical systems across various scientific and engineering disciplines. Two key frameworks that have emerged for modeling and solving control…

Methodology · Statistics 2025-04-15 Alice Cleynen , Benoîte de Saporta , Orlane Rossini , Régis Sabbadin , Amélie Vernay

Oscillatory systems of interacting Hawkes processes with Erlang memory kernels were introduced in Ditlevsen (2017). They are piecewise deterministic Markov processes (PDMP) and can be approximated by a stochastic diffusion. First, a strong…

Numerical Analysis · Mathematics 2020-03-25 Julien Chevallier , Anna Melnykova , Irene Tubikanec

In this paper we aim to construct infinite dimensional versions of well established Piecewise Deterministic Monte Carlo methods, such as the Bouncy Particle Sampler, the Zig-Zag Sampler and the Boomerang Sampler. In order to do so we…

Probability · Mathematics 2022-05-24 Paul Dobson , Joris Bierkens

In piecewise-deterministic Markov processes (PDMPs) the state of a finite-dimensional system evolves continuously, but the evolutive equation may change randomly as a result of discrete switches. A running cost is integrated along the…

Optimization and Control · Mathematics 2023-02-27 Elliot Cartee , Antonio Farah , April Nellis , Jacob van Hook , Alexander Vladimirsky

A novel class of non-reversible Markov chain Monte Carlo schemes relying on continuous-time piecewise-deterministic Markov Processes has recently emerged. In these algorithms, the state of the Markov process evolves according to a…

Methodology · Statistics 2018-05-16 Paul Vanetti , Alexandre Bouchard-Côté , George Deligiannidis , Arnaud Doucet

Markov Decision Processes (Mdps) form a versatile framework used to model a wide range of optimization problems. The Mdp model consists of sets of states, actions, time steps, rewards, and probability transitions. When in a given state and…

The use of stochastic models, in effect piecewise deterministic Markov processes (PDMP), has become increasingly popular especially for the modeling of chemical reactions and cell biophysics. Yet, exact simulation methods, for the…

Numerical Analysis · Mathematics 2015-04-28 Romain Veltz

This paper investigates the random horizon optimal stopping problem for measure-valued piecewise deterministic Markov processes (PDMPs). This is motivated by population dynamics applications, when one wants to monitor some characteristics…

Probability · Mathematics 2018-09-14 Bertrand Cloez , Benoîte de Saporta , Maud Joubaud

We aim at characterizing viability, invariance and some reachability properties of controlled piecewise deterministic Markov processes (PDMPs). Using analytical methods from the theory of viscosity solutions, we establish criteria for…

Optimization and Control · Mathematics 2013-04-09 D. Goreac

Determinantal point processes (DPPs) are probabilistic models for repulsion. When used to represent the occurrence of random subsets of a finite base set, DPPs allow to model global negative associations in a mathematically elegant and…

Statistics Theory · Mathematics 2019-01-29 Kayvan Sadeghi , Alessandro Rinaldo