English
Related papers

Related papers: Multiscale Piecewise Deterministic Markov Process …

200 papers

An extension of non-deterministic processes driven by the random telegraph signal is introduced in the framework of "piecewise deterministic Markov processes" [Davis], including a broader category of random systems. The corresponding…

Numerical Analysis · Mathematics 2025-10-20 Mario Annunziato

Adaptive Langevin dynamics is a method for sampling the Boltzmann-Gibbs distribution at prescribed temperature in cases where the potential gradient is subject to stochastic perturbation of unknown magnitude. The method replaces the…

Probability · Mathematics 2023-11-14 Benedict Leimkuhler , Matthias Sachs , Gabriel Stoltz

We consider a general piecewise deterministic Markov process (PDMP) $X=\{X_t\}_{t\geqslant 0}$ with measure-valued generator $\mathcal{A}$, for which the conditional distribution function of the inter-occurrence time is not necessarily…

Probability · Mathematics 2017-04-27 Zhaoyang Liu , Yuying Liu , Guoxin Liu

We consider a finite number of $N$ statistically equal agents, each moving on a finite set of states according to a continuous-time Markov Decision Process (MDP). Transition intensities of the agents and generated rewards depend not only on…

Probability · Mathematics 2025-09-23 Nicole Bäuerle , Sebastian Höfer

We construct a four-parameter family of Markov processes on infinite Gelfand-Tsetlin schemes that preserve the class of central (Gibbs) measures. Any process in the family induces a Feller Markov process on the infinite-dimensional boundary…

Probability · Mathematics 2013-03-04 Alexei Borodin , Grigori Olshanski

We observe the actions of a $K$ sub-sample of $N$ individuals up to time $t$ for some large $K\le N$. We model the relationships of individuals by i.i.d. Bernoulli($p$)-random variables, where $p\in (0,1]$ is an unknown parameter. The rate…

Statistics Theory · Mathematics 2019-06-20 Chenguang Liu

Motivated by the Central Limit Theorem, in this paper, we study both universal and non-universal simulations of random variables with an arbitrary target distribution $Q_{Y}$ by general mappings, not limited to linear ones (as in the…

Probability · Mathematics 2018-12-05 Lei Yu

The main goal of this paper is to apply the so-called policy iteration algorithm (PIA) for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP's) taking values in a general Borel space and with…

Probability · Mathematics 2009-02-17 O. L. V. Costa , F. Dufour

We propose a Markov model for the spread of Hepatitis C virus (HCV) among drug users who use injections. We then proceed to an asymptotic analysis (large initial population) and show that the Markov process is close to the solution of a non…

Probability · Mathematics 2010-02-19 Laure Coutin , Laurent Decreusefond , Jean-Stephane Dhersin

Without higher moment assumptions, this note establishes the decay of the Kolmogorov distance in a central limit theorem for L\'evy processes. This theorem can be viewed as a continuous-time extension of the classical random walk result by…

Probability · Mathematics 2021-07-01 David Bang , Jorge Ignacio González Cázares , Aleksandar Mijatović

In this paper we study the semi-global (approximate) state feedback stabilization of an infinite dimensional quantum stochastic system towards a target state. A discrete-time Markov chain on an infinite-dimensional Hilbert space is used to…

Optimization and Control · Mathematics 2011-03-22 Ram Somaraju , Mazyar Mirrahimi , Pierre Rouchon

We prove a Poisson limit theorem in the total variation distance of functionals of a general Poisson point process using the Malliavin-Stein method. Our estimates only involve first and second order difference operators and are closely…

Probability · Mathematics 2019-05-28 Jens Grygierek

The main result of this paper is a functional limit theorem for the sine-process. In particular, we study the limit distribution, in the space of trajectories, for the number of particles in a growing interval. The sine-process has the…

Dynamical Systems · Mathematics 2018-01-12 Alexander I. Bufetov , Andrey V. Dymov

We consider the inverse problem of reconstructing the posterior measure over the trajec- tories of a diffusion process from discrete time observations and continuous time constraints. We cast the problem in a Bayesian framework and derive…

Machine Learning · Statistics 2016-12-21 Botond Cseke , David Schnoerr , Manfred Opper , Guido Sanguinetti

In the first part of this paper we study approximations of trajectories of Piecewise Deter-ministic Processes (PDP) when the flow is not explicit by the thinning method. We also establish a strong error estimate for PDPs as well as a weak…

Probability · Mathematics 2022-02-10 Vincent Lemaire , Michèle Thieullen , Nicolas Thomas

We derive a finite-sample probabilistic bound on the parameter estimation error of a system identification algorithm for Linear Switched Systems. The algorithm estimates Markov parameters from a single trajectory and applies a variant of…

Machine Learning · Computer Science 2025-05-19 Daniel Racz , Mihaly Petreczky , Balint Daroczy

We construct a general procedure for the Quasi Likelihood Analysis applied to a multivariate point process on the real half line in an ergodic framework. More precisely, we assume that the stochastic intensity of the underlying model…

Statistics Theory · Mathematics 2016-09-28 Simon Clinet , Nakahiro Yoshida

Consider the problem of predicting the next symbol given a sample path of length n, whose joint distribution belongs to a distribution class that may have long-term memory. The goal is to compete with the conditional predictor that knows…

Statistics Theory · Mathematics 2024-04-25 Yanjun Han , Tianze Jiang , Yihong Wu

Hawkes processes are a class of simple point processes whose intensity depends on the past history, and is in general non-Markovian. Limit theorems for Hawkes processes in various asymptotic regimes have been studied in the literature. In…

Probability · Mathematics 2026-05-25 Fuqing Gao , Lingjiong Zhu

We investigate the convergence in distribution of sequential empirical processes of dependent data indexed by a class of functions F. Our technique is suitable for processes that satisfy a multiple mixing condition on a space of functions…

Probability · Mathematics 2014-09-26 Herold Dehling , Olivier Durieu , Marco Tusche