English
Related papers

Related papers: Pitman's discrete $2M-X$ theorem for arbitrary ini…

200 papers

In this paper, we consider the gradual-impulse control problem of continuous-time Markov decision processes, where the system performance is measured by the expectation of the exponential utility of the total cost. We prove, under very…

Optimization and Control · Mathematics 2023-11-16 Xin Guo , Aiko Kurushima , Alexey Piunovskiy , Yi Zhang

We consider the inverse problem of reconstructing the posterior measure over the trajec- tories of a diffusion process from discrete time observations and continuous time constraints. We cast the problem in a Bayesian framework and derive…

Machine Learning · Statistics 2016-12-21 Botond Cseke , David Schnoerr , Manfred Opper , Guido Sanguinetti

We introduce a novel class of generative models based on piecewise deterministic Markov processes (PDMPs), a family of non-diffusive stochastic processes consisting of deterministic motion and random jumps at random times. Similarly to…

Machine Learning · Statistics 2024-11-06 Andrea Bertazzi , Dario Shariatian , Umut Simsekli , Eric Moulines , Alain Durmus

In this paper, we study the asymptotic behaviour of plane partitions distributed according to a $q^{\text{Volume}}$-weighted Muttalib--Borodin ensemble and its associated discrete point process. We establish a Large Deviation Principle for…

Probability · Mathematics 2026-04-09 Jonathan Husson , Guido Mazzuca , Alessandra Occelli

We consider additive functionals of systems of random measures whose initial configuration is given by a Poisson point process, and whose individual components evolve according to arbitrary Markovian or non-Markovian measure valued…

Probability · Mathematics 2025-12-03 Arturo Jaramillo , Antonio Murillo-Salas

Bisimulation is a concept that captures behavioural equivalence of states in a variety of types of transition systems. It has been widely studied in discrete-time settings where a key notion is the bisimulation metric which quantifies "how…

Logic in Computer Science · Computer Science 2025-11-27 Linan Chen , Florence Clerc , Prakash Panangaden

In this paper we consider a control problem for a Partially Observable Piecewise Deterministic Markov Process of the following type: After the jump of the process the controller receives a noisy signal about the state and the aim is to…

Optimization and Control · Mathematics 2021-07-21 Nicole Bäuerle , Dirk Lange

We establish integral tests and laws of the iterated logarithm for the upper envelope of the future infimum of positive self-similar Markov processes and for increasing self-similar Markov processes at 0 and infinity. Our proofs are based…

Probability · Mathematics 2007-05-23 J. C. Pardo

Consider $M_n$ the maximal position at generation $n$ of a supercritical branching random walk. A\"id\'ekon (2013) obtained and described the convergence in law, as time $n$ goes to infinity, of $M_n-m_n$, where $m_n$ is an explicit…

Probability · Mathematics 2026-01-14 Louis Chataignier , Lianghui Luo

A random walk problem with particles on discrete double infinite linear grids is discussed. The model is based on the work of Montroll and others. A probability connected with the problem is given in the form of integrals containing…

Classical Analysis and ODEs · Mathematics 2007-05-23 J. B. Sanders , N. M. Temme

We study downward deviations of the maximum local time of the discrete-time simple random walk on $\mathbb{Z}^d$, $d\ge 3$. In our previous paper \cite{li2026ldmaxlocal}, the corresponding upper bound was established, while the matching…

Probability · Mathematics 2026-05-26 Xinyi Li , Yushu Zheng

Let $(X,d)$ be a geodesic Gromov-hyperbolic space, $o \in X$ a basepoint and $\mu$ a countably supported non-elementary probability measure on $\operatorname{Isom}(X)$. Denote by $z_n$ the random walk on $X$ driven by the probability…

Probability · Mathematics 2022-03-15 Richard Aoun , Pierre Mathieu , Cagri Sert

For a continuous-time Markov process, we characterize the law of the first jump location when started from an arbitrary initial distribution, in terms of the invariant distribution of an auxiliary Markov process. This could be of interest…

Probability · Mathematics 2019-08-23 Andi Q. Wang , David Steinsaltz

In the setting where we have $n$ independent observations of a random variable $X$, we derive explicit error bounds in total variation distance when approximating the number of observations equal to the maximum of the sample (in the case…

Probability · Mathematics 2026-04-10 Fraser Daly

We consider a random walk on the support of an ergodic simple point process on R^d, d>1, furnished with independent energy marks. The jump rates of the random walk decay exponentially in the jump length and depend on the energy marks via a…

Mathematical Physics · Physics 2007-05-23 A. Faggionato , P. Mathieu

Piecewise Deterministic Markov Processes (PDMPs) are studied in a general framework. First, different constructions are proven to be equivalent. Second, we introduce a coupling between two PDMPs following the same differential flow which…

Probability · Mathematics 2021-08-03 Alain Durmus , Arnaud Guillin , Pierre Monmarché

In the present paper, we consider a class of Markov processes on the discrete circle which has been introduced by K\"onig, O'Connell and Roch. These processes describe movements of exchangeable interacting particles and are discrete…

Probability · Mathematics 2026-01-01 Anna Ben-Hamou , Pierre Tarrago

Piecewise-deterministic Markov processes form a general class of non-diffusion stochastic models that involve both deterministic trajectories and random jumps at random times. In this paper, we state a new characterization of the jump rate…

Methodology · Statistics 2017-05-03 Romain Azaïs , Alexandre Genadot

We study the ergodic behaviour of a discrete-time process $X$ which is a Markov chain in a stationary random environment. The laws of $X_t$ are shown to converge to a limiting law in (weighted) total variation distance as $t\to\infty$.…

Probability · Mathematics 2019-07-29 Balazs Gerencser , Miklos Rasonyi

We consider the problem of learning two families of time-evolving random measures from indirect observations. In the first model, the signal is a Fleming--Viot diffusion, which is reversible with respect to the law of a Dirichlet process,…

Statistics Theory · Mathematics 2014-11-19 Omiros Papaspiliopoulos , Matteo Ruggiero , Dario Spanò