English
Related papers

Related papers: On level crossings for a general class of piecewis…

200 papers

We study the long time behaviour of a Markov process evolving in $\mathbb{N}$ and conditioned not to hit 0. Assuming that the process comes back quickly from infinity, we prove that the process admits a unique quasi-stationary distribution…

Probability · Mathematics 2013-04-04 Servet Martinez , Jaime San Martin , Denis Villemonais

In this paper we consider a control problem for a Partially Observable Piecewise Deterministic Markov Process of the following type: After the jump of the process the controller receives a noisy signal about the state and the aim is to…

Optimization and Control · Mathematics 2021-07-21 Nicole Bäuerle , Dirk Lange

We analyse and interpret the effects of breaking detailed balance on the convergence to equilibrium of conservative interacting particle systems and their hydrodynamic scaling limits. For finite systems of interacting particles, we review…

Statistical Mechanics · Physics 2017-08-21 Marcus Kaiser , Robert L. Jack , Johannes Zimmer

One-dimensional non-equilibrium models of particles subjected to a coagulation-diffusion process are important in understanding non-equilibrium dynamics, and fluctuation-dissipation relation. We consider in this paper transport properties…

Statistical Mechanics · Physics 2015-06-18 Jean-Yves Fortin

We study the random acceleration model, which is perhaps one of the simplest, yet nontrivial, non-Markov stochastic processes, and is key to many applications. For this non-Markov process, we present exact analytical results for the…

Statistical Mechanics · Physics 2019-09-04 Satya N. Majumdar , Alberto Rosso , Andrea Zoia

We consider the diffusive limit of a typical pure-jump Markovian control problem as the intensity of the driving Poisson process tends to infinity. We show that the convergence speed is provided by the H\"older constant of the Hessian of…

Optimization and Control · Mathematics 2022-08-19 Marc Abeille , Bruno Bouchard , Lorenzo Croissant

Designing efficient and rigorous numerical methods for sequential decision-making under uncertainty is a difficult problem that arises in many applications frameworks. In this paper we focus on the numerical solution of a subclass of…

Statistics Theory · Mathematics 2025-11-07 Alice Cleynen , Benoîte de Saporta

We study a system of $N$ interacting particles on $\bf{Z}$. The stochastic dynamics consists of two components: a free motion of each particle (independent random walks) and a pair-wise interaction between particles. The interaction belongs…

Probability · Mathematics 2011-10-25 A. Manita , V. Shcherbakov

Markov jump processes are widely used to model natural and engineered processes. In the context of biological or chemical applications one typically refers to the chemical master equation (CME), which models the evolution of the probability…

Optimization and Control · Mathematics 2017-07-05 Wei Zhang , Carsten Hartmann , Max von Kleist

We consider an infinite horizon optimal control problem for a pure jump Markov process $X$, taking values in a complete and separable metric space $I$, with noise-free partial observation. The observation process is defined as $Y_t =…

Optimization and Control · Mathematics 2020-03-05 Alessandro Calvia

This article is concerned with pointwise growth and spreading speeds in systems of parabolic partial differential equations. Several criteria exist for quantifying pointwise growth rates. These include the location in the complex plane of…

Pattern Formation and Solitons · Physics 2015-06-17 Matt Holzer , Arnd Scheel

Markov jump processes are continuous-time stochastic processes with a wide range of applications in both natural and social sciences. Despite their widespread use, inference in these models is highly non-trivial and typically proceeds via…

Machine Learning · Computer Science 2023-06-01 Patrick Seifner , Ramses J. Sanchez

We study the Markov chain on $\mathbf{F}_p$ obtained by applying a function $f$ and adding $\pm\gamma$ with equal probability. When $f$ is a linear function, this is the well-studied Chung--Diaconis--Graham process. We consider two cases:…

Probability · Mathematics 2022-03-08 Jimmy He

We study ergodic properties of a class of Markov-modulated general birth-death processes under fast regime switching. The first set of results concerns the ergodic properties of the properly scaled joint Markov process with a parameter that…

Probability · Mathematics 2019-09-17 Ari Arapostathis , Guodong Pang , Yi Zheng

We study finite particle systems on the one-dimensional integer lattice, where each particle performs a continuous-time nearest-neighbour random walk, with jump rates intrinsic to each particle, subject to an exclusion interaction which…

Probability · Mathematics 2024-05-07 Vadim Malyshev , Mikhail Menshikov , Serguei Popov , Andrew Wade

Let $\eta_t$ be a Poisson point process of intensity $t\geq 1$ on some state space $\Y$ and $f$ be a non-negative symmetric function on $\Y^k$ for some $k\geq 1$. Applying $f$ to all $k$-tuples of distinct points of $\eta_t$ generates a…

Probability · Mathematics 2012-12-11 Matthias Schulte , Christoph Thaele

We consider a Markovian evolution on point processes, the $\Psi$--process, on the unit interval in which points are added according to a rule that depends only on the spacings of the existing point configuration. Having chosen a spacing, a…

Probability · Mathematics 2020-07-01 Pascal Maillard , Elliot Paquette

We study the quenched invariance principle for random conductance models with long range jumps on $\Z^d$, where the transition probability from $x$ to $y$ is, on average, comparable to $|x-y|^{-(d+\alpha)}$ with $\alpha\in (0,2)$ but is…

Probability · Mathematics 2020-05-01 Xin Chen , Takashi Kumagai , Jian Wang

We consider the behaviour of branching-selection particle systems in the large population limit. The dynamics of these systems is the combination of the following three components: (a) Motion: particles move on the real line according to a…

Probability · Mathematics 2023-11-22 Jean Bérard , Brieuc Frénais

Zero-range processes with decreasing jump rates are known to exhibit condensation, where a finite fraction of all particles concentrates on a single lattice site when the total density exceeds a critical value. We study such a process on a…

Probability · Mathematics 2018-04-26 Inés Armendáriz , Stefan Grosskinsky , Michail Loulakis