Related papers: A Markov process for a continuum infinite particle…
The use of coordinate processes for the modelling of impulse control for general Markov processes typically involves the construction of a probability measure on a countable product of copies of the path space. In addition, admissibility of…
Consider a system of infinitely many Brownian particles on the real line. At any moment, these particles can be ranked from the bottom upward. Each particle moves as a Brownian motion with drift and diffusion coefficients depending on its…
Birth and death Markov processes can model stochastic physical systems from percolation to disease spread and, in particular, wildfires. We introduce and analyze a birth-death-suppression Markov process as a model of controlled culling of…
We consider finite and infinite systems of particles on the real line and half-line evolving in continuous time. Hereby, the particles are driven by i.i.d. L\'{e}vy processes endowed with rank-dependent drift and diffusion coefficients. In…
We develop a method based on martingales to study first-passage problems of time-additive observables exiting an interval of finite width in a Markov process. In the limit that the interval width is large, we derive generic expressions for…
Motivated by queueing systems with heterogeneous parallel servers, we consider a class of structured multi-dimensional Markov processes whose state space can be partitioned into two parts: a finite set of boundary states and a structured…
We investigate toy dynamical models of energy-level repulsion in quantum eigenvalue sequences. We focus on parametric (with respect to a running coupling or "complexity" parameter) stochastic processes that are capable of relaxing towards a…
We study the evolution of a particle system whose genealogy is given by a supercritical continuous time Galton--Watson tree. The particles move independently according to a Markov process and when a branching event occurs, the offspring…
Markov branching systems form a fundamental class of stochastic models that are extensively applied in biology, physics, finance, and other domains. These systems are distinguished by their continuous-time evolution and inherent branching…
We propose the entropy of random Markov trajectories originating and terminating at a state as a measure of the stability of a state of a Markov process. These entropies can be computed in terms of the entropy rates and stationary…
The paper deals with the problem of large-time behaviour of trajectories for discrete-time dynamical systems driven by a random noise. Assuming that the phase space is finite-dimensional and compact, and the noise is a Markov process with a…
We explore two notions of stationary processes. The first is called a random-step Markov process in which the stationary process of states, $(X_i)_{i \in \mathbb{Z}}$ has a stationary coupling with an independent process on the positive…
We report an experimental study of a dilute "gas" of magnetic particles subjected to a vertical alternating magnetic field in a 3D container. Due to the torque exerted by the field on the magnetic moment of each particle, a spatially…
We study an $n$-species $t$-PushTASEP, an integrable long-range stochastic process, on a one-dimensional periodic lattice with inhomogeneities $x_1,\ldots,x_L$ and arbitrary capacity $l$ at each lattice site. The Markov matrix is identified…
For the system with inhomogeneous distribution of macroscopic parameters we obtain thermodynamic relation which depends on the spatial point (coordinate). In our approach, to obtain such a relation we use the basic ideas of the method of…
It is well-known that 0 is the absorbing state for a branching system. Each particle in the system lives a random long time and gives a random number of new particles at its death time. It stops when the system has no particle. This paper…
In this work, we study dynamic programming (DP) algorithms for partially observable Markov decision processes with jointly continuous and discrete state-spaces. We consider a class of stochastic systems which have coupled discrete and…
Motivated by a general principle governing regulation mechanisms in biological cells, we investigate a general interaction scheme between different populations of particles and specific particles, referred to as agents. Assuming that each…
This paper considers the space homogenous Boltzmann equation with Maxwell molecules and arbitrary angular distribution. Following Kac's program, emphasis is laid on the the associated conservative Kac's stochastic $N$-particle system, a…
We construct an infinite particle/infinite volume Langevin dynamics on the space of configurations in $\R^d$ having velocities as marks. The construction is done via a limiting procedure using $N$-particle dynamics in cubes…