Related papers: Approximation of birth-death processes
This paper studies function approximation for finite horizon discrete time Markov decision processes under certain convexity assumptions. Uniform convergence of these approximations on compact sets is proved under several sampling schemes…
We consider discrete-time birth-death chains on a spider, i.e. a graph consisting of $N$ discrete half lines on the plane that are joined at the origin. This process can be identified with a discrete-time quasi-birth-death process on the…
The marked Hawkes risk process is a compound point process for which the occurrence and amplitude of past events impact the future. Thanks to its autoregressive properties, it found applications in various fields such as neuosciences,…
The Martin compactification is investigated for a d-dimensional random walk which is killed when at least one of it's coordinates becomes zero or negative. The limits of the Martin kernel are represented in terms of the harmonic functions…
We study a multi-type Ehrenfest process modeled as a finite quasi-birth-death (QBD) process. We assume that the transitions are allowed only to the two adjacent levels of the same phase and are characterized by linear rates. The crucial…
We present a numerical method to compute the survival function and the moments of the exit time for a piecewise-deterministic Markov process (PDMP). Our approach is based on the quantization of an underlying discrete-time Markov chain…
A general model of catalytic branching process (CBP) with any finite number of catalysis centers in a discrete space is studied. More exactly, it is assumed that particles move in this space according to a specified Markov chain and they…
We prove under mild conditions that the Fleming-Viot process selects the minimal quasi-stationary distribution for Markov processes with soft killing on non-compact state spaces. Our results are applied to multi-dimensional birth and death…
The simple (linear) birth-and-death process is a widely used stochastic model for describing the dynamics of a population. When the process is observed discretely over time, despite the large amount of literature on the subject, little is…
This article presents a variant of Fleming-Viot particle systems, which are a standard way to approximate the law of a Markov process with killing as well as related quantities. Classical Fleming-Viot particle systems proceed by simulating…
We study the computational complexity of central analysis problems for One-Counter Markov Decision Processes (OC-MDPs), a class of finitely-presented, countable-state MDPs. OC-MDPs are equivalent to a controlled extension of (discrete-time)…
The extremal process of a branching random walk is the point measure recording the position of particles alive at time $n$, shifted around the expected position of the minimal position. Madaule proved that this point measure converges, as…
Density dependence is important in the ecology and evolution of microbial and cancer cells. Typically, we can only measure net growth rates, but the underlying density-dependent mechanisms that give rise to the observed dynamics can…
In a Markov chain population model subject to catastrophes, random immigration events (birth), promoting growth, are in balance with the effect of binomial catastrophes that cause recurrent mass removal (death). Using a generating function…
The main substance of the paper concerns the growth rate and the classification (ergodicity, transience) of a family of random trees. In the basic model, new edges appear according to a Poisson process of parameter $\lambda$ and leaves can…
We consider a bilateral birth-death process characterized by a constant transition rate $\lambda$ from even states and a possibly different transition rate $\mu$ from odd states. We determine the probability generating functions of the even…
It is well-known that 0 is the absorbing state for a branching system. Each particle in the system lives a random long time and gives a random number of new particles at its death time. It stops when the system has no particle. This paper…
Near a birth-death critical point in a one-parameter family of gradient flows, there are precisely two Morse critical points of index difference one on the birth side. This paper gives a self-contained proof of the folklore theorem that…
Controlled branching processes are stochastic growth population models in which the number of individuals with reproductive capacity in each generation is controlled by a random control function. The purpose of this work is to examine the…
We study a Markov decision problem in which the state space is the set of finite marked point configurations in the plane, the actions represent thinnings, the reward is proportional to the mark sum which is discounted over time, and the…