Related papers: Uniqueness Problem for the Backward Differential E…
Dealing with unichain MDPs, we consider stationary distributions of policies that coincide in all but $n$ states. In these states each policy chooses one of two possible actions. We show that the stationary distributions of n+1 such…
We consider the genealogical tree of a stationary continuous state branching process with immigration. For a sub-critical stable branching mechanism, we consider the genealogical tree of the extant population at some fixed time and prove…
A branching process in a Markovian environment consists of an irreducible Markov chain on a set of "environments" together with an offspring distribution for each environment. At each time step the chain transitions to a new random…
Understanding and predicting how complex systems respond to external perturbations is a central challenge in nonequilibrium statistical physics. Here we consider continuous-time Markov networks, which we subject to perturbations along a…
The time evolution of the one-point probability vector of stochastic processes and quantum processes for $N$-level systems have been unified. Hence, quantum states and quantum operations can be regarded as generalizations of the one-point…
We address a class of backward stochastic differential equations on a bounded interval, where the driving noise is a marked, or multivariate, point process. Assuming that the jump times are totally inaccessible and a technical condition…
In this note, we present a new numerical method for solving backward stochastic differential equations. Our method can be viewed as an analogue of the classical finite element method solving deterministic partial differential equations.
We consider a system of seminlinear parabolic variational inequalities with time-dependent convex obstacles. We prove the existence and uniqueness of its solution. We also provide a stochastic representation of the solution and show that it…
In this work, we study the numerical approximation of a class of singular fully coupled forward backward stochastic differential equations. These equations have a degenerate forward component and non-smooth terminal condition. They are…
A general theory is developed to study individual based models which are discrete in time. We begin by constructing a Markov chain model that converges to a one-dimensional map in the infinite population limit. Stochastic fluctuations are…
The upper extremes of a Markov chain with regulary varying stationary marginal distribution are known to exhibit under general conditions a multiplicative random walk structure called the tail chain. More generally, if the Markov chain is…
Based on extensive study of a dynamical systems model of the development of a cell society, a novel theory for stem cell differentiation and its regulation is proposed as the ``chaos hypothesis''. Two fundamental features of stem cell…
This paper investigates a numerical probabilistic method for the solution of some semilinear stochastic partial differential equations (SPDEs in short). The numerical scheme is based on discrete time approximation for solutions of systems…
The normalised partial sums of values of a nonnegative multiplicative function over divisors with appropriately restricted sizes of a random permutation from the symmetric group define trajectories of a stochastic process. We prove a…
In this paper, we introduce branching processes in a L\'evy random environment. In order to define this class of processes, we study a particular class of non-negative stochastic differential equations driven by Brownian motions and Poisson…
Arguing about the equilibrium distribution of continuous-time Markov chains can be vital for showing properties about the underlying systems. For example in biological systems, bistability of a chemical reaction network can hint at its…
This article is devoted to a generalized version of Smoluchowski's coagulation equation. This model describes the time evolution of a system of aggregating particles under the effect of external input and output particles. We show that for…
In this paper, we consider the backward Cauchy problem of linear degenerate stochastic partial differential equations. We obtain the existence and uniqueness results in Sobolev space $L^p(\Omega; C([0,T];W^{m,p}))$ with both $m\geq 1$ and…
We propose a particle system of diffusion processes coupled through a chain-like network structure described by an infinite-dimensional, nonlinear stochastic differential equation of McKean-Vlasov type. It has both (i) a local chain…
In this paper, we study a class of stochastic processes, called evolving network Markov chains, in evolving networks. Our approach is to transform the degree distribution problem of an evolving network to a corresponding problem of evolving…