Related papers: A Markov process for an infinite age-structured po…
Isolating slower dynamics from fast fluctuations has proven remarkably powerful, but how do we proceed from partial observations of dynamical systems for which we lack underlying equations? Here, we construct maximally-predictive states by…
Consider a system evolving according to an absorbing discrete-time Markov chain with known transition matrix. The state of the system is observed at two points in time, separated by an unknown number of generations. We are interested in…
We consider Markov processes in continuous time with state space $\posint^N$ and provide two sufficient conditions and one necessary condition for the existence of moments $E(\|X(t)\|^r)$ of all orders $r \in \nat$ for all $t \geq 0$. The…
This article describes an accurate procedure for computing the mean first passage times of a finite irreducible Markov chain and a Markov renewal process. The method is a refinement to the Kohlas, Zeit fur Oper Res, 30,197-207, (1986)…
The Lindblad equation describes the time evolution of a density matrix of a quantum mechanical system. Stationary solutions are obtained by time-averaging the solution, which will in general depend on the initial state. We provide an…
Certain Markov processes, or deterministic evolution equations, have the property that they are dual to a stochastic process that exhibits extinction versus unbounded growth, i.e., the total mass in such a process either becomes zero, or…
Density dependent Markov population processes in large populations of size $N$ were shown by Kurtz (1970, 1971) to be well approximated over finite time intervals by the solution of the differential equations that describe their average…
Consider a sequence of Markov processes $X^1, X^2,...$ with state space $E$, where $X^N$ has a strong drift to $D \subseteq E$, such that $\Phi(X^N)$ is slow for some appropriate $\Phi: E\to D$. Using the method of martingale problems, we…
We study an $n$-species $t$-PushTASEP, an integrable long-range stochastic process, on a one-dimensional periodic lattice with inhomogeneities $x_1,\ldots,x_L$ and arbitrary capacity $l$ at each lattice site. The Markov matrix is identified…
We propose a novel measure valued process which models the behaviour of chemical reaction networks in spatially heterogeneous systems. It models reaction dynamics between different molecular species and continuous movement of molecules in…
We introduce the concept of an imprecise Markov semigroup \(\mathbf Q\). It is a tool that allows us to represent ambiguity around both the transition probabilities and the invariant measure of a continuous-time Markov process via a…
We study K-processes, which are Markov processes in a denumerable state space, all of whose elements are stable, with the exception of a single state, starting from which the process enters finite sets of stable states with uniform…
Measure-free discrete time stochastic processes in Riesz spaces were formulated and studied by Kuo, Labuschagne and Watson. Aspects relating martingales, stopping times, convergence of these processes as well as various decomposition were…
Filtering---estimating the state of a partially observable Markov process from a sequence of observations---is one of the most widely studied problems in control theory, AI, and computational statistics. Exact computation of the posterior…
Suppose that a real valued process X is given as a solution to a stochastic differential equation. Then, for any twice continuously differentiable function f, the backward Kolmogorov equation gives a condition for f(t,X) to be a local…
We consider Markov processes with generator of the form $\gamma \mathcal{L}_{1} + \mathcal{L}_{0}$, in which $\mathcal{L}_{1}$ generates a so-called dominant process that converges at large times towards a random point in a fixed subset…
In this paper, we employ Markov process theory to prove asymptotic results for a class of stochastic processes which arise as solutions of a stochastic evolution inclusion and are given by the representation formula \begin{align*}…
We introduce a new class of stochastic processes which are stationary, Markovian and characterized by an infinite range of time-scales. By transforming the Fokker-Planck equation of the process into a Schrodinger equation with an…
In many biological systems, chemical reactions or changes in a physical state are assumed to occur instantaneously. For describing the dynamics of those systems, Markov models that require exponentially distributed inter-event times have…
By modeling the interaction of a system with an environment through a renewal approach, we demonstrate that completely positive non-Markovian dynamics may develop some unexplored non-standard statistical properties. The renewal approach is…