Related papers: Markov processes on Riesz spaces
A class of stochastic processes, called "weak Dirichlet processes", is introduced and its properties are investigated in detail. This class is much larger than the class of Dirichlet processes. It is closed under C^1$-transformations and…
Stochastic Spatio-Temporal processes are prevalent across domains ranging from modeling of plasma to the turbulence in fluids to the wave function of quantum systems. This letter studies a measure-theoretic description of such systems by…
We consider continuous-time Markov chains on integers which allow transitions to adjacent states only, with alternating rates. We give explicit formulas for probability generating functions, and also for means, variances and state…
An analogue of the classical Mecke formula for Poisson point processes is proved for the class of space-time STIT tessellation processes. From this key identity the Markov property of a class of associated random processes is derived. This…
In the last years, many authors studied a class of continuous time semi-Markov processes obtained by time-changing Markov processes by hitting times of independent subordinators. Such processes are governed by integro-differential…
We introduce multi-kangaroo Markov processes and provide a general procedure for evaluating a certain type of stochastic functionals. We calculate analytically the large deviation properties. Applications include zero-crossing statistics…
In this paper, we study quasi-stationary distributions of nonlinearly perturbed semi-Markov processes in discrete time. This type of distributions is of interest for the analysis of stochastic systems which have finite lifetimes, but are…
This paper proves the uniqueness of measure for the two-dimensional Navier-Stokes equations under a random kick-force and a time-dependent deterministic force. By extending a result for uniqueness of measure for time-homogeneous Markov…
We study Markov processes where the "time" parameter is replaced by paths in a directed graph from an initial vertex to a terminal one. Along each directed path the process is Markov and has the same distribution as the one along any other…
With the increasing ubiquity of safety-critical autonomous systems operating in uncertain environments, there is a need for mathematical methods for formal verification of stochastic models. Towards formally verifying properties of…
We consider Markov processes in continuous time with state space $\posint^N$ and provide two sufficient conditions and one necessary condition for the existence of moments $E(\|X(t)\|^r)$ of all orders $r \in \nat$ for all $t \geq 0$. The…
The construction presented in this paper can be briefly described as follows: starting from any "finite-dimensional" Markov transition function p_t, on a measurable state space (E,B), we construct a strong Markov process on a certain…
In the paper adapting Krein Rutman theory we show the existence of solutions to the long run risk sensitive control problem for controlled discrete time Markov processes over locally compact separable metric spaces.
For time-inconsistent stochastic controls in discrete time and finite horizon, an open problem in Bj\"ork and Murgoci (Finance Stoch, 2014) is the existence of an equilibrium control. A nonrandomized Borel measurable Markov equilibrium…
Comparison results are given for time-inhomogeneous Markov processes with respect to function classes induced stochastic orderings. The main result states comparison of two processes, provided that the comparability of their infinitesimal…
Ito's construction of Markovian solutions to stochastic equations driven by a L\'evy noise is extended to nonlinear distribution dependent integrands aiming at the effective construction of linear and nonlinear Markov semigroups and the…
We present a formalism to describe slowly decaying systems in the context of finite Markov chains obeying detailed balance. We show that phase space can be partitioned into approximately decoupled regions, in which one may introduce…
We analyze the Markov property of solutions to the compressible Navier--Stokes system perturbed by a general multiplicative stochastic forcing. We show the existence of an almost sure Markov selection to the associated martingale problem.…
This paper shows how the theory of dynamic risk measures provides viscosity solutions to a family of second-order parabolic partial differential equations, even in the degenerate case. First, motivated by the martingale problem approach of…
In this paper we generalize the martingale of Kella and Whitt to the setting of L\'{e}vy-type processes and show that the (local) martingales obtained are in fact square integrable martingales which upon dividing by the time index converge…