Related papers: Markov processes on Riesz spaces
Martingales, Markov processes and Laws of Large Numbers have been well studied in the Riesz space (vector lattice) setting. There has, however, been no attention given in the Riesz space setting to Laws of Small Numbers or to the so called…
We refine stochastic calculus for symmetric Markov processes without using time reverse operators. Under some conditions on the jump functions of locally square integrable martingale additive functionals, we extend Nakao's divergence-like…
Let $E$ be the class of finite (resp. probability) measures absolutely continuous with respect to a $\sigma$-finite Radon measure on a Polish space. We present a criterion on the quasi-regularity of Dirichlet forms on $E$ in terms of upper…
Stochastic processes on topological vector spaces over non-Archimedean fields and with transition measures having values in non-Archimedean fields are defined and investigated. For this the non-Archimedean analog of the Kolmogorov theorem…
In this work we investigate the long-time behavior, that is the existence and characterization of invariant measures as well as convergence of transition probabilities, for Markov processes obtained as the unique mild solution to stochastic…
We consider a Markov jump process on a general state space to which we apply a time-dependent weak perturbation over a finite time interval. By martingale-based stochastic calculus, under a suitable exponential moment bound for the…
We present limit theorems for a sequence of Piecewise Deterministic Markov Processes (PDMPs) taking values in a separable Hilbert space. This class of processes provides a rigorous framework for stochastic spatial models in which discrete…
This paper studies continuous-time Markov decision processes under the risk-sensitive average cost criterion. The state space is a finite set, the action space is a Borel space, the cost and transition rates are bounded, and the…
The general framework on the non-local Markovian symmetric forms on weighted $l^p$ $(p \in [1, \infty])$ spaces constructed by [A,Kagawa,Yahagi,Y 2020], by restricting the situation where $p =2$, is applied to such measure spaces as the…
We present a class of Gauss-Markov processes which can be represented as space-time scaled stationary Ornstein-Uhlenbeck processes defined on the real line. We give several explicit examples of the representation for certain Gauss bridge…
We formalize and analyze the notions of stochastic monotonicity and realizable mono-tonicity for Markov Chains in continuous-time, taking values in a finite partially ordered set. Similarly to what happens in discrete-time, the two notions…
We consider the problem of `discrete-time persistence', which deals with the zero-crossings of a continuous stochastic process, X(T), measured at discrete times, T = n(\Delta T). For a Gaussian Stationary Process the persistence (no…
We provide a probabilistic description of the stationary measures for the open KPZ on the spatial interval $[0,1]$ in terms of a Markov process $Y$, which is a Doob's $h$ transform of the Brownian motion killed at an exponential rate. Our…
This work shows how exponential concentration inequalities for additive functionals of stochastic processes over a finite time interval can be derived from concentration inequalities for martingales. The approach is entirely probabilistic…
In this research paper, the relationship between finite / countable state space stochastic processes and point processes is explored. Utilizing the known relationship between Poisson processes and continuous time Markov chains, finite /…
A time-dependent finite-state Markov chain that uses doubly stochastic transition matrices, is considered. Entropic quantities that describe the randomness of the probability vectors, and also the randomness of the discrete paths, are…
Non-Archimedean analogs of Markov quasimeasures and stochastic processes are investigated. Thery are used for the development of stochastic antiderivations. The non-Archimedean analog of the It$\hat o$ formula is proved.
Markov processes with stochastic resetting towards the origin generically converge towards non-equilibrium steady-states. Long dynamical trajectories can be thus analyzed via the large deviations at Level 2.5 for the joint probability of…
Markov models are often used to capture the temporal patterns of sequential data for statistical learning applications. While the Hidden Markov modeling-based learning mechanisms are well studied in literature, we analyze a…
In applications spaning from image analysis and speech recognition, to energy dissipation in turbulence and time-to failure of fatigued materials, researchers and engineers want to calculate how often a stochastic observable crosses a…