English
Related papers

Related papers: Markov processes on Riesz spaces

200 papers

Martingales, Markov processes and Laws of Large Numbers have been well studied in the Riesz space (vector lattice) setting. There has, however, been no attention given in the Riesz space setting to Laws of Small Numbers or to the so called…

Functional Analysis · Mathematics 2026-05-29 Wen-Chi Kuo , Nigel Musara , Bruce A. Watson

We refine stochastic calculus for symmetric Markov processes without using time reverse operators. Under some conditions on the jump functions of locally square integrable martingale additive functionals, we extend Nakao's divergence-like…

Probability · Mathematics 2012-11-09 Kazuhiro Kuwae

Let $E$ be the class of finite (resp. probability) measures absolutely continuous with respect to a $\sigma$-finite Radon measure on a Polish space. We present a criterion on the quasi-regularity of Dirichlet forms on $E$ in terms of upper…

Probability · Mathematics 2025-06-30 Panpan Ren , Feng-Yu Wang , Simon Wittmann

Stochastic processes on topological vector spaces over non-Archimedean fields and with transition measures having values in non-Archimedean fields are defined and investigated. For this the non-Archimedean analog of the Kolmogorov theorem…

Classical Analysis and ODEs · Mathematics 2007-05-23 S. Ludkovsky , A. Khrennikov

In this work we investigate the long-time behavior, that is the existence and characterization of invariant measures as well as convergence of transition probabilities, for Markov processes obtained as the unique mild solution to stochastic…

Probability · Mathematics 2022-03-17 Balint Fárkas , Martin Friesen , Barbara Rüdiger , Dennis Schroers

We consider a Markov jump process on a general state space to which we apply a time-dependent weak perturbation over a finite time interval. By martingale-based stochastic calculus, under a suitable exponential moment bound for the…

Probability · Mathematics 2024-05-14 Alessandra Faggionato , Vittoria Silvestri

We present limit theorems for a sequence of Piecewise Deterministic Markov Processes (PDMPs) taking values in a separable Hilbert space. This class of processes provides a rigorous framework for stochastic spatial models in which discrete…

Probability · Mathematics 2012-04-13 Martin G. Riedler , Michèle Thieullen , Gilles Wainrib

This paper studies continuous-time Markov decision processes under the risk-sensitive average cost criterion. The state space is a finite set, the action space is a Borel space, the cost and transition rates are bounded, and the…

Optimization and Control · Mathematics 2015-12-22 Qingda Wei , Xian Chen

The general framework on the non-local Markovian symmetric forms on weighted $l^p$ $(p \in [1, \infty])$ spaces constructed by [A,Kagawa,Yahagi,Y 2020], by restricting the situation where $p =2$, is applied to such measure spaces as the…

Mathematical Physics · Physics 2021-05-13 Sergio Albeverio , Toshinao Kagawa , Shyuji Kawasaki , Yumi Yahagi , Minoru W. Yoshida

We present a class of Gauss-Markov processes which can be represented as space-time scaled stationary Ornstein-Uhlenbeck processes defined on the real line. We give several explicit examples of the representation for certain Gauss bridge…

Probability · Mathematics 2019-01-28 Matyas Barczy , Peter Kern

We formalize and analyze the notions of stochastic monotonicity and realizable mono-tonicity for Markov Chains in continuous-time, taking values in a finite partially ordered set. Similarly to what happens in discrete-time, the two notions…

Probability · Mathematics 2016-03-08 Paolo Dai Pra , Pierre-Yves Louis , Ida Minelli

We consider the problem of `discrete-time persistence', which deals with the zero-crossings of a continuous stochastic process, X(T), measured at discrete times, T = n(\Delta T). For a Gaussian Stationary Process the persistence (no…

Statistical Mechanics · Physics 2009-11-07 George C. M. A. Ehrhardt , Alan J. Bray , Satya N. Majumdar

We provide a probabilistic description of the stationary measures for the open KPZ on the spatial interval $[0,1]$ in terms of a Markov process $Y$, which is a Doob's $h$ transform of the Brownian motion killed at an exponential rate. Our…

Probability · Mathematics 2023-04-04 Wlodek Bryc , Alexey Kuznetsov , Yizao Wang , Jacek Wesolowski

This work shows how exponential concentration inequalities for additive functionals of stochastic processes over a finite time interval can be derived from concentration inequalities for martingales. The approach is entirely probabilistic…

Probability · Mathematics 2020-07-14 Bob Pepin

In this research paper, the relationship between finite / countable state space stochastic processes and point processes is explored. Utilizing the known relationship between Poisson processes and continuous time Markov chains, finite /…

Statistics Theory · Mathematics 2012-04-24 Garimella Rama Murthy

A time-dependent finite-state Markov chain that uses doubly stochastic transition matrices, is considered. Entropic quantities that describe the randomness of the probability vectors, and also the randomness of the discrete paths, are…

Quantum Physics · Physics 2022-03-18 A. Vourdas

Non-Archimedean analogs of Markov quasimeasures and stochastic processes are investigated. Thery are used for the development of stochastic antiderivations. The non-Archimedean analog of the It$\hat o$ formula is proved.

General Mathematics · Mathematics 2007-05-23 S. V. Ludkovsky

Markov processes with stochastic resetting towards the origin generically converge towards non-equilibrium steady-states. Long dynamical trajectories can be thus analyzed via the large deviations at Level 2.5 for the joint probability of…

Statistical Mechanics · Physics 2021-05-07 Cecile Monthus

Markov models are often used to capture the temporal patterns of sequential data for statistical learning applications. While the Hidden Markov modeling-based learning mechanisms are well studied in literature, we analyze a…

Machine Learning · Statistics 2021-03-25 Devesh K. Jha

In applications spaning from image analysis and speech recognition, to energy dissipation in turbulence and time-to failure of fatigued materials, researchers and engineers want to calculate how often a stochastic observable crosses a…

Statistical Mechanics · Physics 2018-03-21 Markus Nyberg , Ludvig Lizana , Tobias Ambjörnsson