English
Related papers

Related papers: Towards a characterization of Markov processes enj…

200 papers

We give rates of convergence in the strong invariance principle for stationary sequences satisfying some projective criteria. The conditions are expressed in terms of conditional expectations of partial sums of the initial sequence. Our…

Probability · Mathematics 2012-03-02 Jérôme Dedecker , Paul Doukhan , Florence Merlevède

We construct a large class of non-Markovian master equations that describe the dynamics of open quantum systems featuring strong memory effects, which relies on a quantum generalization of the concept of classical semi-Markov processes.…

Quantum Physics · Physics 2008-10-03 Heinz-Peter Breuer , Bassano Vacchini

Weconsider Markov decision processes arising from a Markov model of an underlying natural phenomenon. Such phenomena are usually periodic (e.g. annual) in time, and so the Markov processes modelling them must be time-inhomogeneous, with…

Optimization and Control · Mathematics 2024-09-17 Arash Khojaste , Geoffrey Pritchard , Golbon Zakeri

We present a general method to derive the metastable behavior of weakly mixing Markov chains. This approach is based on properties of the resolvent equations and can be applied to metastable dynamics which do not satisfy the mixing…

Probability · Mathematics 2024-06-21 Claudio Landim , Diego Marcondes , Insuk Seo

We consider a class of stochastic dynamical systems, called piecewise deterministic Markov processes, with states $(x, \s)\in \O\times \G$, $\O$ being a region in $\bbR^d$ or the $d$--dimensional torus, $\G$ being a finite set. The…

Statistical Mechanics · Physics 2009-02-25 Alessandra Faggionato , Davide Gabrielli , Marco Ribezzi Crivellari

We introduce a new framework that yields spectral bounds on norms of functions of transition maps for finite, homogeneous Markov chains. The techniques employed work for bounded semigroups, in particular for classical as well as for quantum…

Mathematical Physics · Physics 2015-03-16 Oleg Szehr , David Reeb , Michael M. Wolf

A stable-like process is a Feller process $(X_t)_{t\geq 0}$ taking values in $\mathbb{R}^d$ and whose generator behaves, locally, like an $\alpha$-stable L\'evy process, but the index $\alpha$ and all other characteristics may depend on the…

Probability · Mathematics 2020-05-19 V. Knopova , A. Kulik , R. Schilling

We obtain weak rates for approximation of an integral functional of a Markov process by integral sums. An assumption on the process is formulated only in terms of its transition probability density, and, therefore, our approach is not…

Probability · Mathematics 2015-10-08 Iurii Ganychenko , Alexei Kulik

We report on a fundamental role of a non-normalized formal steady state, i.e., an infinite invariant density, in a semi-Markov process where the state is determined by the inter-event time of successive renewals. The state describes certain…

Statistical Mechanics · Physics 2020-07-14 Takuma Akimoto , Eli Barkai , Günter Radons

Our aim is to unify and extend the large deviation upper and lower bounds for the occupation times of a Markov process with $L_2$ semigroups under minimal conditions on the state space and the process trajectories; for example, no strong…

Probability · Mathematics 2008-09-24 Naresh Jain , Nicolai Krylov

Semi-Markov processes are Markovian processes in which the firing time of the transitions is modelled by probabilistic distributions over positive reals interpreted as the probability of firing a transition at a certain moment in time. In…

Formal Languages and Automata Theory · Computer Science 2017-12-04 Mathias Ruggaard Pedersen , Nathanaël Fijalkow , Giorgio Bacci , Kim Guldstrand Larsen , Radu Mardare

We generalize the notion of the submartingale property and Doob's inequality. Furthermore, we show how the latter leads to new inequalities for several stochastic processes: certain time series, Levy processes, random walks, processes with…

Probability · Mathematics 2018-12-24 János Engländer

Using time-reversal, we introduce a stochastic integral for zero-energy additive functionals of symmetric Markov processes, extending earlier work of S. Nakao. Various properties of such stochastic integrals are discussed and an It\^{o}…

Probability · Mathematics 2012-05-29 Z. -Q. Chen , P. J. Fitzsimmons , K. Kuwae , T. -S. Zhang

In this article, we introduce \textit{Mallows processes}, defined to be continuous-time c\`adl\`ag processes with Mallows distributed marginals. We show that such processes exist and that they can be restricted to have certain natural…

Probability · Mathematics 2022-05-11 Benoît Corsini

Markov processes restarted or reset at random times to a fixed state or region in space have been actively studied recently in connection with random searches, foraging, and population dynamics. Here we study the large deviations of…

Statistical Mechanics · Physics 2016-01-06 Janusz M. Meylahn , Sanjib Sabhapandit , Hugo Touchette

We establish an abstract, effective, exponential large deviations type estimate for Markov systems satisfying a weaker form of mixing. We employ this result to derive such estimates, as well as a central limit theorem, for the skew product…

Dynamical Systems · Mathematics 2025-07-17 Ao Cai , Pedro Duarte , Silvius Klein

The deterministic analog of the Markov property of a time-homogeneous Markov process is the semigroup property of solutions of an autonomous differential equation. The semigroup property arises naturally when the solutions of a differential…

Dynamical Systems · Mathematics 2019-12-03 Jorge E. Cardona , Lev Kapitanski

This paper presents a stochastic model motivated by the study of a virus-like evolving population with different mutation rates. This is a continuous time birth-death model: the birth processes are mutually-exciting Hawkes processes and the…

Probability · Mathematics 2026-03-10 Rahul Roy , Dharmaraja Selvamuthu , Paola Tardelli

This thesis is devoted to the study of affine processes and their applications in financial mathematics. In the first part we consider the theory of time-inhomogeneous affine processes on general state spaces. We present a concise setup for…

Pricing of Securities · Quantitative Finance 2015-12-11 Stefan Waldenberger

In this study, a new extension of the Markov Renewal theory is introduced by allowing time to evolve in multiple dimensions. The resulting chains are referred to as multi-time Markov Renewal chains and since this extension is new, the state…

Probability · Mathematics 2025-08-21 Leonidas Kordalis , Samis Trevezas