English
Related papers

Related papers: Long time behavior of Markov processes and beyond

200 papers

A study of time homogeneous, real valued Markov processes with a special property and a non-atomic initial distribution is provided. The new notion of a function of evolution of distribution which determines the dependency between one…

Probability · Mathematics 2022-07-04 Tomasz Bielecki , Jacek Jakubowski , Maciej Wiśniewolski

Multistate Markov models are a canonical parametric approach for data modeling of observed or latent stochastic processes supported on a finite state space. Continuous-time Markov processes describe data that are observed irregularly over…

Classical linear regression is considered for a case when regression parameters depend on the external random environment. The last is described as a continuous time Markov chain with finite state space. Here the expected sojourn times in…

Methodology · Statistics 2019-01-29 Alexander M. Andronov , Nadezda Spiridovska

In many practical cases, the engineer has access to prior knowledge like rough values of the DC-gain or the main time constant of the system. In order to improve the accuracy of subspace-based identification techniques using the model…

Systems and Control · Computer Science 2016-06-28 Guillaume Mercère

Extended Thermodynamics is a very important theory: for example, it predicts hyperbolicity, finite speeds of propagation waves as well as continuous dependence on initial data. Therefore, it constitutes a significative improvement of…

Mathematical Physics · Physics 2007-05-23 Sebastiano Pennisi , Maria Cristina Carrisi , Antonio Scanu

We develop a martingale approximation approach to studying the limiting behavior of quadratic forms of Markov chains. We use the technique to examine the asymptotic behavior of lag-window estimators in time series and we apply the results…

Probability · Mathematics 2011-08-16 Yves F. Atchade , Matias D. Cattaneo

Equilibrium statistical mechanics provides powerful tools to understand physics at the macroscale. Yet, the question remains how this can be justified based on a microscopic quantum description. Here, we extend the ideas of pure state…

Quantum Physics · Physics 2023-06-07 Neil Dowling , Pedro Figueroa-Romero , Felix A. Pollock , Philipp Strasberg , Kavan Modi

An overview is given of the long-time and long-distance behavior of correlation functions in both classical and quantum statistical mechanics. After a simple derivation of the classical long-time tails in equilibrium time correlation…

Statistical Mechanics · Physics 2015-06-24 T. R. Kirkpatrick , D. Belitz , J. V. Sengers

Non-linear Hawkes processes with memory kernels given by the sum of Erlang kernels are considered. It is shown that their stability properties can be studied in terms of an associated class of piecewise deterministic Markov processes,…

Probability · Mathematics 2018-11-27 Aline Duarte , Eva Löcherbach , Guilherme Ost

The paper is devoted to a systematic study of the duality of processes in the sense that $E f(X_t^x,y)=E f (x, Y_t^y)$ for a certain $f$. This classical topic has well known applications in interacting particles, intertwining,…

Probability · Mathematics 2022-05-03 Vassili Kolokoltsov , RuiXin Lee

The influence of a time-periodic forcing on stochastic processes can essentially be emphasized in the large time behaviour of their paths. The statistics of transition in a simple Markov chain model permits to quantify this influence. In…

Probability · Mathematics 2013-03-27 Samuel Herrmann , Damien Landon

Many biological and medical questions can be modeled using time-to-event data in finite-state Markov chains, with the phase-type distribution describing intervals between events. We solve the inverse problem: given a phase-type…

Dynamical Systems · Mathematics 2024-11-19 Ovidiu Radulescu , Dima Grigoriev , Matthias Seiss , Maria Douaihy , Mounia Lagha , Edouard Bertrand

We study ergodic properties of a class of Markov-modulated general birth-death processes under fast regime switching. The first set of results concerns the ergodic properties of the properly scaled joint Markov process with a parameter that…

Probability · Mathematics 2019-09-17 Ari Arapostathis , Guodong Pang , Yi Zheng

The stochastic properties of a Langevin-type Markov process can be extracted from a given time series by a Markov analysis. Also processes that obey a stochastically forced second order differential equation can be analyzed this way by…

Data Analysis, Statistics and Probability · Physics 2014-12-09 Bernd Lehle , Joachim Peinke

Analytical and numerical studies on many-body stochastic processes with multiplicative interactions are reviewed. The method of moment relations is used to investigate effects of asymmetry and randomness in interactions. Probability…

Statistical Mechanics · Physics 2009-11-11 Akihiro Fujihara , Toshiya Ohtsuki , Hiroshi Yamamoto

Various kinematical quantities associated with the statistical properties of dynamical systems are examined: statistics of the motion, dynamical bases and Lyapunov exponents. Markov partitons for chaotic systems, without any attempt at…

chao-dyn · Physics 2009-10-22 G. Gallavotti

We consider processes which are functions of finite-state Markov chains. It is well known that such processes are rarely Markov. However, such processes are often regular in the following sense: the distant past values of the process have…

Probability · Mathematics 2021-01-05 Steven Berghout , Evgeny Verbitskiy

This work shows how exponential concentration inequalities for additive functionals of stochastic processes over a finite time interval can be derived from concentration inequalities for martingales. The approach is entirely probabilistic…

Probability · Mathematics 2020-07-14 Bob Pepin

We consider Markov processes, which describe e.g. queueing network processes, in a random environment which influences the network by determining random breakdown of nodes, and the necessity of repair thereafter. Starting from an explicit…

Probability · Mathematics 2015-03-03 H. Daduna , R. Szekli

We provide a systematic study of the notion of duality of Markov processes with respect to a function. We discuss the relation of this notion with duality with respect to a measure as studied in Markov process theory and potential theory…

Probability · Mathematics 2014-02-18 Sabine Jansen , Noemi Kurt