English
Related papers

Related papers: Realizable monotonicity for continuous-time Markov…

200 papers

The applicability of machine learning for predicting chaotic dynamics relies heavily upon the data used in the training stage. Chaotic time series obtained by numerically solving ordinary differential equations embed a complicated noise of…

Data Analysis, Statistics and Probability · Physics 2021-10-13 Igor A Khovanov

We consider a large family of discrete and continuous time controlled Markov processes and study an ergodic risk-sensitive minimization problem. Under a blanket stability assumption, we provide a complete analysis to this problem. In…

Optimization and Control · Mathematics 2022-07-18 Anup Biswas , Somnath Pradhan

For a stochastically monotone Markov chain taking values in a Polish space, we present a number of conditions for existence and for uniqueness of its stationary regime, as well as for closeness of its transient trajectories. In particular,…

Probability · Mathematics 2026-04-02 Sergey Foss , Michael Scheutzow

We establish new conditions for obtaining uniform bounds on the moments of discrete-time stochastic processes. Our results require a weak negative drift criterion along with a state-dependent restriction on the sizes of the one-step jumps…

Probability · Mathematics 2022-06-02 Arnab Ganguly , Debasish Chatterjee

This paper is concerned with the solution of the optimal stopping problem associated to the valuation of Perpetual American options driven by continuous time Markov chains. We introduce a new dynamic approach for the numerical pricing of…

Probability · Mathematics 2019-04-25 Laurent Miclo , Stéphane Villeneuve

We establish convergence to an invariant measure as time tends to infinity, for a large class of (possibly non-Markovian) stochastic volatility models. Our arguments are based on a novel coupling idea for Markov chains which also extends to…

Probability · Mathematics 2021-08-30 Balázs Gerencsér , Miklós Rásonyi

We consider the fluctuations of a time-integrated particle current around an atypical value in a generic stochastic Markov process involving classical particles with two-site interaction and hardcore repulsion on a finite one-dimensional…

Statistical Mechanics · Physics 2016-01-20 Pegah Torkaman , Farhad H. Jafarpour

We consider the problem of tracking an unstable stochastic process $X_t$ by using causal knowledge of another stochastic process $Y_t$. We obtain necessary conditions and sufficient conditions for maintaining a finite tracking error. We…

Information Theory · Computer Science 2020-05-18 Baran Tan Bacinoglu , Yin Sun , Elif Uysal

We develop an approach to time-consistent risk evaluation of continuous-time processes in Markov systems. Our analysis is based on dual representation of coherent risk measures, differentiability concepts for multivalued mappings, and a…

Optimization and Control · Mathematics 2017-01-31 Darinka Dentcheva , Andrzej Ruszczynski

We consider continuous-time Markov chains which display a family of wells at the same depth. We provide sufficient conditions which entail the convergence of the finite-dimensional distributions of the order parameter to the ones of a…

Probability · Mathematics 2019-10-03 Claudio Landim , Michail Loulakis , Mustapha Mourragui

We consider Markov chains which are polynomially mixing, in a weak sense expressed in terms of the space of functions on which the mixing speed is controlled. In this context, we prove polynomial large and moderate deviations inequalities.…

Probability · Mathematics 2016-07-22 J Dedecker , Sébastien Gouëzel , F Merlevède

We consider a discrete time dynamic system described by a difference equation with periodic coefficients and with additive stochastic noise. We investigate the possibility of the periodicity for the solution. In particular, we found…

Dynamical Systems · Mathematics 2013-09-02 Alexandra Rodkina , Nikolai Dokuchaev , John Appleby

We discuss the relationship between discrete-time processes (chains) and one-dimensional Gibbs measures. We consider finite-alphabet (finite-spin) systems, possibly with a grammar (exclusion rule). We establish conditions for a stochastic…

Probability · Mathematics 2007-05-23 Roberto Fernandez , Gregory Maillard

In this research the technology of complex Markov chains is applied to predict financial time series. The main distinction of complex or high-order Markov Chains and simple first-order ones is the existing of aftereffect or memory. The…

Statistical Finance · Quantitative Finance 2011-11-23 Vladimir Soloviev , Vladimir Saptsin , Dmitry Chabanenko

For Markov processes over discrete configurations, an asymptotic bound on the uncertainty of stochastic fluxes is derived in terms of the harmonic mean of decay rates with respect to the stationary distribution. This bound is necessarily…

Statistical Mechanics · Physics 2024-07-16 Katarzyna Macieszczak

We study the persistence in a class of continuous stochastic processes that are stationary only under integer shifts of time. We show that under certain conditions, the persistence of such a continuous process reduces to the persistence of…

Statistical Mechanics · Physics 2009-11-07 Satya N. Majumdar , Deepak Dhar

Rate processes are simple and analytically tractable models for many dynamical systems which switch stochastically between a discrete set of quasi stationary states but they may also approximate continuous processes by coarse grained,…

Statistical Mechanics · Physics 2013-03-11 R. Toenjes , H. Kori

We study irreducible time-homogenous Markov chains with finite state space in discrete time. We obtain results on the sensitivity of the stationary distribution and other statistical quantities with respect to perturbations of the…

Probability · Mathematics 2007-05-23 Eilon Solan , Nicolas Vieille

We prove that the class of discrete time stationary max-stable process satisfying the Markov property is equal, up to time reversal, to the class of stationary max-autoregressive processes of order $1$. A similar statement is also proved…

Probability · Mathematics 2013-11-13 Clément Dombry , Frédéric Eyi-Minko

The focus of this article is on entropy and Markov processes. We study the properties of functionals which are invariant with respect to monotonic transformations and analyze two invariant "additivity" properties: (i) existence of a…

Data Analysis, Statistics and Probability · Physics 2013-11-12 A. N. Gorban , P. A. Gorban , G. Judge