English
Related papers

Related papers: A perturbation analysis of some Markov chains mode…

200 papers

We develop an estimator for the high-dimensional covariance matrix of a locally stationary process with a smoothly varying trend and use this statistic to derive consistent predictors in non-stationary time series. In contrast to the…

Methodology · Statistics 2020-01-08 Holger Dette , Weichi Wu

We investigate the statistical complexity of estimating the parameters of a discrete-state Markov chain kernel from a single long sequence of state observations. In the finite case, we characterize (modulo logarithmic factors) the minimax…

Machine Learning · Statistics 2020-08-14 Geoffrey Wolfer , Aryeh Kontorovich

We consider the fluctuations of a time-integrated particle current around an atypical value in a generic stochastic Markov process involving classical particles with two-site interaction and hardcore repulsion on a finite one-dimensional…

Statistical Mechanics · Physics 2016-01-20 Pegah Torkaman , Farhad H. Jafarpour

Markov chain analysis is a key technique in formal verification. A practical obstacle is that all probabilities in Markov models need to be known. However, system quantities such as failure rates or packet loss ratios, etc. are often not --…

Logic in Computer Science · Computer Science 2023-11-08 Sebastian Junges , Erika Ábrahám , Christian Hensel , Nils Jansen , Joost-Pieter Katoen , Tim Quatmann , Matthias Volk

We provide a novel method for sensitivity analysis of parametric robust Markov chains. These models incorporate parameters and sets of probability distributions to alleviate the often unrealistic assumption that precise probabilities are…

Machine Learning · Computer Science 2023-05-03 Thom Badings , Sebastian Junges , Ahmadreza Marandi , Ufuk Topcu , Nils Jansen

The paper studies an improved estimate for the rate of convergence for nonlinear homogeneous discrete-time Markov chains. These processes are nonlinear in terms of the distribution law. Hence, the transition kernels are dependent on the…

Probability · Mathematics 2021-05-21 Aleksandr Shchegolev

This paper focuses on time-varying delayed stochastic differential systems with stochastically switching parameters formulated by a unified switching behavior combining a discrete adapted process and a Cox process. Unlike prior studies…

Dynamical Systems · Mathematics 2024-01-30 Xinyu Wu , Zidong Wang , Wenlian Lu

Rate processes are simple and analytically tractable models for many dynamical systems which switch stochastically between a discrete set of quasi stationary states but they may also approximate continuous processes by coarse grained,…

Statistical Mechanics · Physics 2013-03-11 R. Toenjes , H. Kori

When the initial and transition probabilities of a finite Markov chain in discrete time are not well known, we should perform a sensitivity analysis. This can be done by considering as basic uncertainty models the so-called credal sets that…

Probability · Mathematics 2009-11-24 Gert de Cooman , Filip Hermans , Erik Quaeghebeur

We observe n possibly dependent random variables, the distribution of which is presumed to be stationary even though this might not be true, and we aim at estimating the stationary distribution. We establish a non-asymptotic deviation bound…

Statistics Theory · Mathematics 2023-07-10 Alexandre Lecestre

We investigate the parameter recovery of Markov-switching ordinary differential processes from discrete observations, where the differential equations are nonlinear additive models. This framework has been widely applied in biological…

Methodology · Statistics 2025-01-03 Katherine Tsai , Mladen Kolar , Sanmi Koyejo

We consider continuous-space, discrete-time Markov chains on $\mathbb{R}^d$, that admit a finite number $N$ of metastable states. Our main motivation for investigating these processes is to analyse random Poincar\'e maps, which describe…

Probability · Mathematics 2025-08-19 Nils Berglund

We investigate the stability of quantum Markov processes with respect to perturbations of their transition maps. In the first part, we introduce a condition number that measures the sensitivity of fixed points of a quantum channel to…

Mathematical Physics · Physics 2013-03-25 Oleg Szehr , Michael M. Wolf

We study a variable length Markov chain model associated with a group of stationary processes that share the same context tree but each process has potentially different conditional probabilities. We propose a new model selection and…

Methodology · Statistics 2016-01-01 Alexandre Belloni , Roberto I. Oliveira

This paper deals with a unifying approach to the problems of computing the admissible sets of parametrical multi perturbations in appropriate bounded sets such that some fundamental properties of parameter-varying linear dynamic systems are…

Optimization and Control · Mathematics 2008-03-28 M. De la Sen

We study a limit behavior of a sequence of Markov processes (or Markov chains) such that their distributions outside of any neighborhood of a "singular" point attract to some probability law. In any neighborhood of this point the behavior…

Probability · Mathematics 2015-09-14 Andrey Pilipenko , Yuriy Prykhodko

We examine reaction networks (CRNs) through their associated continuous-time Markov processes. Studying the dynamics of such networks is in general hard, both analytically and by simulation. In particular, stationary distributions of…

Probability · Mathematics 2022-03-28 Linard Hoessly

We study discrete time Markov processes with periodic or open boundary conditions and with inhomogeneous rates in the bulk. The Markov matrices are given by the inhomogeneous transfer matrices introduced previously to prove the…

Statistical Mechanics · Physics 2015-10-30 N. Crampe , K. Mallick , E. Ragoucy , M. Vanicat

We consider the filtering of continuous-time finite-state hidden Markov models, where the rate and observation matrices depend on unknown time-dependent parameters, for which no prior or stochastic model is available. We quantify and…

Probability · Mathematics 2021-03-17 Andrew L. Allan

Let $P$ be a Markov kernel on a measurable space $\X$ and let $V:\X\r[1,+\infty)$. This paper provides explicit connections between the $V$-geometric ergodicity of $P$ and that of finite-rank nonnegative sub-Markov kernels $\Pc_k$…

Probability · Mathematics 2014-01-24 Loïc Hervé , James Ledoux