English
Related papers

Related papers: Statistical properties for mixing Markov chains wi…

200 papers

This paper introduces a concept of approximate spectral gap to analyze the mixing time of Markov Chain Monte Carlo (MCMC) algorithms for which the usual spectral gap is degenerate or almost degenerate. We use the idea to analyze a class of…

Computation · Statistics 2019-08-26 Yves F. Atchadé

Filtering is concerned with the sequential estimation of the state, and uncertainties, of a Markovian system, given noisy observations. It is particularly difficult to achieve accurate filtering in complex dynamical systems, such as those…

Probability · Mathematics 2015-12-14 Wonjung Lee , Andrew Stuart

The basic question in perturbation analysis of Markov chains is: how do small changes in the transition kernels of Markov chains translate to chains in their stationary distributions? Many papers on the subject have shown, roughly, that the…

Probability · Mathematics 2025-08-13 Na Lin , Yuanyuan Liu , Aaron Smith

Markov chain Monte Carlo (MCMC) is a powerful tool for sampling from complex probability distributions. Despite its versatility, MCMC often suffers from strong autocorrelation and the negative sign problem, leading to slowing down the…

Statistical Mechanics · Physics 2024-12-05 Synge Todo

The paper is a sketch of systematic presentation of distributional limit theorems and their refinements for compound sums. When analyzing, e.g., ergodic semi-Markov systems with discrete or continuous time, this allows us to separate those…

Probability · Mathematics 2024-04-29 Vsevolod K. Malinovskii

The mixed effects model for repeated measures (MMRM) has been widely used for the analysis of longitudinal clinical data collected at a number of fixed time points. We propose a robust extension of the MMRM for skewed and heavy-tailed data…

Methodology · Statistics 2019-08-12 Yongqiang Tang

Adaptive and interacting Markov chain Monte Carlo algorithms (MCMC) have been recently introduced in the literature. These novel simulation algorithms are designed to increase the simulation efficiency to sample complex distributions.…

Statistics Theory · Mathematics 2012-03-15 G. Fort , E. Moulines , P. Priouret

An asymptotic model for extreme behavior of certain Markov chains is the "tail chain". Generally taking the form of a multiplicative random walk, it is useful in deriving extremal characteristics such as point process limits. We place this…

Probability · Mathematics 2011-12-30 Sidney I. Resnick , David Zeber

In this work, we characterise the statistics of Markov chains by constructing an associated sequence of periodic differential operators. Studying the density of states of these operators reveals the absolutely continuous invariant measure…

Dynamical Systems · Mathematics 2025-09-22 Bryn Davies , Angelica Yu Xiao

Markov Population Models are a widespread formalism used to model the dynamics of complex systems, with applications in Systems Biology and many other fields. The associated Markov stochastic process in continuous time is often analyzed by…

Machine Learning · Computer Science 2021-06-25 Francesca Cairoli , Ginevra Carbone , Luca Bortolussi

The article is devoted to the estimation of the rate of convergence of integral functionals of a Markov process. Under the assumption that the given Markov process admits a transition probability density which is differentiable in $t$ and…

Probability · Mathematics 2015-08-03 I. Ganychenko , V. Knopova , A. Kulik

We study a recently introduced gradient-based Markov chain Monte Carlo method based on 'Barker dynamics'. We provide a full derivation of the method from first principles, placing it within a wider class of continuous-time Markov jump…

Computation · Statistics 2021-09-03 Max Hird , Samuel Livingstone , Giacomo Zanella

Identifying coherent flow structures in chemical reactors is crucial for understanding the mixing dynamics, which is essential for optimizing reactor performance. We demonstrate the use of a transfer operator method to find coherent flow…

We formulate some simple conditions under which a Markov chain may be approximated by the solution to a differential equation, with quantifiable error probabilities. The role of a choice of coordinate functions for the Markov chain is…

Probability · Mathematics 2008-04-23 R. W. R. Darling , J. R. Norris

Markov chain Monte Carlo (MCMC) methods asymptotically sample from complex probability distributions. The pseudo-marginal MCMC framework only requires an unbiased estimator of the unnormalized probability distribution function to construct…

Computation · Statistics 2016-05-25 Iain Murray , Matthew M. Graham

We consider a family of measure preserving transformations, which act on a common probability space and are chosen at random by a stationary ergodic Markov chain. This setting defines an instance of a random dynamical system (RDS), which…

Dynamical Systems · Mathematics 2024-02-27 Pablo Lummerzheim , Felix Pogorzelski , Elias Zimmermann

In order to give quantitative estimates for approximating the ergodic limit, we investigate probabilistic limit behaviors of time-averaging estimators of numerical discretizations for a class of time-homogeneous Markov processes, by…

Probability · Mathematics 2023-10-13 Chuchu Chen , Tonghe Dang , Jialin Hong , Guoting Song

We study weak convergence of empirical processes of dependent data $(X_i)_{i\geq0}$, indexed by classes of functions. Our results are especially suitable for data arising from dynamical systems and Markov chains, where the central limit…

Probability · Mathematics 2014-07-07 Herold Dehling , Olivier Durieu , Marco Tusche

In this paper, we study small noise asymptotics of Markov-modulated diffusion processes in the regime that the modulating Markov chain is rapidly switching. We prove the joint sample-path large deviations principle for the Markov-modulated…

Probability · Mathematics 2023-02-27 Gang Huang , Michel Mandjes , Peter Spreij

We consider generalized definitions of mixing and exactness for random dynamical systems in terms of Markov operator cocycles. We first give six fundamental definitions of mixing for Markov operator cocycles in view of observations of the…

Dynamical Systems · Mathematics 2022-03-30 Fumihiko Nakamura , Yushi Nakano , Hisayoshi Toyokawa