English
Related papers

Related papers: Measure Concentration of Markov Tree Processes

200 papers

A widely studied model for generating sequences is to ``evolve'' them on a tree according to a symmetric Markov process. We prove that model trees tend to be maximally ``far apart'' in terms of variational distance.

Probability · Mathematics 2016-08-16 M. A. Steel , L. A. Székely

This paper is concerned with the development of rigorous approximations to various expectations associated with Markov chains and processes having non-stationary transition probabilities. Such non-stationary models arise naturally in…

Probability · Mathematics 2018-05-07 Zeyu Zheng , Harsha Honnappa , Peter W. Glynn

In this paper, we study the problem of estimating the autocovariance sequence resulting from a reversible Markov chain. A motivating application for studying this problem is the estimation of the asymptotic variance in central limit…

Methodology · Statistics 2023-11-13 Stephen Berg , Hyebin Song

We prove a Chernoff-type bound for sums of matrix-valued random variables sampled via a regular (aperiodic and irreducible) finite Markov chain. Specially, consider a random walk on a regular Markov chain and a Hermitian matrix-valued…

Machine Learning · Statistics 2020-10-30 Jiezhong Qiu , Chi Wang , Ben Liao , Richard Peng , Jie Tang

We give Hoeffding and Bernstein-type concentration inequalities for the largest eigenvalue of sums of random matrices arising from a Markov chain. We consider time-dependent matrix-valued functions on a general state space, generalizing…

Probability · Mathematics 2025-07-01 Joe Neeman , Bobby Shi , Rachel Ward

We introduce a statistical mechanics formalism for the study of constrained graph evolution as a Markovian stochastic process, in analogy with that available for spin systems, deriving its basic properties and highlighting the role of the…

Disordered Systems and Neural Networks · Physics 2015-05-13 A. C. C. Coolen , A. De Martino , A. Annibale

The aim of this note is to construct a probability measure on the space of trajectories in a continuous time Markov chain having a finite state diagram, or more generally which admits a global bound on its degree and rates. Our approach is…

Probability · Mathematics 2021-05-25 Michael J. Catanzaro , Vladimir Y. Chernyak , John R. Klein

We consider the monomer-dimer model on sequences of random graphs locally convergent to trees. We prove that the monomer density converges almost surely, in the thermodynamic limit, to an analytic function of the monomer activity. We…

Mathematical Physics · Physics 2015-06-15 Diego Alberici , Pierluigi Contucci

This paper introduces \textit{measurement trees}, a novel class of metrics designed to combine various constructs into an interpretable multi-level representation of a measurand. Unlike conventional metrics that yield single values,…

Artificial Intelligence · Computer Science 2025-10-01 Craig Greenberg , Patrick Hall , Theodore Jensen , Kristen Greene , Razvan Amironesei

For many Markov chains of practical interest, the invariant distribution is extremely sensitive to perturbations of some entries of the transition matrix, but insensitive to others; we give an example of such a chain, motivated by a problem…

Numerical Analysis · Mathematics 2015-10-12 Erik Thiede , Brian Van Koten , Jonathan Weare

Perturbation theory for Markov chains addresses the question how small differences in the transitions of Markov chains are reflected in differences between their distributions. We prove powerful and flexible bounds on the distance of the…

Computation · Statistics 2017-02-27 Daniel Rudolf , Nikolaus Schweizer

In this paper we introduce some recent progresses on the convergence rate in Wasserstein distance for empirical measures of Markov processes. For diffusion processes on compact manifolds possibly with reflecting or killing boundary…

Probability · Mathematics 2025-07-22 Feng-Yu Wang

We present two data-driven procedures to estimate the transition density of an homogeneous Markov chain. The first yields to a piecewise constant estimator on a suitable random partition. By using an Hellinger-type loss, we establish…

Statistics Theory · Mathematics 2012-10-19 Mathieu Sart

Markov chain Monte Carlo (MCMC) is the engine of modern Bayesian statistics, being used to approximate the posterior and derived quantities of interest. Despite this, the issue of how the output from a Markov chain is post-processed and…

Methodology · Statistics 2021-09-07 Leah F. South , Marina Riabiz , Onur Teymur , Chris. J. Oates

Ordinary differential equations obtained as limits of Markov processes appear in many settings. They may arise by scaling large systems, or by averaging rapidly fluctuating systems, or in systems involving multiple time-scales, by a…

Probability · Mathematics 2014-03-24 Hye-Won Kang , Thomas G. Kurtz , Lea Popovic

We establish an abstract, effective, exponential large deviations type estimate for Markov systems satisfying a weaker form of mixing. We employ this result to derive such estimates, as well as a central limit theorem, for the skew product…

Dynamical Systems · Mathematics 2025-07-17 Ao Cai , Pedro Duarte , Silvius Klein

We introduce a new framework that yields spectral bounds on norms of functions of transition maps for finite, homogeneous Markov chains. The techniques employed work for bounded semigroups, in particular for classical as well as for quantum…

Mathematical Physics · Physics 2015-03-16 Oleg Szehr , David Reeb , Michael M. Wolf

The modeling of natural phenomena via a Markov process --- a process for which the future is independent of the past, given the present--- is ubiquitous in many fields of science. Within this context, it is of foremost importance to develop…

Quantum Physics · Physics 2020-03-24 Matheus Capela , Lucas C. Céleri , Kavan Modi , Rafael Chaves

We give a concise self-contained presentation of known and new limit theorems for the one-type Markov branching processes with continuous time. The new streamlined proofs are based on what we call, the tail generating function approach. Our…

Probability · Mathematics 2014-10-07 Serik Sagitov

In the paper we study continuous time controlled Markov processes using discrete time controlled Markov processes. We consider long run functionals: average reward per unit time or long run risk sensitive functional. We also investigate…

Optimization and Control · Mathematics 2025-08-12 Lukasz Stettner