English
Related papers

Related papers: Bernstein's inequalities for general Markov chains

200 papers

We provide a simple, general argument to obtain improvements of concentration-type inequalities starting from improvements of their corresponding isoperimetric-type inequalities. We apply this argument to obtain robust improvements of the…

Optimization and Control · Mathematics 2015-07-14 Eric A. Carlen , Francesco Maggi

We study functional inequalities (Poincar\'e, Cheeger, log-Sobolev) for probability measures obtained as perturbations. Several explicit results for general measures as well as log-concave distributions are given.The initial goal of this…

Probability · Mathematics 2021-01-28 Patrick Cattiaux , Arnaud Guillin

Equivariant neural networks play a pivotal role in analyzing datasets with symmetry properties, particularly in complex data structures. However, integrating equivariance with Markov properties presents notable challenges due to the…

Machine Learning · Statistics 2025-03-04 Hui Li , Zhiguo Wang , Bohui Chen , Li Sheng

We study some regularity properties in locally stationary Markov models which are fundamental for controlling the bias of nonparametric kernel estimators. In particular, we provide an alternative to the standard notion of derivative process…

Statistics Theory · Mathematics 2018-12-07 Lionel Truquet

The major contributions of this paper lie in two aspects. Firstly, we focus on deriving Bernstein-type inequalities for both geometric and algebraic irregularly-spaced NED random fields, which contain time series as special case.…

Statistics Theory · Mathematics 2025-03-20 Zihao Yuan , Martin Spindler

Markov chain Monte Carlo algorithms are invaluable tools for exploring stationary properties of physical systems, especially in situations where direct sampling is unfeasible. Common implementations of Monte Carlo algorithms employ…

Statistical Mechanics · Physics 2016-04-27 Marija Vucelja

When the initial and transition probabilities of a finite Markov chain in discrete time are not well known, we should perform a sensitivity analysis. This is done by considering as basic uncertainty models the so-called credal sets that…

Artificial Intelligence · Computer Science 2014-08-12 Gert de Cooman , Filip Hermans , Erik Quaeghebeur

Let $\{Y_i\}_{i=1}^{\infty}$ be a stationary reversible Markov chain with state space $[N]$, let $(X, \| \cdot \|)$ be a real-valued Banach space and let $f_1, \ldots, f_n: [N] \rightarrow X$ be functions with mean $0$ such that $\|f_i(v)\|…

Probability · Mathematics 2026-03-02 Shravas Rao

We investigate the statistical complexity of estimating the parameters of a discrete-state Markov chain kernel from a single long sequence of state observations. In the finite case, we characterize (modulo logarithmic factors) the minimax…

Machine Learning · Statistics 2020-08-14 Geoffrey Wolfer , Aryeh Kontorovich

We study normal approximations for a class of discrete-time occupancy processes, namely, Markov chains with transition kernels of product Bernoulli form. This class encompasses numerous models which appear in the complex networks…

Probability · Mathematics 2018-11-13 Liam Hodgkinson , Ross McVinish , Philip K. Pollett

Devoted to multi-task learning and structured output learning, operator-valued kernels provide a flexible tool to build vector-valued functions in the context of Reproducing Kernel Hilbert Spaces. To scale up these methods, we extend the…

Machine Learning · Computer Science 2018-05-25 Romain Brault , Florence d'Alché-Buc , Markus Heinonen

We propose a model of random walks on weighted graphs where the weights are interval valued, and connect it to reversible imprecise Markov chains. While the theory of imprecise Markov chains is now well established, this is a first attempt…

Optimization and Control · Mathematics 2016-09-20 Damjan Škulj

In this article we give some improvements and generalizations of the famous Jensen's and Jensen-Mercer inequalities for twice differentiable functions, where convexity property of the target function is not assumed in advance. They…

Classical Analysis and ODEs · Mathematics 2020-11-24 Slavko Simic

The Markov Chain Monte Carlo method is the dominant paradigm for posterior computation in Bayesian analysis. It is common to control computation time by making approximations to the Markov transition kernel. Comparatively little attention…

Computation · Statistics 2017-08-30 James E. Johndrow , Jonathan C. Mattingly , Sayan Mukherjee , David Dunson

Given a unichain Markov reward process (MRP), we provide an explicit expression for the bias values in terms of mean first passage times. This result implies a generalization of known Markov chain perturbation bounds for the stationary…

Probability · Mathematics 2024-08-09 Ronald Ortner

Classical parameter-space Bayesian inference for Bayesian neural networks (BNNs) suffers from several unresolved prior issues, such as knowledge encoding intractability and pathological behaviours in deep networks, which can lead to…

Machine Learning · Computer Science 2024-10-11 Mengjing Wu , Junyu Xuan , Jie Lu

We prove a new inequality controlling the large deviations of the empirical measure of a Markov chain. This inequality is based on the martingale used by Donsker and Varadhan and the minimax theorem. It holds for convex sets and it requires…

Probability · Mathematics 2022-11-10 Raphaël Cerf

We consider a simple but important class of metastable discrete time Markov chains, which we call perturbed Markov chains. Basically, we assume that the transition matrices depend on a parameter $\varepsilon$, and converge as $\varepsilon$.…

Probability · Mathematics 2014-12-23 Volker Betz , Stéphane Le Roux

We study concave trace functions of several operator variables and formulate and prove multivariate generalisations of the Golden-Thompson inequality. The obtained results imply that certain functionals in quantum statistical mechanics have…

Mathematical Physics · Physics 2015-08-06 Frank Hansen

Markov chain Monte Carlo algorithms play a key role in the Bayesian approach to phylogenetic inference. In this paper, we present the first theoretical work analyzing the rate of convergence of several Markov chains widely used in…

Populations and Evolution · Quantitative Biology 2007-05-23 Elchanan Mossel , Eric Vigoda