English
Related papers

Related papers: Bernstein's inequalities for general Markov chains

200 papers

We study the large deviations of Markov chains under the sole assumption that the state space is discrete. In particular, we do not require any of the usual irreducibility and exponential tightness assumptions. Using subadditive arguments,…

Probability · Mathematics 2026-05-15 Léo Daures

We obtain strong converse inequalities for the Bernstein operators with explicit constants. One of the main ingredients in our approach is the representation of the derivatives of the Bernstein operators in terms of the orthogonal…

Classical Analysis and ODEs · Mathematics 2023-11-21 José A. Adell , Daniel Cárdenas-Morales

In this paper we study nonconvex penalization using Bernstein functions whose first-order derivatives are completely monotone. The Bernstein function can induce a class of nonconvex penalty functions for high-dimensional sparse estimation…

Machine Learning · Statistics 2015-10-30 Zhihua Zhang

The main purpose of this article is to establish moderate deviation principles for additive functionals of bifurcating Markov chains. Bifurcating Markov chains are a class of processes which are indexed by a regular binary tree. They can be…

Probability · Mathematics 2021-05-21 S. Valère Bitseki Penda , Gorgui Gackou

We investigate how basic probability inequalities can be extended to an imprecise framework, where (precise) probabilities and expectations are replaced by imprecise probabilities and lower/upper previsions. We focus on inequalities giving…

Probability · Mathematics 2022-11-04 Renato Pelessoni , Paolo Vicig

Generalised Bayesian inference updates prior beliefs using a loss function, rather than a likelihood, and can therefore be used to confer robustness against possible mis-specification of the likelihood. Here we consider generalised Bayesian…

Methodology · Statistics 2022-01-12 Takuo Matsubara , Jeremias Knoblauch , François-Xavier Briol , Chris. J. Oates

We provide a sharp nonasymptotic analysis of the rates of convergence for some standard multivariate Markov chains using spectral techniques. All chains under consideration have multivariate orthogonal polynomial as eigenfunctions. Our…

Probability · Mathematics 2009-06-24 Kshitij Khare , Hua Zhou

We present an elementary proof of a conjecture by I. Ra\c{s}a which is an inequality involving Bernstein basis polynomials and convex functions. It was affirmed in positive very recently by the use of stochastic convex orderings. Moreover,…

Classical Analysis and ODEs · Mathematics 2016-09-02 Ulrich Abel

We establish a Bernstein-type inequality for a class of stochastic processes that include the classical geometrically $\phi$-mixing processes, Rio's generalization of these processes, as well as many time-discrete dynamical systems. Modulo…

Probability · Mathematics 2015-01-14 H. Hang , I. Steinwart

We consider the stochastic integrals of multivariate point processes and study their concentration phenomena. In particular, we obtain a Bernstein type of concentration inequality through Dol\'eans-Dade exponential formula and a uniform…

Probability · Mathematics 2017-03-24 Hanchao Wang , Zhengyan Lin , Zhonggen Su

This paper investigates the supervised learning problem with observations drawn from certain general stationary stochastic processes. Here by \emph{general}, we mean that many stationary stochastic processes can be included. We show that…

Machine Learning · Statistics 2016-05-11 Hanyuan Hang , Yunlong Feng , Ingo Steinwart , Johan A. K. Suykens

We present a short proof of a conjecture proposed by I. Ra\c{s}a (2017), which is an inequality involving basic Bernstein polynomials and convex functions. This proof was given in the letter to I. Ra\c{s}a (2017). The methods of our proof…

Classical Analysis and ODEs · Mathematics 2018-01-09 Andrzej Komisarski , Teresa Rajba

There is a well-established theory linking certain semi-Markov chains and continuous-time random walks to time-fractional equations and anomalous diffusion. In this work, we go beyond the semi-Markov framework by considering some…

Probability · Mathematics 2026-02-27 Lorenzo Facciaroni , Costantino Ricciuti , Enrico Scalas

It is proved that the limit of the normalized rate-distortion functions of block independent approximations of an irreducible, aperiodic Markoff chain is independent of the initial distribution of the Markoff chain and thus, is also equal…

Information Theory · Computer Science 2018-03-28 Mukul Agarwal

In this paper, we first introduce and define several new information divergences in the space of transition matrices of finite Markov chains which measure the discrepancy between two Markov chains. These divergences offer natural…

Information Theory · Computer Science 2023-12-11 Youjia Wang , Michael C. H. Choi

Stochastic gradient methods are the workhorse (algorithms) of large-scale optimization problems in machine learning, signal processing, and other computational sciences and engineering. This paper studies Markov chain gradient descent, a…

Optimization and Control · Mathematics 2018-09-13 Tao Sun , Yuejiao Sun , Wotao Yin

We consider a class of non-homogeneous Markov chains, that contains many natural examples. Next, using martingale methods, we establish some deviation and moment inequalities for separately Lipschitz functions of such a chain, under moment…

Probability · Mathematics 2019-09-11 Jérôme Dedecker , Paul Doukhan , Xiequan Fan

In Monte-Carlo methods the Markov processes used to sample a given target distribution usually satisfy detailed balance, i.e. they are time-reversible. However, relatively recent results have demonstrated that appropriate reversible and…

Probability · Mathematics 2016-06-29 Luc Rey-Bellet , Konstantinos Spiliopoulos

We extend the classical Bernstein inequality to a general setting including Schr{\"o}dinger operators and divergence form elliptic operators on Riemannian manifolds or domains. Moreover , we prove a new reverse inequality that can be seen…

Analysis of PDEs · Mathematics 2021-06-11 Rafik Imekraz , El Maati Ouhabaz

We prove a version of McDiarmid's bounded differences inequality for Markov chains, with constants proportional to the mixing time of the chain. We also show variance bounds and Bernstein-type inequalities for empirical averages of Markov…

Probability · Mathematics 2018-11-14 Daniel Paulin