English
Related papers

Related papers: A Bernstein-type Inequality for Some Mixing Proces…

200 papers

This paper investigates the supervised learning problem with observations drawn from certain general stationary stochastic processes. Here by \emph{general}, we mean that many stationary stochastic processes can be included. We show that…

Machine Learning · Statistics 2016-05-11 Hanyuan Hang , Yunlong Feng , Ingo Steinwart , Johan A. K. Suykens

We introduce a Bernstein-type inequality which serves to uniformly control quadratic forms of gaussian variables. The latter can for example be used to derive sharp model selection criteria for linear estimation in linear regression and…

Statistics Theory · Mathematics 2009-09-22 Ikhlef Bechar

We consider the stochastic integrals of multivariate point processes and study their concentration phenomena. In particular, we obtain a Bernstein type of concentration inequality through Dol\'eans-Dade exponential formula and a uniform…

Probability · Mathematics 2017-03-24 Hanchao Wang , Zhengyan Lin , Zhonggen Su

We establish a new Bernstein-type deviation inequality for general (non-reversible) discrete-time Markov chains via an elementary approach. More robust than existing works in the literature, our result only requires the Markov chain to…

Probability · Mathematics 2025-10-07 De Huang , Xiangyuan Li

In this article we present a Bernstein inequality for sums of random variables which are defined on a spatial lattice structure. The inequality can be used to derive concentration inequalities. It can be useful to obtain consistency…

Statistics Theory · Mathematics 2017-12-06 Eduardo Valenzuela-Domínguez , Johannes T. N. Krebs , Jürgen E. Franke

Learning from non-independent and non-identically distributed data poses a persistent challenge in statistical learning. In this study, we introduce data-dependent Bernstein inequalities tailored for vector-valued processes in Hilbert…

Machine Learning · Computer Science 2025-07-11 Erfan Mirzaei , Andreas Maurer , Vladimir R. Kostic , Massimiliano Pontil

We obtain a Bernstein type Gaussian concentration inequality for martingales. Our inequality improves the Azuma-Hoeffding inequality for moderate deviations $x$. Following the work of McDiarmid (1989), Talagrand (1996) and Boucheron, Lugosi…

Probability · Mathematics 2017-10-17 Xiequan Fan

Many important dynamic systems, time series models or even algorithms exhibit non-strong mixing properties. In this paper, we introduce the general concept of $\mathcal{C}_{p,\mathcal{F}}$-mixing to cover such cases, where assumptions on…

Statistics Theory · Mathematics 2025-03-18 Zihao Yuan , Holger Dette

We extend the classical Bernstein inequality to a general setting including Schr{\"o}dinger operators and divergence form elliptic operators on Riemannian manifolds or domains. Moreover , we prove a new reverse inequality that can be seen…

Analysis of PDEs · Mathematics 2021-06-11 Rafik Imekraz , El Maati Ouhabaz

We prove optimal convergence results of a stochastic particle method for computing the classical solution of a multivariate McKean-Vlasov equation, when the measure variable is in the drift, following the classical approach of [BT97,…

Probability · Mathematics 2025-11-05 Marc Hoffmann , Yating Liu

We obtain a Bernstein-type inequality for sums of Banach-valued random variables satisfying a weak dependence assumption of general type and under certain smoothness assumptions of the underlying Banach norm. We use this inequality in order…

Machine Learning · Statistics 2018-12-11 Gilles Blanchard , Oleksandr Zadorozhnyi

Time series regression models are commonly used in time series analysis. However, in modern real-world applications, serially correlated data with an ultra-high dimension and fat tails are prevalent. This presents a challenge in developing…

Statistics Theory · Mathematics 2023-04-21 Linbo Liu , Danna Zhang

The major contributions of this paper lie in two aspects. Firstly, we focus on deriving Bernstein-type inequalities for both geometric and algebraic irregularly-spaced NED random fields, which contain time series as special case.…

Statistics Theory · Mathematics 2025-03-20 Zihao Yuan , Martin Spindler

We derive explicit Bernstein-type and Bennett-type concentration inequalities for matrix-valued martingale processes with unbounded observations from the Hermitian space $\mathbb{H}(d)$. Specifically, we assume that the…

Probability · Mathematics 2025-02-21 Alexey Kroshnin , Alexandra Suvorikova

Exponential inequalities are main tools in machine learning theory. To prove exponential inequalities for non i.i.d random variables allows to extend many learning techniques to these variables. Indeed, much work has been done both on…

Machine Learning · Statistics 2020-08-03 Pierre Alquier , Paul Doukhan , Xiequan Fan

We consider online learning algorithms that guarantee worst-case regret rates in adversarial environments (so they can be deployed safely and will perform robustly), yet adapt optimally to favorable stochastic environments (so they will…

Machine Learning · Computer Science 2021-08-31 Wouter M. Koolen , Peter Grünwald , Tim van Erven

In this paper we obtain a Bernstein type inequality for a class of weakly dependent and bounded random variables. The proofs lead to a moderate deviations principle for sums of bounded random variables with exponential decay of the strong…

Probability · Mathematics 2012-02-23 Florence Merlevède , Magda Peligrad , Emmanuel Rio

We give a distribution-dependent concentration inequality for functions of independent variables. The result extends Bernstein's inequality from sums to more general functions, whose variation in any argument does not depend too much on the…

Probability · Mathematics 2017-05-12 Andreas Maurer

We use the generic chaining device proposed by Talagrand to establish exponential bounds on the deviation probability of some suprema of random processes. Then, given a random vector $\xi$ in $\R^{n}$ the components of which are independent…

Statistics Theory · Mathematics 2009-04-22 Yannick Baraud

We consider the problem of statistical learning for the intensity of a counting process with covariates. In this context, we introduce an empirical risk, and prove risk bounds for the corresponding empirical risk minimizers. Then, we give…

Statistics Theory · Mathematics 2009-09-30 Stéphane Gaïffas , Agathe Guilloux
‹ Prev 1 2 3 10 Next ›