English
Related papers

Related papers: Bernstein-type dimension-free concentration for se…

200 papers

We study the regret minimization problem in the novel setting of generalized kernelized bandits (GKBs), where we optimize an unknown function $f^*$ belonging to a reproducing kernel Hilbert space (RKHS) having access to samples generated by…

Machine Learning · Computer Science 2025-12-12 Alberto Maria Metelli , Simone Drago , Marco Mussi

We give a distribution-dependent concentration inequality for functions of independent variables. The result extends Bernstein's inequality from sums to more general functions, whose variation in any argument does not depend too much on the…

Probability · Mathematics 2017-05-12 Andreas Maurer

We prove a Bernstein inequality for vector-valued self-normalized martingales. We first give an alternative perspective of the corresponding sub-Gaussian bound due to Abbasi-Yadkori et al. via a PAC-Bayesian argument with Gaussian priors.…

Probability · Mathematics 2025-01-07 Ingvar Ziemann

The generalized linear bandit framework has attracted a lot of attention in recent years by extending the well-understood linear setting and allowing to model richer reward structures. It notably covers the logistic model, widely used when…

Machine Learning · Computer Science 2020-06-09 Louis Faury , Marc Abeille , Clément Calauzènes , Olivier Fercoq

This work prepares new probability bounds for sums of random, independent, Hermitian tensors. These probability bounds characterize large-deviation behavior of the extreme eigenvalue of the sums of random tensors. We extend Lapalace…

Probability · Mathematics 2021-01-01 Shih Yu Chang

We present new algorithms for online convex optimization over unbounded domains that obtain parameter-free regret in high-probability given access only to potentially heavy-tailed subgradient estimates. Previous work in unbounded domains…

Machine Learning · Statistics 2023-02-28 Jiujia Zhang , Ashok Cutkosky

Freedman's inequality is a martingale counterpart to Bernstein's inequality. This result shows that the large-deviation behavior of a martingale is controlled by the predictable quadratic variation and a uniform upper bound for the…

Probability · Mathematics 2015-03-17 Joel A. Tropp

The analysis of extremal dependence in high dimensions has recently attracted considerable interest. Existing methodology primarily focuses on modeling and estimation of extremal dependence structures, often supported by concentration…

Statistics Theory · Mathematics 2026-04-02 Axel Bücher , Yeonjoon Choi , Katharina Effertz , Stanislav Volgushev

This paper studies semiparametric contextual bandits, a generalization of the linear stochastic bandit problem where the reward for an action is modeled as a linear function of known action features confounded by an non-linear…

Machine Learning · Statistics 2018-07-17 Akshay Krishnamurthy , Zhiwei Steven Wu , Vasilis Syrgkanis

In this paper, we obtain quantitative, non-asymptotic, and data-dependent \textit{Bernstein-von Mises type} bounds on the normal approximation of the posterior distribution in exponential family models with arbitrary centring and scaling.…

Statistics Theory · Mathematics 2025-01-14 Adrian Fischer , Robert E. Gaunt , Gesine Reinert , Yvik Swan

Employing the framework of regular variation, we propose two decompositions which help to summarize and describel high-dimensional tail dependence. Via transformation, we define a vector space on the positive orthant, yielding the notion of…

Methodology · Statistics 2018-04-27 Daniel Cooley , Emeric Thibaud

We propose a variational tail bound for norms of random vectors under moment assumptions on their one-dimensional marginals. A simplified version of the bound that parametrizes the ``aggregating distribution'' using a certain pushforward of…

Probability · Mathematics 2026-02-02 Sohail Bahmani

We present deviation bounds for self-normalized averages and applications to estimation with a random number of observations. The results rely on a peeling argument in exponential martingale techniques that represents an alternative to the…

Statistics Theory · Mathematics 2016-11-17 Aurélien Garivier

We consider the problem of adaptive estimation of the regression function in a framework where we replace ergodicity assumptions (such as independence or mixing) by another structural assumption on the model. Namely, we propose adaptive…

Statistics Theory · Mathematics 2010-11-03 Sylvain Delattre , Stéphane Gaïffas

We present novel martingale concentration inequalities for martingale differences with finite Orlicz-$\psi_\alpha$ norms. Such martingale differences with weak exponential-type tails scatters in many statistical applications and can be…

Probability · Mathematics 2020-03-19 Chris Junchi Li

We describe and analyze a class of positive recurrent reflected Brownian motions (RBMs) in $\mathbb{R}^d_+$ for which local statistics converge to equilibrium at a rate independent of the dimension $d$. Under suitable assumptions on the…

Probability · Mathematics 2022-03-23 Sayan Banerjee , Brendan Brown

We obtain a Bernstein-type inequality for sums of Banach-valued random variables satisfying a weak dependence assumption of general type and under certain smoothness assumptions of the underlying Banach norm. We use this inequality in order…

Machine Learning · Statistics 2018-12-11 Gilles Blanchard , Oleksandr Zadorozhnyi

We consider the stochastic integrals of multivariate point processes and study their concentration phenomena. In particular, we obtain a Bernstein type of concentration inequality through Dol\'eans-Dade exponential formula and a uniform…

Probability · Mathematics 2017-03-24 Hanchao Wang , Zhengyan Lin , Zhonggen Su

We obtain an uniform tail estimates for natural normed sums of independent random variables (r.v.) with regular varying tails of distributions. We give also many examples on order to show the exactness of offered estimates and discuss some…

Probability · Mathematics 2012-06-22 E. Ostrovsky , L. Sirota

The major contributions of this paper lie in two aspects. Firstly, we focus on deriving Bernstein-type inequalities for both geometric and algebraic irregularly-spaced NED random fields, which contain time series as special case.…

Statistics Theory · Mathematics 2025-03-20 Zihao Yuan , Martin Spindler