English
Related papers

Related papers: Split-kl and PAC-Bayes-split-kl Inequalities for T…

200 papers

Bell inequalities are mathematical constructs that demarcate the boundary between quantum and classical physics. A new class of multiplicative Bell inequalities originating from a volume maximization game (based on products of correlators…

Count outcomes in longitudinal studies are frequent in clinical and engineering studies. In frequentist and Bayesian statistical analysis, methods such as Mixed linear models allow the variability or correlation within individuals to be…

Methodology · Statistics 2024-07-15 Alejandra Estefanía Patiño Hoyos , Johnatan Cardona Jiménez

In this article we present a Bernstein inequality for sums of random variables which are defined on a spatial lattice structure. The inequality can be used to derive concentration inequalities. It can be useful to obtain consistency…

Statistics Theory · Mathematics 2017-12-06 Eduardo Valenzuela-Domínguez , Johannes T. N. Krebs , Jürgen E. Franke

We consider the three dimensional array $\mathcal{A} = \{a_{i,j,k}\}_{1\le i,j,k \le n}$, with $a_{i,j,k} \in [0,1]$, and the two random statistics $T_{1}:= \sum_{i=1}^n \sum_{j=1}^n a_{i,j,\sigma(i)}$ and $T_{2}:= \sum_{i=1}^{n}…

Probability · Mathematics 2020-03-13 Debapratim Banerjee , Matteo Sordello

Concentration results and probabilistic analysis for combinatorial problems like the TSP, MWST, graph coloring have received much attention, but generally, for i.i.d. samples (i.i.d. points in the unit square for the TSP, for example).…

Probability · Mathematics 2010-05-24 Ravindran Kannan

An infinite urn scheme is defined by a probability mass function $(p_j)_{j\geq1}$ over positive integers. A random allocation consists of a sample of $N$ independent drawings according to this probability distribution where $N$ may be…

Statistics Theory · Mathematics 2016-09-29 Anna Ben-Hamou , Stéphane Boucheron , Mesrob I. Ohannessian

This paper studies offline policy learning, which aims at utilizing observations collected a priori (from either fixed or adaptively evolving behavior policies) to learn an optimal individualized decision rule that achieves the best overall…

Machine Learning · Computer Science 2025-06-06 Ying Jin , Zhimei Ren , Zhuoran Yang , Zhaoran Wang

We introduce a Bernstein-type inequality which serves to uniformly control quadratic forms of gaussian variables. The latter can for example be used to derive sharp model selection criteria for linear estimation in linear regression and…

Statistics Theory · Mathematics 2009-09-22 Ikhlef Bechar

Learning from non-independent and non-identically distributed data poses a persistent challenge in statistical learning. In this study, we introduce data-dependent Bernstein inequalities tailored for vector-valued processes in Hilbert…

Machine Learning · Computer Science 2025-07-11 Erfan Mirzaei , Andreas Maurer , Vladimir R. Kostic , Massimiliano Pontil

We explore quantum nonlocality in one of the simplest bipartite scenarios. Several new facet-defining Bell inequalities for the {[3 3 3] [3 3 3]} scenario are obtained with their quantum violations analyzed in details. Surprisingly, all…

Quantum Physics · Physics 2018-05-16 Sacha Schwarz , Bänz Bessire , André Stefanov , Yeong-Cherng Liang

We study a tight Bennett-type concentration inequality for sums of heterogeneous and independent variables, defined as a one-dimensional minimization. We show that this refinement, which outperforms the standard known bounds, remains…

Optimization and Control · Mathematics 2022-11-23 Quentin Jacquet , Riadh Zorgati

While Contrastive Learning (CL) has revolutionized self-supervised representation learning, its latent representations remain highly entangled and opaque, limiting their interpretability in safety-critical applications. We identify that a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Peng Cui , Jiahao Zhang , Lijie Hu

In this paper we obtain a Bernstein type inequality for the sum of self-adjoint centered and geometrically absolutely regular random matrices with bounded largest eigenvalue. This inequality can be viewed as an extension to the matrix…

Probability · Mathematics 2018-07-19 Marwa Banna , Florence Merlevède , Pierre Youssef

Self-normalized processes arise naturally in many learning-related tasks. While self-normalized concentration has been extensively studied for scalar-valued processes, there are few results for multidimensional processes outside of the…

Probability · Mathematics 2025-05-02 Justin Whitehouse , Zhiwei Steven Wu , Aaditya Ramdas

In this paper we obtain a Bernstein type inequality for a class of weakly dependent and bounded random variables. The proofs lead to a moderate deviations principle for sums of bounded random variables with exponential decay of the strong…

Probability · Mathematics 2012-02-23 Florence Merlevède , Magda Peligrad , Emmanuel Rio

We develop the concept of exponential stochastic inequality (ESI), a novel notation that simultaneously captures high-probability and in-expectation statements. It is especially well suited to succinctly state, prove, and reason about…

Statistics Theory · Mathematics 2023-04-28 Peter D. Grünwald , Muriel F. Pérez-Ortiz , Zakaria Mhammedi

In this paper we show that the weighted Bernstein-Walsh inequality in logarithmic potential theory is sharp up to some new universal constant, provided that the external field is given by a logarithmic potential. Our main tool for such…

Numerical Analysis · Mathematics 2017-07-26 Bernhard Beckermann , Thomas Helart

Aggregated predictors are obtained by making a set of basic predictors vote according to some weights, that is, to some probability distribution. Randomized predictors are obtained by sampling in a set of basic predictors, according to some…

Machine Learning · Statistics 2025-03-03 Pierre Alquier

We introduce a modified version of the excess risk, which can be used to obtain tighter, fast-rate PAC-Bayesian generalisation bounds. This modified excess risk leverages information about the relative hardness of data examples to reduce…

Machine Learning · Computer Science 2023-01-25 Felix Biggs , Benjamin Guedj

We present two alternative ways to apply PAC-Bayesian analysis to sequences of dependent random variables. The first is based on a new lemma that enables to bound expectations of convex functions of certain dependent random variables by…

Machine Learning · Computer Science 2011-05-20 Yevgeny Seldin , François Laviolette , John Shawe-Taylor , Jan Peters , Peter Auer