English
Related papers

Related papers: Distribution-dependent concentration inequalities …

200 papers

Diffusion models are powerful generative models that produce high-quality samples from complex data. While their infinite-data behavior is well understood, their generalization with finite data remains less clear. Classical learning theory…

Machine Learning · Statistics 2026-02-02 Claudia Merger , Sebastian Goldt

We derive tight and computable bounds on the bias of statistical estimators, or more generally of quantities of interest, when evaluated on a baseline model P rather than on the typically unknown true model Q. Our proposed method combines…

Information Theory · Computer Science 2017-07-04 Konstantinos Gourgoulias , Markos A. Katsoulakis , Luc Rey-Bellet , Jie Wang

We show that the Bernstein-Hoeffding method can be employed to a larger class of generalized moments. This class includes the exponential moments whose properties play a key role in the proof of a well-known inequality of Wassily Hoeffding,…

Probability · Mathematics 2015-09-02 Christos Pelekis , Jan Ramon , Yuyi Wang

We explore the question whether Lipschitz functions of random variables under various forms of negative correlation satisfy concentration bounds similar to McDiarmid's inequality for independent random variables. We prove such a…

Probability · Mathematics 2018-04-27 Kevin Garbe , Jan Vondrak

Probabilistic graphical models compactly represent joint distributions by decomposing them into factors over subsets of random variables. In Bayesian networks, the factors are conditional probability distributions. For many problems, common…

Machine Learning · Computer Science 2018-08-21 Weirui Kong , Wenyi Wang

Estimates are constructed for the deviation of the concentration functions of sums of independent random variables with finite variances from the folded normal distribution function without any assumptions concerning the existence of the…

Probability · Mathematics 2016-08-11 V. Yu. Korolev , A. V. Dorofeeva

A problem of bounding the generalization error of a classifier f in H, where H is a "base" class of functions (classifiers), is considered. This problem frequently occurs in computer learning, where efficient algorithms of combining simple…

Probability · Mathematics 2007-06-13 Vladimir Koltchinskii , Dmitry Panchenko , Fernando Lozano

Learning from non-independent and non-identically distributed data poses a persistent challenge in statistical learning. In this study, we introduce data-dependent Bernstein inequalities tailored for vector-valued processes in Hilbert…

Machine Learning · Computer Science 2025-07-11 Erfan Mirzaei , Andreas Maurer , Vladimir R. Kostic , Massimiliano Pontil

We give a concentration inequality based on the premise that random variables take values within a particular region. The concentration inequality guarantees that, for any sequence of correlated random variables, the difference between the…

Probability · Mathematics 2020-02-21 Go Kato

High complexity models are notorious in machine learning for overfitting, a phenomenon in which models well represent data but fail to generalize an underlying data generating process. A typical procedure for circumventing overfitting…

Machine Learning · Statistics 2025-03-11 James Schmidt

Imitation learning holds the promise of equipping robots with versatile skills by learning from expert demonstrations. However, policies trained on finite datasets often struggle to generalize beyond the training distribution. In this work,…

Machine Learning · Computer Science 2025-04-28 Yixiao Wang

The push-forward operation enables one to redistribute a probability measure through a deterministic map. It plays a key role in statistics and optimization: many learning problems (notably from optimal transport, generative modeling, and…

Machine Learning · Statistics 2025-05-19 Lucas de Lara , Mathis Deronzier , Alberto González-Sanz , Virgile Foy

Stochastic Gradient Descent (SGD) based methods have been widely used for training large-scale machine learning models that also generalize well in practice. Several explanations have been offered for this generalization performance, a…

Machine Learning · Computer Science 2021-02-11 Yikai Zhang , Wenjia Zhang , Sammy Bald , Vamsi Pingali , Chao Chen , Mayank Goswami

We show generalisation error bounds for deep learning with two main improvements over the state of the art. (1) Our bounds have no explicit dependence on the number of classes except for logarithmic factors. This holds even when formulating…

Machine Learning · Computer Science 2021-02-23 Antoine Ledent , Waleed Mustafa , Yunwen Lei , Marius Kloft

Training of deep neural networks heavily depends on the data distribution. In particular, the networks easily suffer from class imbalance. The trained networks would recognize the frequent classes better than the infrequent classes. To…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Byungju Kim , Junmo Kim

The focal-loss has become a widely used alternative to cross-entropy in class-imbalanced classification problems, particularly in computer vision. Despite its empirical success, a systematic information-theoretic study of the focal-loss…

Information Theory · Computer Science 2026-03-04 Jaimin Shah , Martina Cardone , Alex Dytso

We show sharpened forms of the concentration of measure phenomenon centered at first order stochastic expansions. The bound are based on second order difference operators and second order derivatives. Applications to functions on the…

Probability · Mathematics 2019-11-22 Friedrich Götze , Holger Sambale

We prove concentration inequalities for general functions of weakly dependent random variables satisfying the Dobrushin condition. In particular, we show Talagrand's convex distance inequality for this type of dependence. We apply our…

Probability · Mathematics 2014-09-02 Daniel Paulin

Cooperation information sharing is important to theories of human learning and has potential implications for machine learning. Prior work derived conditions for achieving optimal Cooperative Inference given strong, relatively restrictive…

Machine Learning · Computer Science 2019-02-15 Pei Wang , Pushpi Paranamana , Patrick Shafto

Despite remarkable success in a variety of applications, it is well-known that deep learning can fail catastrophically when presented with out-of-distribution data. Toward addressing this challenge, we consider the domain generalization…

Machine Learning · Statistics 2021-11-16 Alexander Robey , George J. Pappas , Hamed Hassani