English
Related papers

Related papers: An Information-Theoretic Approach to Generalizatio…

200 papers

The success of denoising diffusion models raises important questions regarding their generalisation behaviour, particularly in high-dimensional settings. Notably, it has been shown that when training and sampling are performed perfectly,…

Machine Learning · Statistics 2025-07-08 Tyler Farghly , Patrick Rebeschini , George Deligiannidis , Arnaud Doucet

In this paper, we leverage stochastic projection and lossy compression to establish new conditional mutual information (CMI) bounds on the generalization error of statistical learning algorithms. It is shown that these bounds are generally…

Machine Learning · Statistics 2025-10-28 Milad Sefidgaran , Kimia Nadjahi , Abdellatif Zaidi

We focus on a stochastic learning model where the learner observes a finite set of training examples and the output of the learning process is a data-dependent distribution over a space of hypotheses. The learned data-dependent distribution…

Machine Learning · Statistics 2020-12-29 Omar Rivasplata , Ilja Kuzborskij , Csaba Szepesvari , John Shawe-Taylor

Providing generalization guarantees for stochastic optimization algorithms remains a key challenge in learning theory. Recently, numerous works demonstrated the impact of the geometric properties of optimization trajectories on…

Machine Learning · Computer Science 2026-01-23 Mario Tuci , Lennart Bastian , Benjamin Dupuis , Nassir Navab , Tolga Birdal , Umut Şimşekli

Quantum classification and hypothesis testing are two tightly related subjects, the main difference being that the former is data driven: how to assign to quantum states $\rho(x)$ the corresponding class $c$ (or hypothesis) is learnt from…

Quantum Physics · Physics 2021-11-30 Leonardo Banchi , Jason Pereira , Stefano Pirandola

In this paper, we investigate the question: Given a small number of datapoints, for example N = 30, how tight can PAC-Bayes and test set bounds be made? For such small datasets, test set bounds adversely affect generalisation performance by…

Machine Learning · Statistics 2022-01-14 Andrew Y. K. Foong , Wessel P. Bruinsma , David R. Burt , Richard E. Turner

We present data-dependent learning bounds for the general scenario of non-stationary non-mixing stochastic processes. Our learning guarantees are expressed in terms of a data-dependent measure of sequential complexity and a discrepancy…

Machine Learning · Computer Science 2018-03-16 Vitaly Kuznetsov , Mehryar Mohri

Many learning paradigms self-select training data in light of previously learned parameters. Examples include active learning, semi-supervised learning, bandits, or boosting. Rodemann et al. (2024) unify them under the framework of…

Machine Learning · Computer Science 2025-05-13 Julian Rodemann , James Bailie

Information-theoretic (IT) generalization bounds have been used to study the generalization of learning algorithms. These bounds are intrinsically data- and algorithm-dependent so that one can exploit the properties of data and algorithm to…

Machine Learning · Computer Science 2026-01-06 Ze Peng , Jian Zhang , Yisen Wang , Lei Qi , Yinghuan Shi , Yang Gao

We propose a general learning framework for the protection mechanisms that protects privacy via distorting model parameters, which facilitates the trade-off between privacy and utility. The algorithm is applicable to arbitrary privacy…

Machine Learning · Computer Science 2023-06-06 Xiaojin Zhang , Wenjie Li , Kai Chen , Shutao Xia , Qiang Yang

In this work, we improve upon the stepwise analysis of noisy iterative learning algorithms initiated by Pensia, Jog, and Loh (2018) and recently extended by Bu, Zou, and Veeravalli (2019). Our main contributions are significantly improved…

Machine Learning · Statistics 2020-01-28 Jeffrey Negrea , Mahdi Haghifam , Gintare Karolina Dziugaite , Ashish Khisti , Daniel M. Roy

Machine learning models trained by different optimization algorithms under different data distributions can exhibit distinct generalization behaviors. In this paper, we analyze the generalization of models trained by noisy iterative…

Machine Learning · Statistics 2022-12-29 Hao Wang , Rui Gao , Flavio P. Calmon

We make three related contributions motivated by the challenge of training stochastic neural networks, particularly in a PAC-Bayesian setting: (1) we show how averaging over an ensemble of stochastic neural networks enables a new class of…

Machine Learning · Computer Science 2021-12-16 Felix Biggs , Benjamin Guedj

We study a simple learning algorithm for binary classification. Instead of predicting with the best hypothesis in the hypothesis class, that is, the hypothesis that minimizes the training error, our algorithm predicts with a weighted…

Statistics Theory · Mathematics 2007-06-13 Yoav Freund , Yishay Mansour , Robert E. Schapire

We study which machine learning algorithms have tight generalization bounds. First, we present conditions that preclude the existence of tight generalization bounds. Specifically, we show that algorithms that have certain inductive biases…

Machine Learning · Computer Science 2024-10-04 Michael Gastpar , Ido Nachum , Jonathan Shafer , Thomas Weinberger

Existing generalization bounds fail to explain crucial factors that drive the generalization of modern neural networks. Since such bounds often hold uniformly over all parameters, they suffer from over-parametrization and fail to account…

Machine Learning · Statistics 2023-11-14 Songyan Hou , Parnian Kassraie , Anastasis Kratsios , Andreas Krause , Jonas Rothfuss

In this paper, the worst-case probability measure over the data is introduced as a tool for characterizing the generalization capabilities of machine learning algorithms. More specifically, the worst-case probability measure is a Gibbs…

Machine Learning · Computer Science 2023-12-20 Xinying Zou , Samir M. Perlaza , Iñaki Esnaola , Eitan Altman

Query-driven machine learning models have emerged as a promising estimation technique for query selectivities. Yet, surprisingly little is known about the efficacy of these techniques from a theoretical perspective, as there exist…

Machine Learning · Statistics 2026-05-19 Peizhi Wu , Haoshu Xu , Ryan Marcus , Zachary G. Ives

We view the Information Bottleneck Principle (IBP: Tishby et al., 1999; Schwartz-Ziv and Tishby, 2017) and Predictive Information Bottleneck Principle (PIBP: Still et al., 2007; Alemi, 2019) as special cases of a family of general…

Machine Learning · Computer Science 2019-12-24 Sayandev Mukherjee

Bayesian inference provides an attractive online-learning framework to analyze sequential data, and offers generalization guarantees which hold even with model mismatch and adversaries. Unfortunately, exact Bayesian inference is rarely…

Machine Learning · Statistics 2020-08-03 Badr-Eddine Chérief-Abdellatif , Pierre Alquier , Mohammad Emtiyaz Khan