English
Related papers

Related papers: Information-theoretic generalization bounds for bl…

200 papers

We present algorithms for efficiently learning regularizers that improve generalization. Our approach is based on the insight that regularizers can be viewed as upper bounds on the generalization gap, and that reducing the slack in the…

Machine Learning · Computer Science 2019-02-25 Matthew Streeter

In this work, the probability of an event under some joint distribution is bounded by measuring it with the product of the marginals instead (which is typically easier to analyze) together with a measure of the dependence between the two…

Information Theory · Computer Science 2020-10-22 Amedeo Roberto Esposito , Michael Gastpar , Ibrahim Issa

The progress of machine learning over the past decade is undeniable. In retrospect, it is both remarkable and unsettling that this progress was achievable with little to no rigorous theory to guide experimentation. Despite this fact,…

Machine Learning · Statistics 2025-05-23 Hong Jun Jeon , Benjamin Van Roy

We present a framework to derive bounds on the test loss of randomized learning algorithms for the case of bounded loss functions. Drawing from Steinke & Zakynthinou (2020), this framework leads to bounds that depend on the conditional…

Machine Learning · Computer Science 2021-03-11 Fredrik Hellström , Giuseppe Durisi

As machine learning applications grow increasingly ubiquitous and complex, they face an increasing set of requirements beyond accuracy. The prevalent approach to handle this challenge is to aggregate a weighted combination of requirement…

Machine Learning · Computer Science 2026-01-07 Aneesh Barthakur , Luiz F. O. Chamon

Inductive Conformal Prediction (ICP) provides a practical and effective approach for equipping deep learning models with uncertainty estimates in the form of set-valued predictions which are guaranteed to contain the ground truth with high…

Machine Learning · Computer Science 2023-12-11 Apoorva Sharma , Sushant Veer , Asher Hancock , Heng Yang , Marco Pavone , Anirudha Majumdar

Machine learning models have traditionally been developed under the assumption that the training and test distributions match exactly. However, recent success in few-shot learning and related problems are encouraging signs that these models…

Machine Learning · Statistics 2020-10-15 James Lucas , Mengye Ren , Irene Kameni , Toniann Pitassi , Richard Zemel

As deep neural networks are highly expressive, it is important to find solutions with small generalization gap (the difference between the performance on the training data and unseen data). Focusing on the stochastic nature of training, we…

Machine Learning · Computer Science 2023-10-31 Rie Johnson , Tong Zhang

In this paper, we present generalization bounds for the unsupervised risk in the Deep Contrastive Representation Learning framework, which employs deep neural networks as representation functions. We approach this problem from two angles.…

Machine Learning · Statistics 2024-12-20 Nong Minh Hieu , Antoine Ledent , Yunwen Lei , Cheng Yeaw Ku

Variational inference (VI) is widely used for approximate inference in Bayesian machine learning. In addition to this practical success, generalization bounds for variational inference and related algorithms have been developed, mostly…

Machine Learning · Computer Science 2025-02-19 Yadi Wei , Roni Khardon

Providing generalization guarantees for stochastic optimization algorithms remains a key challenge in learning theory. Recently, numerous works demonstrated the impact of the geometric properties of optimization trajectories on…

Machine Learning · Computer Science 2026-01-23 Mario Tuci , Lennart Bastian , Benjamin Dupuis , Nassir Navab , Tolga Birdal , Umut Şimşekli

By leveraging experience from previous tasks, meta-learning algorithms can achieve effective fast adaptation ability when encountering new tasks. However it is unclear how the generalization property applies to new tasks. Probably…

Machine Learning · Computer Science 2021-02-09 Tianyu Liu , Jie Lu , Zheng Yan , Guangquan Zhang

Existing generalization bounds fail to explain crucial factors that drive the generalization of modern neural networks. Since such bounds often hold uniformly over all parameters, they suffer from over-parametrization and fail to account…

Machine Learning · Statistics 2023-11-14 Songyan Hou , Parnian Kassraie , Anastasis Kratsios , Andreas Krause , Jonas Rothfuss

Understanding the generalization behavior of deep neural networks remains a fundamental challenge in modern statistical learning theory. Among existing approaches, PAC-Bayesian norm-based bounds have demonstrated particular promise due to…

Machine Learning · Statistics 2026-01-14 Xinping Yi , Gaojie Jin , Xiaowei Huang , Shi Jin

Deep learning is usually described as an experiment-driven field under continuous criticizes of lacking theoretical foundations. This problem has been partially fixed by a large volume of literature which has so far not been well organized.…

Machine Learning · Computer Science 2021-03-12 Fengxiang He , Dacheng Tao

Motivated by the learned iterative soft thresholding algorithm (LISTA), we introduce a general class of neural networks suitable for sparse reconstruction from few linear measurements. By allowing a wide range of degrees of weight-sharing…

Machine Learning · Computer Science 2022-01-19 Ekkehard Schnoor , Arash Behboodi , Holger Rauhut

Established approaches to obtain generalization bounds in data-driven optimization and machine learning mostly build on solutions from empirical risk minimization (ERM), which depend crucially on the functional complexity of the hypothesis…

Optimization and Control · Mathematics 2022-10-14 Yibo Zeng , Henry Lam

We study a simple learning algorithm for binary classification. Instead of predicting with the best hypothesis in the hypothesis class, that is, the hypothesis that minimizes the training error, our algorithm predicts with a weighted…

Statistics Theory · Mathematics 2007-06-13 Yoav Freund , Yishay Mansour , Robert E. Schapire

Modern deep neural networks (DNNs) represent a formidable challenge for theorists: according to the commonly accepted probabilistic framework that describes their performance, these architectures should overfit due to the huge number of…

Disordered Systems and Neural Networks · Physics 2022-03-03 S. Ariosto , R. Pacelli , F. Ginelli , M. Gherardi , P. Rotondo

Recently, the information-theoretical framework has been proven to be able to obtain non-vacuous generalization bounds for large models trained by Stochastic Gradient Langevin Dynamics (SGLD) with isotropic noise. In this paper, we optimize…

Machine Learning · Computer Science 2021-11-04 Bohan Wang , Huishuai Zhang , Jieyu Zhang , Qi Meng , Wei Chen , Tie-Yan Liu