English
Related papers

Related papers: An Information-Theoretic Approach to Generalizatio…

200 papers

The overall predictive uncertainty of a trained predictor can be decomposed into separate contributions due to epistemic and aleatoric uncertainty. Under a Bayesian formulation, assuming a well-specified model, the two contributions can be…

Machine Learning · Computer Science 2021-10-22 Sharu Theresa Jose , Sangwoo Park , Osvaldo Simeone

Deep Probabilistic Programming (DPP) allows powerful models based on recursive computation to be learned using efficient deep-learning optimization techniques. Additionally, DPP offers a unified perspective, where inference and learning…

Machine Learning · Computer Science 2022-03-31 Jonathan Warrell , Mark Gerstein

Empirically, the PAC-Bayesian analysis is known to produce tight risk bounds for practical machine learning algorithms. However, in its naive form, it can only deal with stochastic predictors while such predictors are rarely used and…

Machine Learning · Statistics 2019-11-22 Kohei Miyaguchi

Meta-learning aims at optimizing the hyperparameters of a model class or training algorithm from the observation of data from a number of related tasks. Following the setting of Baxter [1], the tasks are assumed to belong to the same task…

Machine Learning · Computer Science 2021-05-11 Sharu Theresa Jose , Osvaldo Simeone

The progress of machine learning over the past decade is undeniable. In retrospect, it is both remarkable and unsettling that this progress was achievable with little to no rigorous theory to guide experimentation. Despite this fact,…

Machine Learning · Statistics 2025-05-23 Hong Jun Jeon , Benjamin Van Roy

Variational inference (VI) is widely used for approximate inference in Bayesian machine learning. In addition to this practical success, generalization bounds for variational inference and related algorithms have been developed, mostly…

Machine Learning · Computer Science 2025-02-19 Yadi Wei , Roni Khardon

The ultimate performance of machine learning algorithms for classification tasks is usually measured in terms of the empirical error probability (or accuracy) based on a testing dataset. Whereas, these algorithms are optimized through the…

Machine Learning · Computer Science 2021-12-13 Matias Vera , Leonardo Rey Vega , Pablo Piantanida

Application of deep neural networks to medical imaging tasks has in some sense become commonplace. Still, a "thorn in the side" of the deep learning movement is the argument that deep networks are prone to overfitting and are thus unable to…

Machine Learning · Computer Science 2021-07-12 Anthony Sicilia , Xingchen Zhao , Anastasia Sosnovskikh , Seong Jae Hwang

Physics-informed machine learning (PIML) integrates mechanistic knowledge, typically in the form of partial differential equations (PDE), into data-driven models. Despite strong empirical performance, its statistical generalisation…

Machine Learning · Computer Science 2026-05-27 Thien V. Nguyen , Amaury Habrard , Benjamin Guedj

Is there a way to design powerful AI systems based on machine learning methods that would satisfy probabilistic safety guarantees? With the long-term goal of obtaining a probabilistic guarantee that would apply in every context, we consider…

Artificial Intelligence · Computer Science 2025-06-17 Yoshua Bengio , Michael K. Cohen , Nikolay Malkin , Matt MacDermott , Damiano Fornasiere , Pietro Greiner , Younesse Kaddar

Pairwise learning focuses on learning tasks with pairwise loss functions, depends on pairs of training instances, and naturally fits for modeling relationships between pairs of samples. In this paper, we focus on the privacy of pairwise…

Machine Learning · Computer Science 2021-06-02 Yilin Kang , Yong Liu , Jian Li , Weiping Wang

Information theory provides a mathematical foundation to measure uncertainty in belief. Belief is represented by a probability distribution that captures our understanding of an outcome's plausibility. Information measures based on…

Information Theory · Computer Science 2020-01-17 Jed A. Duersch , Thomas A. Catanach

This work presents several expected generalization error bounds based on the Wasserstein distance. More specifically, it introduces full-dataset, single-letter, and random-subset bounds, and their analogues in the randomized subsample…

Machine Learning · Statistics 2022-03-29 Borja Rodríguez-Gálvez , Germán Bassi , Ragnar Thobaben , Mikael Skoglund

In this work, we study out-of-distribution (OOD) generalization in meta-reinforcement learning from an information-theoretic perspective. We begin by establishing OOD generalization bounds for meta-supervised learning under two distinct…

Machine Learning · Computer Science 2026-04-07 Xingtu Liu

Bayesian methods, distributionally robust optimization methods, and regularization methods are three pillars of trustworthy machine learning combating distributional uncertainty, e.g., the uncertainty of an empirical distribution compared…

Machine Learning · Computer Science 2024-03-26 Shixiong Wang , Haowei Wang

We derive information theoretic generalization bounds for supervised learning algorithms based on a new measure of leave-one-out conditional mutual information (loo-CMI). Contrary to other CMI bounds, which are black-box bounds that do not…

Machine Learning · Computer Science 2022-07-04 Mohamad Rida Rammal , Alessandro Achille , Aditya Golatkar , Suhas Diggavi , Stefano Soatto

In transfer learning, training and testing data sets are drawn from different data distributions. The transfer generalization gap is the difference between the population loss on the target data distribution and the training loss. The…

Machine Learning · Computer Science 2021-01-26 Sharu Theresa Jose , Osvaldo Simeone

Quantum machine learning offers a transformative approach to solving complex problems, but the inherent noise hinders its practical implementation in near-term quantum devices. This obstacle makes it difficult to understand the…

Machine Learning · Computer Science 2025-02-05 Bikram Khanal , Pablo Rivas

We introduce a novel strategy to train randomised predictors in federated learning, where each node of the network aims at preserving its privacy by releasing a local predictor but keeping secret its training dataset with respect to the…

Machine Learning · Computer Science 2026-05-20 Pierre Jobic , Maxime Haddouche , Benjamin Guedj

We integrate information-theoretic concepts into the design and analysis of optimistic algorithms and Thompson sampling. By making a connection between information-theoretic quantities and confidence bounds, we obtain results that relate…

Machine Learning · Statistics 2019-11-25 Xiuyuan Lu , Benjamin Van Roy