English
Related papers

Related papers: Deep Variational Information Bottleneck

200 papers

Domain generalization models learn to generalize to previously unseen domains, but suffer from prediction uncertainty and domain shift. In this paper, we address both problems. We introduce a probabilistic meta-learning model for domain…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Yingjun Du , Jun Xu , Huan Xiong , Qiang Qiu , Xiantong Zhen , Cees G. M. Snoek , Ling Shao

Benefiting from large-scale pretrained vision language models (VLMs), the performance of visual question answering (VQA) has approached human oracles. However, finetuning such models on limited data often suffers from overfitting and poor…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Jingjing Jiang , Ziyi Liu , Nanning Zheng

Deep neural networks suffer from poor generalization to unseen environments when the underlying data distribution is different from that in the training set. By learning minimum sufficient representations from training data, the information…

Machine Learning · Computer Science 2021-10-13 Francesco Alesiani , Shujian Yu , Xi Yu

The Information Bottleneck principle offers both a mechanism to explain how deep neural networks train and generalize, as well as a regularized objective with which to train models. However, multiple competing objectives are proposed in the…

Machine Learning · Computer Science 2021-01-06 Andreas Kirsch , Clare Lyle , Yarin Gal

In the last few years, compression of deep neural networks has become an important strand of machine learning and computer vision research. Deep models require sizeable computational complexity and storage, when used for instance for Human…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Ayush Srivastava , Oshin Dutta , Prathosh AP , Sumeet Agarwal , Jigyasa Gupta

We introduce a bottleneck method for learning data representations based on information deficiency, rather than the more traditional information sufficiency. A variational upper bound allows us to implement this method efficiently. The…

Information Theory · Computer Science 2020-11-05 Pradeep Kr. Banerjee , Guido Montúfar

Effective adaptation to distribution shifts in training data is pivotal for sustaining robustness in neural networks, especially when removing specific biases or outdated information, a process known as machine unlearning. Traditional…

Machine Learning · Computer Science 2024-05-24 Ling Han , Hao Huang , Dustin Scheinost , Mary-Anne Hartley , María Rodríguez Martínez

The Information Bottleneck (IB) framework is a general characterization of optimal representations obtained using a principled approach for balancing accuracy and complexity. Here we present a new framework, the Dual Information Bottleneck…

Information Theory · Computer Science 2020-06-09 Zoe Piran , Ravid Shwartz-Ziv , Naftali Tishby

We view the Information Bottleneck Principle (IBP: Tishby et al., 1999; Schwartz-Ziv and Tishby, 2017) and Predictive Information Bottleneck Principle (PIBP: Still et al., 2007; Alemi, 2019) as special cases of a family of general…

Machine Learning · Computer Science 2019-12-24 Sayandev Mukherjee

In discriminative settings such as regression and classification there are two random variables at play, the inputs X and the targets Y. Here, we demonstrate that the Variational Information Bottleneck can be viewed as a compromise between…

Machine Learning · Statistics 2020-11-18 Alexander A Alemi , Warren R Morningstar , Ben Poole , Ian Fischer , Joshua V Dillon

Deep learning has become the most powerful machine learning tool in the last decade. However, how to efficiently train deep neural networks remains to be thoroughly solved. The widely used minibatch stochastic gradient descent (SGD) still…

Machine Learning · Computer Science 2021-05-18 Xinyu Peng , Jiawei Zhang , Fei-Yue Wang , Li Li

The information bottleneck (IB) method is a technique designed to extract meaningful information related to one random variable from another random variable, and has found extensive applications in machine learning problems. In this paper,…

Information Theory · Computer Science 2025-07-29 Lingyi Chen , Shitong Wu , Sicheng Xu , Huihui Wu , Wenyi Zhang

In supervised learning, understanding an input's proximity to the training data can help a model decide whether it has sufficient evidence for reaching a reliable prediction. While powerful probabilistic models such as Gaussian Processes…

Machine Learning · Computer Science 2024-06-19 Ifigeneia Apostolopoulou , Benjamin Eysenbach , Frank Nielsen , Artur Dubrawski

Information bottleneck (IB) is a technique for extracting information in one random variable $X$ that is relevant for predicting another random variable $Y$. IB works by encoding $X$ in a compressed "bottleneck" random variable $M$ from…

Information Theory · Computer Science 2022-11-22 Artemy Kolchinsky , Brendan D. Tracey , David H. Wolpert

Interpretable machine learning has gained much attention recently. Briefness and comprehensiveness are necessary in order to provide a large amount of information concisely when explaining a black-box decision system. However, existing…

Machine Learning · Computer Science 2019-10-04 Seojin Bang , Pengtao Xie , Heewook Lee , Wei Wu , Eric Xing

In the context of statistical learning, the Information Bottleneck method seeks a right balance between accuracy and generalization capability through a suitable tradeoff between compression complexity, measured by minimum description…

Information Theory · Computer Science 2021-02-16 Mohammad Mahdi Mahvari , Mari Kobayashi , Abdellatif Zaidi

The information bottleneck (IB) principle has been adopted to explain deep learning in terms of information compression and prediction, which are balanced by a trade-off hyperparameter. How to optimize the IB principle for better robustness…

Machine Learning · Computer Science 2021-03-04 Penglong Zhai , Shihua Zhang

Despite its notable success in adversarial learning approaches to multi-domain task-oriented dialog system, training the dialog policy via adversarial inverse reinforcement learning often fails to balance the performance of the policy…

Artificial Intelligence · Computer Science 2020-06-02 Jeiyoon Park , Chanhee Lee , Kuekyeng Kim , Heuiseok Lim

Deep neural networks (DNNs) have achieved significant success in various applications with large-scale and balanced data. However, data in real-world visual recognition are usually long-tailed, bringing challenges to efficient training and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yifan Lan , Xin Cai , Jun Cheng , Shan Tan

The information bottleneck (IB) method is a technique for extracting information that is relevant for predicting the target random variable from the source random variable, which is typically implemented by optimizing the IB Lagrangian that…

Machine Learning · Computer Science 2020-12-23 Ziqi Pan , Li Niu , Jianfu Zhang , Liqing Zhang