English
Related papers

Related papers: On the Multi-View Information Bottleneck Represent…

200 papers

Multimodal data has significantly advanced recommendation systems by integrating diverse information sources to model user preferences and item characteristics. However, these systems often struggle with redundant and irrelevant…

Information Retrieval · Computer Science 2025-09-25 Hui Wang , Jinghui Qin , Wushao Wen , Qingling Li , Shanshan Zhong , Zhongzhan Huang

Despite widespread adoption, multimodal large language models (MLLMs) suffer performance degradation when encountering unfamiliar queries under distribution shifts. Existing methods to improve MLLM generalization typically require either…

Artificial Intelligence · Computer Science 2025-10-21 Changdae Oh , Jiatong Li , Shawn Im , Sharon Li

We consider the problem of learning a neural network classifier. Under the information bottleneck (IB) principle, we associate with this classification problem a representation learning problem, which we call "IB learning". We show that IB…

Machine Learning · Computer Science 2021-06-02 Masoumeh Soflaei , Hongyu Guo , Ali Al-Bashabsheh , Yongyi Mao , Richong Zhang

Generative LLM have achieved remarkable success in various industrial applications, owing to their promising In-Context Learning capabilities. However, the issue of long context in complex tasks poses a significant barrier to their wider…

Computation and Language · Computer Science 2025-10-14 Yihang Wang , Xu Huang , Bowen Tian , Yueyang Su , Lei Yu , Huaming Liao , Yixing Fan , Jiafeng Guo , Xueqi Cheng

Information Bottlenecks (IBs) learn representations that generalize to unseen data by information compression. However, existing IBs are practically unable to guarantee generalization in real-world scenarios due to the vacuous…

Machine Learning · Computer Science 2023-05-01 Yilin Lyu , Xin Liu , Mingyang Song , Xinyue Wang , Yaxin Peng , Tieyong Zeng , Liping Jing

Information bottleneck (IB) and privacy funnel (PF) are two closely related optimization problems which have found applications in machine learning, design of privacy algorithms, capacity problems (e.g., Mrs. Gerber's Lemma), strong data…

Information Theory · Computer Science 2020-12-30 Shahab Asoodeh , Flavio Calmon

The information bottleneck (IB) method is a technique for extracting information that is relevant for predicting the target random variable from the source random variable, which is typically implemented by optimizing the IB Lagrangian that…

Machine Learning · Computer Science 2020-12-23 Ziqi Pan , Li Niu , Jianfu Zhang , Liqing Zhang

Maintaining efficient semantic representations of the environment is a major challenge both for humans and for machines. While human languages represent useful solutions to this problem, it is not yet clear what computational principle…

Computation and Language · Computer Science 2018-08-13 Noga Zaslavsky , Charles Kemp , Terry Regier , Naftali Tishby

The Information Bottleneck method is a learning technique that seeks a right balance between accuracy and generalization capability through a suitable tradeoff between compression complexity, measured by minimum description length, and…

Information Theory · Computer Science 2020-11-04 Mohammad Mahdi Mahvari , Mari Kobayashi , Abdellatif Zaidi

Deep neural networks suffer from poor generalization to unseen environments when the underlying data distribution is different from that in the training set. By learning minimum sufficient representations from training data, the information…

Machine Learning · Computer Science 2021-10-13 Francesco Alesiani , Shujian Yu , Xi Yu

Information Theory (IT) has been used in Machine Learning (ML) from early days of this field. In the last decade, advances in Deep Neural Networks (DNNs) have led to surprising improvements in many applications of ML. The result has been a…

Machine Learning · Computer Science 2019-04-09 Hassan Hafez-Kolahi , Shohreh Kasaei

The fruits of science are relationships made comprehensible, often by way of approximation. While deep learning is an extremely powerful way to find relationships in data, its use in science has been hindered by the difficulty of…

Machine Learning · Computer Science 2022-04-18 Kieran A. Murphy , Dani S. Bassett

The information bottleneck (IB) principle has been suggested as a way to analyze deep neural networks. The learning dynamics are studied by inspecting the mutual information (MI) between the hidden layers and the input and output. Notably,…

Machine Learning · Computer Science 2022-02-15 Stephan Sloth Lorenzen , Christian Igel , Mads Nielsen

In multi-agent deep reinforcement learning, extracting sufficient and compact information of other agents is critical to attain efficient convergence and scalability of an algorithm. In canonical frameworks, distilling of such information…

Machine Learning · Computer Science 2021-09-30 Yue Jin , Shuangqing Wei , Jian Yuan , Xudong Zhang

The Information Bottleneck (IB) principle offers an information-theoretic framework for analyzing the training process of deep neural networks (DNNs). Its essence lies in tracking the dynamics of two mutual information (MI) values: between…

Machine Learning · Computer Science 2024-05-10 Ivan Butakov , Alexander Tolmachev , Sofia Malanchuk , Anna Neopryatnaya , Alexey Frolov , Kirill Andreev

Whenever communication takes place to fulfil a goal, an effective way to encode the source data to be transmitted is to use an encoding rule that allows the receiver to meet the requirements of the goal. A formal way to identify the…

Signal Processing · Electrical Eng. & Systems 2022-11-24 Francesco Pezone , Sergio Barbarossa , Paolo Di Lorenzo

Estimating individual level treatment effects (ITE) from observational data is a challenging and important area in causal machine learning and is commonly considered in diverse mission-critical applications. In this paper, we propose an…

Machine Learning · Computer Science 2019-06-10 Sungyub Kim , Yongsu Baek , Sung Ju Hwang , Eunho Yang

Information bottleneck (IB) is a method for extracting information from one random variable $X$ that is relevant for predicting another random variable $Y$. To do so, IB identifies an intermediate "bottleneck" variable $T$ that has low…

Machine Learning · Statistics 2022-11-22 Artemy Kolchinsky , Brendan D. Tracey , Steven Van Kuyk

The muti-layer information bottleneck (IB) problem, where information is propagated (or successively refined) from layer to layer, is considered. Based on information forwarded by the preceding layer, each stage of the network is required…

Machine Learning · Statistics 2017-11-15 Qianqian Yang , Pablo Piantanida , Deniz Gündüz

The Information Bottleneck (IB) method frequently suffers from unstable optimization, characterized by abrupt representation shifts near critical points of the IB trade-off parameter, beta. In this paper, I introduce a novel approach to…

Machine Learning · Computer Science 2025-05-15 Faruk Alpay