English
Related papers

Related papers: Convexity and Operational Interpretation of the Qu…

200 papers

The information bottleneck (IB) method is a technique for extracting information that is relevant for predicting the target random variable from the source random variable, which is typically implemented by optimizing the IB Lagrangian that…

Machine Learning · Computer Science 2020-12-23 Ziqi Pan , Li Niu , Jianfu Zhang , Liqing Zhang

Information Bottleneck (IB) is a generalization of rate-distortion theory that naturally incorporates compression and relevance trade-offs for learning. Though the original IB has been extensively studied, there has not been much…

Machine Learning · Computer Science 2019-10-08 Thanh T. Nguyen , Jaesik Choi

This study comes as a timely response to mounting criticism of the information bottleneck (IB) theory, injecting fresh perspectives to rectify misconceptions and reaffirm its validity. Firstly, we introduce an auxiliary function to…

Machine Learning · Computer Science 2023-05-22 Faxian Cao , Yongqiang Cheng , Adil Mehmood Khan , Zhijing Yang

The information bottleneck (IB) method aims to find compressed representations of a variable $X$ that retain the most relevant information about a target variable $Y$. We show that for a wide family of distributions -- namely, when $Y$ is…

Information Theory · Computer Science 2023-10-09 Etam Benger , Shahab Asoodeh , Jun Chen

Convex optimization problems arise naturally in quantum information theory, often in terms of minimizing a convex function over a convex subset of the space of hermitian matrices. In most cases, finding exact solutions to these problems is…

Quantum Physics · Physics 2014-11-26 Mark W. Girard , Gilad Gour , Shmuel Friedland

Recent years, many researches attempt to open the black box of deep neural networks and propose a various of theories to understand it. Among them, Information Bottleneck (IB) theory claims that there are two distinct phases consisting of…

Machine Learning · Statistics 2021-02-22 Junjie Li , Ding Liu

The presence of symmetries imposes a stringent set of constraints on a system. This constrained structure allows intelligent agents interacting with such a system to drastically improve the efficiency of learning and generalization, through…

Information Theory · Computer Science 2024-10-03 Hippolyte Charvin , Nicola Catenacci Volpi , Daniel Polani

In many applications, it is desirable to extract only the relevant aspects of data. A principled way to do this is the information bottleneck (IB) method, where one seeks a code that maximizes information about a 'relevance' variable, Y,…

Machine Learning · Statistics 2016-10-27 Matthew Chalk , Olivier Marre , Gasper Tkacik

The Information Bottleneck (IB) principle offers a compelling theoretical framework to understand how neural networks (NNs) learn. However, its practical utility has been constrained by unresolved theoretical ambiguities and significant…

Machine Learning · Computer Science 2026-02-02 Charles Westphal , Stephen Hailes , Mirco Musolesi

In order to understand the source and extent of the greater-than-classical information processing power of quantum systems, one wants to characterize both classical and quantum mechanics as points in a broader space of possible theories.…

Quantum Physics · Physics 2009-08-18 Howard Barnum , Alexander Wilce

The information bottleneck principle is an elegant and useful approach to representation learning. In this paper, we investigate the problem of representation learning in the context of reinforcement learning using the information…

Machine Learning · Computer Science 2019-11-14 Pei Yingjun , Hou Xinwen

The information bottleneck (IB) approach is popular to improve the generalization, robustness and explainability of deep neural networks. Essentially, it aims to find a minimum sufficient representation $\mathbf{t}$ by striking a trade-off…

Machine Learning · Computer Science 2024-04-30 Shujian Yu , Xi Yu , Sigurd Løkse , Robert Jenssen , Jose C. Principe

Lossy compression and clustering fundamentally involve a decision about what features are relevant and which are not. The information bottleneck method (IB) by Tishby, Pereira, and Bialek formalized this notion as an information-theoretic…

Neurons and Cognition · Quantitative Biology 2017-02-23 DJ Strouse , David J Schwab

There are two widely held characterizations of human semantic category systems: (1) they form convex partitions of conceptual spaces, and (2) they are efficient for communication. While prior work observed that convexity and efficiency…

Computation and Language · Computer Science 2026-02-10 Nathaniel Imel , Noga Zaslavasky

The Information bottleneck (IB) method enables optimizing over the trade-off between compression of data and prediction accuracy of learned representations, and has successfully and robustly been applied to both supervised and unsupervised…

Information Theory · Computer Science 2021-05-25 Teng-Hui Huang , Aly El Gamal

Whenever communication takes place to fulfil a goal, an effective way to encode the source data to be transmitted is to use an encoding rule that allows the receiver to meet the requirements of the goal. A formal way to identify the…

Signal Processing · Electrical Eng. & Systems 2022-11-24 Francesco Pezone , Sergio Barbarossa , Paolo Di Lorenzo

Information Bottlenecks (IBs) learn representations that generalize to unseen data by information compression. However, existing IBs are practically unable to guarantee generalization in real-world scenarios due to the vacuous…

Machine Learning · Computer Science 2023-05-01 Yilin Lyu , Xin Liu , Mingyang Song , Xinyue Wang , Yaxin Peng , Tieyong Zeng , Liping Jing

We present an information-theoretic interpretation of quantum formalism based on a Bayesian framework and devoid of any extra axiom or principle. Quantum information is construed as a technique for analyzing a logical system subject to…

Information Theory · Computer Science 2020-12-01 Michel Feldmann

The information bottleneck (IB) problem tackles the issue of obtaining relevant compressed representations $T$ of some random variable $X$ for the task of predicting $Y$. It is defined as a constrained optimization problem which maximizes…

Machine Learning · Statistics 2020-02-19 Borja Rodríguez-Gálvez , Ragnar Thobaben , Mikael Skoglund

We propose a novel framework for uncertainty quantification via information bottleneck (IB-UQ) for scientific machine learning tasks, including deep neural network (DNN) regression and neural operator learning (DeepONet). Specifically, we…

Numerical Analysis · Mathematics 2023-05-31 Ling Guo , Hao Wu , Wenwen Zhou , Yan Wang , Tao Zhou