English
Related papers

Related papers: A Generalized Information Bottleneck Method: A Dec…

200 papers

Understanding the source of the superior generalization ability of NNs remains one of the most important problems in ML research. There have been a series of theoretical works trying to derive non-vacuous bounds for NNs. Recently, the…

Machine Learning · Computer Science 2022-03-07 Zifeng Wang , Shao-Lun Huang , Ercan E. Kuruoglu , Jimeng Sun , Xi Chen , Yefeng Zheng

We propose a novel information bottleneck (IB) method named Drop-Bottleneck, which discretely drops features that are irrelevant to the target variable. Drop-Bottleneck not only enjoys a simple and tractable compression objective but also…

Machine Learning · Computer Science 2021-03-24 Jaekyeom Kim , Minjung Kim , Dongyeon Woo , Gunhee Kim

The information bottleneck (IB) method aims to find compressed representations of a variable $X$ that retain the most relevant information about a target variable $Y$. We show that for a wide family of distributions -- namely, when $Y$ is…

Information Theory · Computer Science 2023-10-09 Etam Benger , Shahab Asoodeh , Jun Chen

Combining the Information Bottleneck model with deep learning by replacing mutual information terms with deep neural nets has proved successful in areas ranging from generative modelling to interpreting deep neural networks. In this paper,…

Machine Learning · Computer Science 2020-02-19 Aleksander Wieczorek , Volker Roth

We introduce a bottleneck method for learning data representations based on information deficiency, rather than the more traditional information sufficiency. A variational upper bound allows us to implement this method efficiently. The…

Information Theory · Computer Science 2020-11-05 Pradeep Kr. Banerjee , Guido Montúfar

The theoretical basis for a candidate variational principle for the information bottleneck (IB) method is formulated within the ambit of the generalized nonadditive statistics of Tsallis. Given a nonadditivity parameter $ q $, the role of…

Statistical Mechanics · Physics 2009-05-01 R. C. Venkatesan , A. Plastino

We show that if the conditional distribution p(C | T) factors through a sufficient statistic {\phi}(T), then the Information Bottleneck (IB) problem for (T, C) is exactly equivalent to the IB problem for ({\phi}(T), C). The reduction is…

Information Theory · Computer Science 2026-04-30 Joss Armstrong

The partial information decomposition (PID) aims to quantify the amount of redundant information that a set of sources provides about a target. Here, we show that this goal can be formulated as a type of information bottleneck (IB) problem,…

Information Theory · Computer Science 2024-06-28 Artemy Kolchinsky

Deep learning has become the most powerful machine learning tool in the last decade. However, how to efficiently train deep neural networks remains to be thoroughly solved. The widely used minibatch stochastic gradient descent (SGD) still…

Machine Learning · Computer Science 2021-05-18 Xinyu Peng , Jiawei Zhang , Fei-Yue Wang , Li Li

The Information Bottleneck (IB) method (\cite{tishby2000information}) provides an insightful and principled approach for balancing compression and prediction for representation learning. The IB objective $I(X;Z)-\beta I(Y;Z)$ employs a…

Machine Learning · Computer Science 2019-10-23 Tailin Wu , Ian Fischer , Isaac L. Chuang , Max Tegmark

Interpretability is a pressing issue for machine learning. Common approaches to interpretable machine learning constrain interactions between features of the input, rendering the effects of those features on a model's output comprehensible…

Machine Learning · Computer Science 2023-05-11 Kieran A. Murphy , Dani S. Bassett

The fruits of science are relationships made comprehensible, often by way of approximation. While deep learning is an extremely powerful way to find relationships in data, its use in science has been hindered by the difficulty of…

Machine Learning · Computer Science 2022-04-18 Kieran A. Murphy , Dani S. Bassett

Decisions of complex language understanding models can be rationalized by limiting their inputs to a relevant subsequence of the original text. A rationale should be as concise as possible without significantly degrading task performance,…

Computation and Language · Computer Science 2020-11-04 Bhargavi Paranjape , Mandar Joshi , John Thickstun , Hannaneh Hajishirzi , Luke Zettlemoyer

Learning invariant (causal) features for out-of-distribution (OOD) generalization has attracted extensive attention recently, and among the proposals invariant risk minimization (IRM) is a notable solution. In spite of its theoretical…

Machine Learning · Computer Science 2023-02-01 Bin Deng , Kui Jia

The information bottleneck principle provides an information-theoretic method for representation learning, by training an encoder to retain all information which is relevant for predicting the label while minimizing the amount of other,…

Machine Learning · Computer Science 2020-02-19 Marco Federici , Anjan Dutta , Patrick Forré , Nate Kushman , Zeynep Akata

Learning effective joint embedding for cross-modal data has always been a focus in the field of multimodal machine learning. We argue that during multimodal fusion, the generated multimodal embedding may be redundant, and the discriminative…

Machine Learning · Computer Science 2022-12-06 Sijie Mai , Ying Zeng , Haifeng Hu

Normalization is fundamental to deep learning, but existing approaches such as BatchNorm, LayerNorm, and RMSNorm are variance-centric by enforcing zero mean and unit variance, stabilizing training without controlling how representations…

Machine Learning · Computer Science 2026-01-30 Xiandong Zou , Jia Li , Xiaotong Yuan , Pan Zhou

Integration of data from multiple omics techniques is becoming increasingly important in biomedical research. Due to non-uniformity and technical limitations in omics platforms, such integrative analyses on multiple omics, which we refer to…

Machine Learning · Computer Science 2021-02-11 Changhee Lee , Mihaela van der Schaar

We formulate and analyze the compound information bottleneck programming. In this problem, a Markov chain $ \mathsf{X} \rightarrow \mathsf{Y} \rightarrow \mathsf{Z} $ is assumed with fixed marginal distributions $\mathsf{P}_{\mathsf{X}}$…

Information Theory · Computer Science 2022-05-11 Michael Dikshtein , Nir Weinberger , Shlomo Shamai

We study a distributed learning problem in which Alice sends a compressed distillation of a set of training data to Bob, who uses the distilled version to best solve an associated learning problem. We formalize this as a rate-distortion…

Information Theory · Computer Science 2018-10-30 Parinaz Farajiparvar , Ahmad Beirami , Matthew Nokleby