English
Related papers

Related papers: The Information Bottleneck Problem and Its Applica…

200 papers

Deep neural networks excel in supervised learning tasks but are constrained by the need for extensive labeled data. Self-supervised learning emerges as a promising alternative, allowing models to learn without explicit labels. Information…

Machine Learning · Computer Science 2023-11-22 Ravid Shwartz-Ziv , Yann LeCun

Deep learning models are nowadays broadly deployed to solve an incredibly large variety of tasks. Commonly, leveraging over the availability of "big data", deep neural networks are trained as black-boxes, minimizing an objective function at…

Machine Learning · Computer Science 2022-10-04 Enzo Tartaglione

We present a variational approximation to the information bottleneck of Tishby et al. (1999). This variational approach allows us to parameterize the information bottleneck model using a neural network and leverage the reparameterization…

Machine Learning · Computer Science 2019-10-25 Alexander A. Alemi , Ian Fischer , Joshua V. Dillon , Kevin Murphy

The information bottleneck (IB) method aims to find compressed representations of a variable $X$ that retain the most relevant information about a target variable $Y$. We show that for a wide family of distributions -- namely, when $Y$ is…

Information Theory · Computer Science 2023-10-09 Etam Benger , Shahab Asoodeh , Jun Chen

It has been argued that semantic systems reflect pressure for efficiency, and a current debate concerns the cultural evolutionary process that produces this pattern. We consider efficiency as instantiated in the Information Bottleneck (IB)…

Computation and Language · Computer Science 2024-12-16 Emil Carlsson , Devdatt Dubhashi , Terry Regier

Machine learning is a vital part of many real-world systems, but several concerns remain about the lack of interpretability, explainability and robustness of black-box AI systems. Concept Bottleneck Models (CBM) address some of these…

Machine Learning · Statistics 2025-10-24 Hidde Fokkema , Tim van Erven , Sara Magliacane

One of the most studied problems in machine learning is finding reasonable constraints that guarantee the generalization of a learning algorithm. These constraints are usually expressed as some simplicity assumptions on the target. For…

Machine Learning · Computer Science 2020-01-03 Hassan Hafez-Kolahi , Shohreh Kasaei , Mahdiyeh Soleymani-Baghshah

This paper investigates a multi-terminal source coding problem under a logarithmic loss fidelity which does not necessarily lead to an additive distortion measure. The problem is motivated by an extension of the Information Bottleneck…

Information Theory · Computer Science 2021-11-29 Matías Vera , Leonardo Rey Vega , Pablo Piantanida

Automated decision making is used routinely throughout our everyday life. Recommender systems decide which jobs, movies, or other user profiles might be interesting to us. Spell checkers help us to make good use of language. Fraud detection…

Machine Learning · Computer Science 2020-07-15 Alexander Jung , Pedro H. J. Nardelli

We study two dual settings of information processing. Let $ \mathsf{Y} \rightarrow \mathsf{X} \rightarrow \mathsf{W} $ be a Markov chain with fixed joint probability mass function $ \mathsf{P}_{\mathsf{X}\mathsf{Y}} $ and a mutual…

Information Theory · Computer Science 2021-10-05 Michael Dikshtein , Shlomo Shamai

We present the information-ordered bottleneck (IOB), a neural layer designed to adaptively compress data into latent variables ordered by likelihood maximization. Without retraining, IOB nodes can be truncated at any bottleneck width,…

Machine Learning · Computer Science 2023-05-22 Matthew Ho , Xiaosheng Zhao , Benjamin Wandelt

Temporal Graph Neural Networks, a new and trending area of machine learning, suffers from a lack of formal analysis. In this paper, information theory is used as the primary tool to provide a framework for the analysis of temporal GNNs. For…

Information Theory · Computer Science 2024-08-13 Amirmohammad Farzaneh

Converging evidence suggests that human systems of semantic categories achieve near-optimal compression via the Information Bottleneck (IB) complexity-accuracy tradeoff. Large language models (LLMs) are not trained for this objective, which…

Computation and Language · Computer Science 2026-03-16 Nathaniel Imel , Noga Zaslavsky

The key to success in machine learning (ML) is the use of effective data representations. Traditionally, data representations were hand-crafted. Recently it has been demonstrated that, given sufficient data, deep neural networks can learn…

Machine Learning · Computer Science 2018-11-09 Ivan Olier , Oghenejokpeme I. Orhobor , Joaquin Vanschoren , Ross D. King

We formulate and analyze the compound information bottleneck programming. In this problem, a Markov chain $ \mathsf{X} \rightarrow \mathsf{Y} \rightarrow \mathsf{Z} $ is assumed with fixed marginal distributions $\mathsf{P}_{\mathsf{X}}$…

Information Theory · Computer Science 2022-05-11 Michael Dikshtein , Nir Weinberger , Shlomo Shamai

Deep neural networks tend to exhibit a bias toward low-rank solutions during training, implicitly learning low-dimensional feature representations. This paper investigates how deep multilayer perceptrons (MLPs) encode these feature…

Machine Learning · Computer Science 2024-10-11 Niket Patel , Ravid Shwartz-Ziv

Concept bottleneck models (CBMs) are interpretable neural networks that first predict labels for human-interpretable concepts relevant to the prediction task, and then predict the final label based on the concept label predictions. We…

Machine Learning · Computer Science 2023-04-28 Kushal Chauhan , Rishabh Tiwari , Jan Freyberg , Pradeep Shenoy , Krishnamurthy Dvijotham

This is an up-to-date introduction to and overview of the Minimum Description Length (MDL) Principle, a theory of inductive inference that can be applied to general problems in statistics, machine learning and pattern recognition. While MDL…

Methodology · Statistics 2019-12-19 Peter Grünwald , Teemu Roos

Multimodal data has significantly advanced recommendation systems by integrating diverse information sources to model user preferences and item characteristics. However, these systems often struggle with redundant and irrelevant…

Information Retrieval · Computer Science 2025-09-25 Hui Wang , Jinghui Qin , Wushao Wen , Qingling Li , Shanshan Zhong , Zhongzhan Huang

In this paper, we introduce the application of Information Bottleneck as a method to investigate properties of questionnaires developed for the study of motivational profiles based on self-determination theory. Founded on information…

Applications · Statistics 2018-06-06 Daniela M L Barbato , Jean-Jacques De Groote