English
Related papers

Related papers: On the Information Plane of Autoencoders

200 papers

Learning with hidden variables is a central challenge in probabilistic graphical models that has important implications for many real-life problems. The classical approach is using the Expectation Maximization (EM) algorithm. This…

Machine Learning · Computer Science 2012-12-12 Gal Elidan , Nir Friedman

Generative LLM have achieved remarkable success in various industrial applications, owing to their promising In-Context Learning capabilities. However, the issue of long context in complex tasks poses a significant barrier to their wider…

Computation and Language · Computer Science 2025-10-14 Yihang Wang , Xu Huang , Bowen Tian , Yueyang Su , Lei Yu , Huaming Liao , Yixing Fan , Jiafeng Guo , Xueqi Cheng

Bidirectional language models have better context understanding and perform better than unidirectional models on natural language understanding tasks, yet the theoretical reasons behind this advantage remain unclear. In this work, we…

Computation and Language · Computer Science 2025-10-10 Md Kowsher , Nusrat Jahan Prottasha , Shiyun Xu , Shetu Mohanto , Ozlem Garibay , Niloofar Yousefi , Chen Chen

The development of optimal and efficient machine learning-based communication systems is likely to be a key enabler of beyond 5G communication technologies. In this direction, physical layer design has been recently reformulated under a…

Information Theory · Computer Science 2021-11-16 Nunzio A. Letizia , Andrea M. Tonello

Numerous deep learning algorithms have been inspired by and understood via the notion of information bottleneck, where unnecessary information is (often implicitly) minimized while task-relevant information is maximized. However, a rigorous…

Machine Learning · Computer Science 2023-05-31 Kenji Kawaguchi , Zhun Deng , Xu Ji , Jiaoyang Huang

This paper describes a novel design of a neural network-based speech generation model for learning prosodic representation.The problem of representation learning is formulated according to the information bottleneck (IB) principle. A…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-09 Guangyan Zhang , Ying Qin , Daxin Tan , Tan Lee

Deep learning is renowned for its theory-practice gap, whereby principled theory typically fails to provide much beneficial guidance for implementation in practice. This has been highlighted recently by the benign overfitting phenomenon:…

Machine Learning · Statistics 2023-11-14 Liam Hodgkinson , Chris van der Heide , Robert Salomone , Fred Roosta , Michael W. Mahoney

The information bottleneck principle provides an information-theoretic method for representation learning, by training an encoder to retain all information which is relevant for predicting the label while minimizing the amount of other,…

Machine Learning · Computer Science 2020-02-19 Marco Federici , Anjan Dutta , Patrick Forré , Nate Kushman , Zeynep Akata

This paper proposes the use of deep autoencoders to compress the channel information in a \review{massive} multiple input and multiple output (MIMO) system. Although autoencoders perform lossy compression, they still have adequate…

Networking and Internet Architecture · Computer Science 2024-10-07 Faris B. Mismar , Aliye Özge Kaya

Learned representations at the level of characters, sub-words, words and sentences, have each contributed to advances in understanding different NLP tasks and linguistic phenomena. However, learning textual embeddings is costly as they are…

Computation and Language · Computer Science 2023-10-27 Melika Behjati , Fabio Fehr , James Henderson

The Information bottleneck (IB) method enables optimizing over the trade-off between compression of data and prediction accuracy of learned representations, and has successfully and robustly been applied to both supervised and unsupervised…

Information Theory · Computer Science 2021-05-25 Teng-Hui Huang , Aly El Gamal

In recent several years, the information bottleneck (IB) principle provides an information-theoretic framework for deep multi-view clustering (MVC) by compressing multi-view observations while preserving the relevant information of multiple…

Information Theory · Computer Science 2024-03-26 Xiaoqiang Yan , Zhixiang Jin , Fengshou Han , Yangdong Ye

Information bottleneck (IB) principle [1] has become an important element in information-theoretic analysis of deep models. Many state-of-the-art generative models of both Variational Autoencoder (VAE) [2; 3] and Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Slava Voloshynovskiy , Mouad Kondah , Shideh Rezaeifar , Olga Taran , Taras Holotyak , Danilo Jimenez Rezende

Information Bottlenecks (IBs) learn representations that generalize to unseen data by information compression. However, existing IBs are practically unable to guarantee generalization in real-world scenarios due to the vacuous…

Machine Learning · Computer Science 2023-05-01 Yilin Lyu , Xin Liu , Mingyang Song , Xinyue Wang , Yaxin Peng , Tieyong Zeng , Liping Jing

The information bottleneck (IB) problem tackles the issue of obtaining relevant compressed representations $T$ of some random variable $X$ for the task of predicting $Y$. It is defined as a constrained optimization problem which maximizes…

Machine Learning · Statistics 2020-02-19 Borja Rodríguez-Gálvez , Ragnar Thobaben , Mikael Skoglund

The information plane (Tishby et al. arXiv:physics/0004057, Shwartz-Ziv et al. arXiv:1703.00810) has been proposed as an analytical tool for studying the learning dynamics of neural networks. It provides quantitative insight on how the…

Quantum Physics · Physics 2024-11-05 Nathan Haboury , Mo Kordzanganeh , Alexey Melnikov , Pavel Sekatski

This paper proposes a deep representation learning using an information-theoretic loss with an aim to increase the inter-class distances as well as within-class similarity in the embedded space. Tasks such as anomaly and out-of-distribution…

Machine Learning · Computer Science 2022-02-08 Shin Ando

The selective visual attention mechanism in the human visual system (HVS) restricts the amount of information to reach visual awareness for perceiving natural scenes, allowing near real-time information processing with limited computational…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Qiuxia Lai , Yu Li , Ailing Zeng , Minhao Liu , Hanqiu Sun , Qiang Xu

The Information Bottleneck (IB) is a conceptual method for extracting the most compact, yet informative, representation of a set of variables, with respect to the target. It generalizes the notion of minimal sufficient statistics from…

Machine Learning · Computer Science 2017-11-08 Amichai Painsky , Naftali Tishby

Extracting relevant information from data is crucial for all forms of learning. The information bottleneck (IB) method formalizes this, offering a mathematically precise and conceptually appealing framework for understanding learning…

Machine Learning · Computer Science 2021-10-27 Vudtiwat Ngampruetikorn , David J. Schwab