English
Related papers

Related papers: Towards understanding neural collapse in supervise…

200 papers

Mixup is a data augmentation strategy that employs convex combinations of training instances and their respective labels to augment the robustness and calibration of deep neural networks. Despite its widespread adoption, the nuanced…

Machine Learning · Computer Science 2024-02-12 Quinn Fisher , Haoming Meng , Vardan Papyan

We consider the problem of learning a neural network classifier. Under the information bottleneck (IB) principle, we associate with this classification problem a representation learning problem, which we call "IB learning". We show that IB…

Machine Learning · Computer Science 2021-06-02 Masoumeh Soflaei , Hongyu Guo , Ali Al-Bashabsheh , Yongyi Mao , Richong Zhang

The information bottleneck (IB) principle has been adopted to explain deep learning in terms of information compression and prediction, which are balanced by a trade-off hyperparameter. How to optimize the IB principle for better robustness…

Machine Learning · Computer Science 2021-03-04 Penglong Zhai , Shihua Zhang

Neural Collapse (NC) is a recently observed phenomenon in neural networks that characterises the solution space of the final classifier layer when trained until zero training loss. Specifically, NC suggests that the final classifier layer…

Machine Learning · Computer Science 2024-11-05 Evan Markou , Thalaiyasingam Ajanthan , Stephen Gould

When training overparameterized deep networks for classification tasks, it has been widely observed that the learned features exhibit a so-called "neural collapse" phenomenon. More specifically, for the output features of the penultimate…

Machine Learning · Computer Science 2023-03-09 Can Yaras , Peng Wang , Zhihui Zhu , Laura Balzano , Qing Qu

The information bottleneck (IB) method is a technique designed to extract meaningful information related to one random variable from another random variable, and has found extensive applications in machine learning problems. In this paper,…

Information Theory · Computer Science 2025-07-29 Lingyi Chen , Shitong Wu , Sicheng Xu , Huihui Wu , Wenyi Zhang

Deep Neural Nets (DNNs) learn latent representations induced by their downstream task, objective function, and other parameters. The quality of the learned representations impacts the DNN's generalization ability and the coherence of the…

Machine Learning · Computer Science 2024-02-13 Nir Weingarten , Zohar Yakhini , Moshe Butman , Ran Gilad-Bachrach

One of the challenges in federated learning is the non-independent and identically distributed (non-iid) characteristics between heterogeneous devices, which cause significant differences in local updates and affect the performance of the…

Machine Learning · Computer Science 2023-04-03 Chenxi Huang , Liang Xie , Yibo Yang , Wenxiao Wang , Binbin Lin , Deng Cai

The information bottleneck (IB) method offers an attractive framework for understanding representation learning, however its applications are often limited by its computational intractability. Analytical characterization of the IB method is…

Information Theory · Computer Science 2023-04-03 Vudtiwat Ngampruetikorn , David J. Schwab

Deep neural networks (DNNs) have achieved significant success in various applications with large-scale and balanced data. However, data in real-world visual recognition are usually long-tailed, bringing challenges to efficient training and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yifan Lan , Xin Cai , Jun Cheng , Shan Tan

Despite their great success, there is still no comprehensive theoretical understanding of learning with Deep Neural Networks (DNNs) or their inner organization. Previous work proposed to analyze DNNs in the \textit{Information Plane}; i.e.,…

Machine Learning · Computer Science 2017-05-02 Ravid Shwartz-Ziv , Naftali Tishby

Recent years, many researches attempt to open the black box of deep neural networks and propose a various of theories to understand it. Among them, Information Bottleneck (IB) theory claims that there are two distinct phases consisting of…

Machine Learning · Statistics 2021-02-22 Junjie Li , Ding Liu

The Information Bottleneck (IB) principle offers an information-theoretic framework for analyzing the training process of deep neural networks (DNNs). Its essence lies in tracking the dynamics of two mutual information (MI) values: between…

Machine Learning · Computer Science 2024-05-10 Ivan Butakov , Alexander Tolmachev , Sofia Malanchuk , Anna Neopryatnaya , Alexey Frolov , Kirill Andreev

Deep classifier neural networks enter the terminal phase of training (TPT) when training error reaches zero and tend to exhibit intriguing Neural Collapse (NC) properties. Neural collapse essentially represents a state at which the…

Machine Learning · Computer Science 2023-04-12 Vignesh Kothapalli

Based on the notion of information bottleneck (IB), we formulate a quantization problem called "IB quantization". We show that IB quantization is equivalent to learning based on the IB principle. Under this equivalence, the standard neural…

Machine Learning · Computer Science 2019-02-13 Hongyu Guo , Yongyi Mao , Ali Al-Bashabsheh , Richong Zhang

Given the input graph and its label/property, several key problems of graph learning, such as finding interpretable subgraphs, graph denoising and graph compression, can be attributed to the fundamental problem of recognizing a subgraph of…

Machine Learning · Computer Science 2020-10-13 Junchi Yu , Tingyang Xu , Yu Rong , Yatao Bian , Junzhou Huang , Ran He

Modern deep neural networks have achieved impressive performance on tasks from image classification to natural language processing. Surprisingly, these complex systems with massive amounts of parameters exhibit the same structural…

Machine Learning · Computer Science 2023-06-21 Hien Dang , Tho Tran , Stanley Osher , Hung Tran-The , Nhat Ho , Tan Nguyen

In this work, we generalize the information bottleneck (IB) approach to the multi-view learning context. The exponentially growing complexity of the optimal representation motivates the development of two novel formulations with more…

Information Theory · Computer Science 2022-09-20 Teng-Hui Huang , Aly El Gamal , Hesham El Gamal

The current paradigm of training deep neural networks for classification tasks includes minimizing the empirical risk that pushes the training loss value towards zero, even after the training error has been vanished. In this terminal phase…

Machine Learning · Computer Science 2024-06-07 Hien Dang , Tho Tran , Tan Nguyen , Nhat Ho

Neural collapse provides an elegant mathematical characterization of learned last layer representations (a.k.a. features) and classifier weights in deep classification models. Such results not only provide insights but also motivate new…

Machine Learning · Computer Science 2023-10-30 Jiachen Jiang , Jinxin Zhou , Peng Wang , Qing Qu , Dustin Mixon , Chong You , Zhihui Zhu