English
Related papers

Related papers: Explaining Grokking and Information Bottleneck thr…

200 papers

Grokking is a phenomenon where a model trained on an algorithmic task first overfits but, then, after a large amount of additional training, undergoes a phase transition to generalize perfectly. We empirically study the internal structure…

Machine Learning · Computer Science 2023-03-22 William Merrill , Nikolaos Tsilivis , Aman Shukla

Grokking, a phenomenon where machine learning models generalize long after overfitting, has been primarily observed and studied in algorithmic tasks. This paper explores grokking in real-world datasets using deep neural networks for…

Machine Learning · Computer Science 2024-06-21 Satvik Golechha

Recent studies have noted an intriguing phenomenon termed Neural Collapse, that is, when the neural networks establish the right correlation between feature spaces and the training targets, their last-layer features, together with the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Yining Wang , Junjie Sun , Chenyue Wang , Mi Zhang , Min Yang

Deep learning sometimes appears to work in unexpected ways. In pursuit of a deeper understanding of its surprising behaviors, we investigate the utility of a simple yet accurate model of a trained neural network consisting of a sequence of…

Machine Learning · Computer Science 2024-11-04 Alan Jeffares , Alicia Curth , Mihaela van der Schaar

The empirical emergence of neural collapse -- a surprising symmetry in the feature representations of the training data in the penultimate layer of deep neural networks -- has spurred a line of theoretical research aimed at its…

Machine Learning · Computer Science 2025-05-22 Peter Súkeník , Christoph H. Lampert , Marco Mondelli

In this paper, we investigate the phenomenon of grokking, where models exhibit delayed generalization following overfitting on training data. We focus on data-scarce regimes where the number of training samples falls below the critical…

Machine Learning · Computer Science 2025-11-10 Vaibhav Singh , Eugene Belilovsky , Rahaf Aljundi

Deep classifier neural networks enter the terminal phase of training (TPT) when training error reaches zero and tend to exhibit intriguing Neural Collapse (NC) properties. Neural collapse essentially represents a state at which the…

Machine Learning · Computer Science 2023-04-12 Vignesh Kothapalli

Catastrophic forgetting is a major problem in continual learning, and lots of approaches arise to reduce it. However, most of them are evaluated through task accuracy, which ignores the internal model structure. Recent research suggests…

Machine Learning · Computer Science 2026-03-06 Yunqin Zhu , Jun Jin

While the phenomenon of grokking, i.e., delayed generalization, has been studied extensively, it remains an open problem whether there is a mathematical framework that characterizes what kind of features will emerge, how and in which…

Machine Learning · Computer Science 2025-12-03 Yuandong Tian

Neural networks often exhibit emergent behavior, where qualitatively new capabilities arise from scaling up the amount of parameters, training data, or training steps. One approach to understanding emergence is to find continuous…

Machine Learning · Computer Science 2023-10-23 Neel Nanda , Lawrence Chan , Tom Lieberum , Jess Smith , Jacob Steinhardt

In some settings neural networks exhibit a phenomenon known as \textit{grokking}, where they achieve perfect or near-perfect accuracy on the validation set long after the same performance has been achieved on the training set. In this…

Machine Learning · Computer Science 2024-04-02 Jack Miller , Charles O'Neill , Thang Bui

We study grokking, the onset of generalization long after overfitting, in a classical ridge regression setting. We prove end-to-end grokking results for learning over-parameterized linear regression models using gradient descent with weight…

Machine Learning · Computer Science 2026-02-09 Mingyue Xu , Gal Vardi , Itay Safran

Neural networks sometimes exhibit grokking, a phenomenon where perfect or near-perfect performance is achieved on a validation set well after the same performance has been obtained on the corresponding training set. In this workshop paper,…

Machine Learning · Computer Science 2024-02-15 Jack Miller , Patrick Gleeson , Charles O'Neill , Thang Bui , Noam Levi

This work investigates the generalization behavior of deep neural networks (DNNs), focusing on the phenomenon of "fooling examples," where DNNs confidently classify inputs that appear random or unstructured to humans. To explore this…

Machine Learning · Computer Science 2025-08-22 Yen-Lung Lai , Zhe Jin

Delayed generalization, termed grokking, in a machine learning calculation occurs when the increase in test accuracy is delayed relative to the training accuracy. This paper examines grokking in the context of a dense neural network trained…

Disordered Systems and Neural Networks · Physics 2026-02-06 Karolina Hutchison , David Yevick

Grokking is proposed and widely studied as an intricate phenomenon in which generalization is achieved after a long-lasting period of overfitting. In this work, we propose NeuralGrok, a novel gradient-based approach that learns an optimal…

Machine Learning · Computer Science 2025-04-28 Xinyu Zhou , Simin Fan , Martin Jaggi , Jie Fu

This paper focuses on predicting the occurrence of grokking in neural networks, a phenomenon in which perfect generalization emerges long after signs of overfitting or memorization are observed. It has been reported that grokking can only…

Machine Learning · Computer Science 2023-10-02 Pascal Jr. Tikeng Notsawo , Hattie Zhou , Mohammad Pezeshki , Irina Rish , Guillaume Dumas

Existing accounts of grokking explain the phenomena in terms of mechanistic frameworks such as circuit efficiency or lazy-to-rich transitions. However, despite a known dependence between grokking and model size, how model capacity shapes…

Machine Learning · Computer Science 2026-05-12 Yiding Song , Hanming Ye

The Information Bottleneck principle offers both a mechanism to explain how deep neural networks train and generalize, as well as a regularized objective with which to train models. However, multiple competing objectives are proposed in the…

Machine Learning · Computer Science 2021-01-06 Andreas Kirsch , Clare Lyle , Yarin Gal

Grokking, referring to the abrupt improvement in test accuracy after extended overfitting, offers valuable insights into the mechanisms of model generalization. Existing researches based on progress measures imply that grokking relies on…

Machine Learning · Computer Science 2025-04-15 Zihan Gu , Ruoyu Chen , Hua Zhang , Yue Hu , Xiaochun Cao