English
Related papers

Related papers: Transfer entropy and O-information to detect grokk…

200 papers

Grokking - the delayed transition from memorisation to generalisation in neural networks - remains poorly understood. We study this phenomenon through the geometry of learned representations and identify a consistent empirical signature…

Machine Learning · Computer Science 2026-05-13 Truong Xuan Khanh , Truong Quynh Hoa , Luu Duc Trung , Phan Thanh Duc

Grokking, a delayed generalization in neural networks after perfect training performance, has been observed in Transformers and MLPs, but the components driving it remain underexplored. We show that embeddings are central to grokking:…

Machine Learning · Computer Science 2025-05-22 H. V. AlquBoj , Hilal AlQuabeh , Velibor Bojkovic , Munachiso Nwadike , Kentaro Inui

In continual learning problems, it is often necessary to overwrite components of a neural network's learned representation in response to changes in the data stream; however, neural networks often exhibit \primacy bias, whereby early…

Machine Learning · Computer Science 2025-07-29 Clare Lyle , Gharda Sokar , Razvan Pascanu , Andras Gyorgy

This paper investigates the grokking phenomenon, which refers to the sudden transition from a long memorization to generalization observed during neural networks training, in the context of learning multiplication in finite-dimensional…

Machine Learning · Computer Science 2026-05-15 Pascal Jr Tikeng Notsawo , Guillaume Dumas , Guillaume Rabusseau

Grokking is the phenomenon where neural networks NNs initially fit the training data and later generalize to the test data during training. In this paper, we empirically provide a frequency perspective to explain the emergence of this…

Machine Learning · Computer Science 2024-05-29 Zhangchen Zhou , Yaoyu Zhang , Zhi-Qin John Xu

In some settings neural networks exhibit a phenomenon known as \textit{grokking}, where they achieve perfect or near-perfect accuracy on the validation set long after the same performance has been achieved on the training set. In this…

Machine Learning · Computer Science 2024-04-02 Jack Miller , Charles O'Neill , Thang Bui

In-context learning enables transformers to adapt to new tasks from a few examples at inference time, while grokking highlights that this generalization can emerge abruptly only after prolonged training. We study task generalization and…

Machine Learning · Statistics 2026-04-15 Abdessamed Qchohi , Simone Rossi

Neural networks often exhibit emergent behavior, where qualitatively new capabilities arise from scaling up the amount of parameters, training data, or training steps. One approach to understanding emergence is to find continuous…

Machine Learning · Computer Science 2023-10-23 Neel Nanda , Lawrence Chan , Tom Lieberum , Jess Smith , Jacob Steinhardt

Tensor networks have recently found applications in machine learning for both supervised learning and unsupervised learning. The most common approaches for training these models are gradient descent methods. In this work, we consider an…

Machine Learning · Computer Science 2023-06-27 Sheng-Hsuan Lin , Olivier Kuijpers , Sebastian Peterhansl , Frank Pollmann

Grokking in modular arithmetic has established itself as the quintessential fruit fly experiment, serving as a critical domain for investigating the mechanistic origins of model generalization. Despite its significance, existing research…

Artificial Intelligence · Computer Science 2026-04-01 Junjie Zhang , Zhen Shen , Gang Xiong , Xisong Dong

Grokking is a puzzling phenomenon in neural networks where full generalization occurs only after a substantial delay following the complete memorization of the training data. Previous research has linked this delayed generalization to…

Machine Learning · Computer Science 2026-01-12 Tiberiu Musat

Grokking refers to delayed generalization in which the increase in test accuracy of a neural network occurs appreciably after the improvement in training accuracy This paper introduces several practical metrics including variance under…

Machine Learning · Computer Science 2025-07-17 Ahmed Salah , David Yevick

Grokking -- the sudden generalisation that appears long after a model has perfectly memorised its training data -- has been widely observed but lacks a quantitative theory explaining the length of the delay. We show that grokking is a…

Artificial Intelligence · Computer Science 2026-05-05 Truong Xuan Khanh , Truong Quynh Hoa , Luu Duc Trung , Phan Thanh Duc

Training loss and accuracy are the standard signals used to monitor generalization during deep neural network training. Two well-documented phenomena complicate this picture: in grokking, train loss falls rapidly while test performance…

Machine Learning · Computer Science 2026-05-29 Chi-Ning Chou , Oscar Uzdelewicz , Neng-Chun Chiu , Yao-Yuan Yang , SueYeon Chung

We discuss two solvable grokking (generalisation beyond overfitting) models in a rule learning scenario. We show that grokking is a phase transition and find exact analytic expressions for the critical exponents, grokking probability, and…

Statistical Mechanics · Physics 2022-10-28 Bojan Žunkovič , Enej Ilievski

Tensor Networks are non-trivial representations of high-dimensional tensors, originally designed to describe quantum many-body systems. We show that Tensor Networks are ideal vehicles to connect quantum mechanical concepts to machine…

High Energy Physics - Phenomenology · Physics 2021-09-09 Jack Y. Araz , Michael Spannowsky

Grokking -- the delayed transition from memorization to generalization in small algorithmic tasks -- remains poorly understood. We present a geometric analysis of optimization dynamics in transformers trained on modular arithmetic. PCA of…

Machine Learning · Computer Science 2026-04-06 Yongzhong Xu

Grokking refers to a delayed generalization following overfitting when optimizing artificial neural networks with gradient-based methods. In this work, we demonstrate that grokking can be induced by regularization, either explicit or…

Machine Learning · Computer Science 2025-07-14 Pascal Jr Tikeng Notsawo , Guillaume Dumas , Guillaume Rabusseau

We study the well-known grokking phenomena in neural networks (NNs) using a 3-layer MLP trained on 1 k-sample subset of MNIST, with and without weight decay, and discover a novel third phase -- \emph{anti-grokking} -- that occurs very late…

Machine Learning · Computer Science 2025-06-06 Hari K. Prakash , Charles H. Martin

Grokking, the abrupt transition from memorization to generalisation after extended training, suggests the presence of competing solution basins with distinct statistical properties. We study this phenomenon through the lens of Singular…

Machine Learning · Statistics 2026-05-08 Ben Cullen , Sergio Estan-Ruiz , Riya Danait , Jiayi Li