English
Related papers

Related papers: Relating Regularization and Generalization through…

200 papers

Large Language Models (LLMs) show strong generalization across diverse tasks, yet the internal decision-making processes behind their predictions remain opaque. In this work, we study the geometry of hidden representations in LLMs through…

Machine Learning · Computer Science 2025-11-26 Abhinav Joshi , Divyanshu Bhatt , Ashutosh Modi

In reinforcement learning, state representations are used to tractably deal with large problem spaces. State representations serve both to approximate the value function with few parameters, but also to generalize to newly encountered…

Machine Learning · Computer Science 2022-03-02 Charline Le Lan , Stephen Tu , Adam Oberman , Rishabh Agarwal , Marc G. Bellemare

The local intrinsic dimension (LID) of data is a fundamental quantity in signal processing and learning theory, but quantifying the LID of high-dimensional, complex data has been a historically challenging task. Recent works have discovered…

Machine Learning · Computer Science 2025-11-27 Eric Yeats , Aaron Jacobson , Darryl Hannan , Yiran Jia , Timothy Doster , Henry Kvinge , Scott Mahan

A machine learning (ML) system must learn not only to match the output of a target function on a training set, but also to generalize to novel situations in order to yield accurate predictions at deployment. In most practical applications,…

Machine Learning · Computer Science 2022-12-13 Clare Lyle

Accurate estimation of Intrinsic Dimensionality (ID) is of crucial importance in many data mining and machine learning tasks, including dimensionality reduction, outlier detection, similarity search and subspace clustering. However, since…

Mode collapse remains a fundamental challenge in training generative adversarial networks (GANs). While existing works have primarily focused on inter-mode collapse, such as mode dropping, intra-mode collapse-where many latent variables map…

Machine Learning · Computer Science 2026-04-23 Kuan-Yu Lin , Yu-Chih Huang , Tie Liu

Pre-trained vision-language models, such as CLIP, show impressive zero-shot recognition ability and can be easily transferred to specific downstream tasks via prompt tuning, even with limited training data. However, existing prompt tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yuqi Peng , Pengfei Wang , Jianzhuang Liu , Shifeng Chen

Recent results on optimization and generalization properties of neural networks showed that in a simple two-layer network, the alignment of the labels to the eigenvectors of the corresponding Gram matrix determines the convergence of the…

Machine Learning · Computer Science 2023-02-03 Arman Rahbar , Emilio Jorge , Devdatt Dubhashi , Morteza Haghir Chehreghani

Efforts to understand the generalization mystery in deep learning have led to the belief that gradient-based optimization induces a form of implicit regularization, a bias towards models of low "complexity." We study the implicit…

Machine Learning · Computer Science 2019-10-29 Sanjeev Arora , Nadav Cohen , Wei Hu , Yuping Luo

Training deep neural networks is known to require a large number of training samples. However, in many applications only few training samples are available. In this work, we tackle the issue of training neural networks for classification…

Machine Learning · Computer Science 2017-12-25 Soufiane Belharbi , Clément Chatelain , Romain Hérault , Sébastien Adam

With too few samples or too many model parameters, overfitting can inhibit the ability to generalise predictions to new data. Within medical imaging, this can occur when features are incorrectly assigned importance such as distinct hospital…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Becks Simpson , Francis Dutil , Yoshua Bengio , Joseph Paul Cohen

Understanding the generalization properties of neural networks on simple input-output distributions is key to explaining their performance on real datasets. The classical teacher-student setting, where a network is trained on data generated…

Disordered Systems and Neural Networks · Physics 2026-03-26 Rodrigo Pérez Ortiz , Gibbs Nwemadji , Jean Barbier , Federica Gerace , Alessandro Ingrosso , Clarissa Lauditi , Enrico M. Malatesta

This study investigates the impact of regularization of latent spaces through truncation on the quality of generated test inputs for deep learning classifiers. We evaluate this effect using style-based GANs, a state-of-the-art generative…

Software Engineering · Computer Science 2026-02-18 Giorgi Merabishvili , Oliver Weißl , Andrea Stocco

Despite perfectly interpolating the training data, deep neural networks (DNNs) can often generalize fairly well, in part due to the "implicit regularization" induced by the learning algorithm. Nonetheless, various forms of regularization,…

Machine Learning · Computer Science 2022-02-23 Navid Azizan , Sahin Lale , Babak Hassibi

Modern machine learning models are often trained in a setting where the number of parameters exceeds the number of training samples. To understand the implicit bias of gradient descent in such overparameterized models, prior work has…

Machine Learning · Statistics 2025-10-29 Hannes Matt , Dominik Stöger

Delayed generalization, termed grokking, in a machine learning calculation occurs when the increase in test accuracy is delayed relative to the training accuracy. This paper examines grokking in the context of a dense neural network trained…

Disordered Systems and Neural Networks · Physics 2026-02-06 Karolina Hutchison , David Yevick

Masked language modeling is a widely used method for learning language representations, where the model predicts a randomly masked word in each input. However, this approach typically considers only a single correct answer during training,…

Computation and Language · Computer Science 2025-04-10 Seunghyun Ji , Soowon Lee

While the Implicit Bias(or Implicit Regularization) of standard loss functions has been studied, the optimization geometry induced by discriminative metric-learning objectives remains largely unexplored.To the best of our knowledge, this…

Machine Learning · Computer Science 2026-04-13 Jiawen Li

Imitation learning holds the promise of equipping robots with versatile skills by learning from expert demonstrations. However, policies trained on finite datasets often struggle to generalize beyond the training distribution. In this work,…

Machine Learning · Computer Science 2025-04-28 Yixiao Wang

In spite of advances in understanding lazy training, recent work attributes the practical success of deep learning to the rich regime with complex inductive bias. In this paper, we study rich regime training empirically with benchmark…

Machine Learning · Computer Science 2021-03-01 Xinyan Li , Arindam Banerjee