English
Related papers

Related papers: Malign Overfitting: Interpolation Can Provably Pre…

200 papers

Transformers have the capacity to act as supervised learning algorithms: by properly encoding a set of labeled training ("in-context") examples and an unlabeled test example into an input sequence of vectors of the same dimension, the…

Machine Learning · Computer Science 2024-12-16 Spencer Frei , Gal Vardi

Studies on benign overfitting provide insights for the success of overparameterized deep learning models. In this work, we examine whether overfitting is truly benign in real-world classification tasks. We start with the observation that a…

Machine Learning · Computer Science 2023-04-04 Kaiyue Wen , Jiaye Teng , Jingzhao Zhang

In this paper, we investigate the principle that `good explanations are hard to vary' in the context of deep learning. We show that averaging gradients across examples -- akin to a logical OR of patterns -- can favor memorization and…

Machine Learning · Computer Science 2020-10-27 Giambattista Parascandolo , Alexander Neitz , Antonio Orvieto , Luigi Gresele , Bernhard Schölkopf

We propose Predict then Interpolate (PI), a simple algorithm for learning correlations that are stable across environments. The algorithm follows from the intuition that when using a classifier trained on one environment to make predictions…

Machine Learning · Computer Science 2021-05-27 Yujia Bao , Shiyu Chang , Regina Barzilay

The practical success of deep learning has led to the discovery of several surprising phenomena. One of these phenomena, that has spurred intense theoretical research, is ``benign overfitting'': deep neural networks seem to generalize well…

Machine Learning · Computer Science 2026-02-25 Ichiro Hashimoto , Stanislav Volgushev , Piotr Zwiernik

Learning approaches have recently become very popular in the field of inverse problems. A large variety of methods has been established in recent years, ranging from bi-level learning to high-dimensional machine learning techniques. Most…

Optimization and Control · Mathematics 2017-04-05 Martin Benning , Guy Gilboa , Joana Sarah Grah , Carola-Bibiane Schönlieb

Overfitting and generalization is an important concept in Machine Learning as only models that generalize are interesting for general applications. Yet some students have trouble learning this important concept through lectures and…

Machine Learning · Computer Science 2022-09-08 Matias Valdenegro-Toro , Matthia Sabatelli

The recovery of the intrinsic geometric structures of data collections is an important problem in data analysis. Supervised extensions of several manifold learning approaches have been proposed in the recent years. Meanwhile, existing…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Cem Ornek , Elif Vural

In fair machine learning, one source of performance disparities between groups is over-fitting to groups with relatively few training samples. We derive group-specific bounds on the generalization error of welfare-centric fair machine…

Machine Learning · Computer Science 2024-03-01 Cyrus Cousins , I. Elizabeth Kumar , Suresh Venkatasubramanian

Over-parameterized neural network models often lead to significant performance discrepancies between training and test sets, a phenomenon known as overfitting. To address this, researchers have proposed numerous regularization techniques…

Machine Learning · Computer Science 2025-01-27 RuiZhe Jiang , Haotian Lei

An agent with an inaccurate model of its environment faces a difficult choice: it can ignore the errors in its model and act in the real world in whatever way it determines is optimal with respect to its model. Alternatively, it can take a…

Despite substantial progress in promoting fairness in high-stake applications using machine learning models, existing methods often modify the training process, such as through regularizers or other interventions, but lack formal guarantees…

Machine Learning · Computer Science 2025-06-10 Firas Laakom , Haobo Chen , Jürgen Schmidhuber , Yuheng Bu

We develop a theoretical framework for generalization in the interpolating regime of statistical learning. The central question is why highly overparameterized estimators can attain zero empirical risk while still achieving nontrivial…

Machine Learning · Statistics 2026-04-13 Gustav Olaf Yunus Laitinen-Lundström Fredriksson-Imanov

One of the most interesting problems in the recent renaissance of the studies in kernel regression might be whether the kernel interpolation can generalize well, since it may help us understand the `benign overfitting henomenon' reported in…

Machine Learning · Computer Science 2023-08-09 Yicheng Li , Haobo Zhang , Qian Lin

The widespread success of deep neural networks has revealed a surprise in classical machine learning: very complex models often generalize well while simultaneously overfitting training data. This phenomenon of benign overfitting has been…

Quantum Physics · Physics 2023-12-20 Evan Peters , Maria Schuld

Meta-learning has arisen as a successful method for improving training performance by training over many similar tasks, especially with deep neural networks (DNNs). However, the theoretical understanding of when and why overparameterized…

Machine Learning · Computer Science 2023-04-11 Peizhong Ju , Yingbin Liang , Ness B. Shroff

The rule of thumb regarding the relationship between the bias-variance tradeoff and model size plays a key role in classical machine learning, but is now well-known to break down in the overparameterized setting as per the double descent…

Machine Learning · Statistics 2026-02-16 Qingyi Hu , Liam Hodgkinson

Many common estimators in machine learning and causal inference are linear smoothers, where the prediction is a weighted average of the training outcomes. Some estimators, such as ordinary least squares and kernel ridge regression, allow…

Machine Learning · Computer Science 2026-04-02 David Arbour , Harsh Parikh , Bijan Niknam , Elizabeth Stuart , Kara Rudolph , Avi Feller

Understanding generalization of overparametrized neural networks remains a fundamental challenge in machine learning. Most of the literature mostly studies generalization from an interpolation point of view, taking convergence of parameters…

Machine Learning · Computer Science 2025-06-13 Etienne Boursier , Nicolas Flammarion

Overfitting describes a machine learning phenomenon where the model fits too closely to the training data, resulting in poor generalization. While this occurrence is thoroughly documented for many forms of supervised learning, it is not…

Machine Learning · Computer Science 2024-08-23 Zachary Rabin , Jim Davis , Benjamin Lewis , Matthew Scherreik