English
Related papers

Related papers: Explaining generalization in deep learning: progre…

200 papers

Deep deraining networks consistently encounter substantial generalization issues when deployed in real-world applications, although they are successful in laboratory benchmarks. A prevailing perspective in deep learning encourages using…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jinjin Gu , Xianzheng Ma , Xiangtao Kong , Yu Qiao , Chao Dong

A practical limitation of deep neural networks is their high degree of specialization to a single task and visual domain. Recently, inspired by the successes of transfer learning, several authors have proposed to learn instead universal,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Sylvestre-Alvise Rebuffi , Hakan Bilen , Andrea Vedaldi

Despite remarkable success in a variety of applications, it is well-known that deep learning can fail catastrophically when presented with out-of-distribution data. Toward addressing this challenge, we consider the domain generalization…

Machine Learning · Statistics 2021-11-16 Alexander Robey , George J. Pappas , Hamed Hassani

Deep neural networks often contain far more parameters than training examples, yet they still manage to generalize well in practice. Classical complexity measures such as VC-dimension or PAC-Bayes bounds usually become vacuous in this…

Machine Learning · Computer Science 2025-08-26 Aviral Dhingra

In this work, we present a novel upper bound of target error to address the problem for unsupervised domain adaptation. Recent studies reveal that a deep neural network can learn transferable features which generalize well to novel tasks.…

Machine Learning · Computer Science 2019-10-07 Dexuan Zhang , Tatsuya Harada

With a goal of understanding what drives generalization in deep networks, we consider several recently suggested explanations, including norm-based control, sharpness and robustness. We study how these measures can ensure generalization,…

Machine Learning · Computer Science 2017-07-07 Behnam Neyshabur , Srinadh Bhojanapalli , David McAllester , Nathan Srebro

Several works have aimed to explain why overparameterized neural networks generalize well when trained by Stochastic Gradient Descent (SGD). The consensus explanation that has emerged credits the randomized nature of SGD for the bias of the…

Machine Learning · Computer Science 2021-02-24 Shengchao Liu , Dimitris Papailiopoulos , Dimitris Achlioptas

Numerous deep learning algorithms have been inspired by and understood via the notion of information bottleneck, where unnecessary information is (often implicitly) minimized while task-relevant information is maximized. However, a rigorous…

Machine Learning · Computer Science 2023-05-31 Kenji Kawaguchi , Zhun Deng , Xu Ji , Jiaoyang Huang

Deep learning methods are known to generalize well from training to future data, even in an overparametrized regime, where they could easily overfit. One explanation for this phenomenon is that even when their *ambient dimensionality*,…

Machine Learning · Computer Science 2025-05-22 Hossein Zakerinia , Dorsa Ghobadi , Christoph H. Lampert

Supervised deep learning involves the training of neural networks with a large number $N$ of parameters. For large enough $N$, in the so-called over-parametrized regime, one can essentially fit the training data points. Sparsity-based…

Disordered Systems and Neural Networks · Physics 2020-04-22 Mario Geiger , Arthur Jacot , Stefano Spigler , Franck Gabriel , Levent Sagun , Stéphane d'Ascoli , Giulio Biroli , Clément Hongler , Matthieu Wyart

We analyze new generalization bounds for deep learning models trained by transfer learning from a source to a target task. Our bounds utilize a quantity called the majority predictor accuracy, which can be computed efficiently from data. We…

Machine Learning · Computer Science 2022-09-14 Cuong N. Nguyen , Lam Si Tung Ho , Vu Dinh , Tal Hassner , Cuong V. Nguyen

The ability of deep neural networks to generalise well even when they interpolate their training data has been explained using various "simplicity biases". These theories postulate that neural networks avoid overfitting by first learning…

Machine Learning · Statistics 2023-05-29 Maria Refinetti , Alessandro Ingrosso , Sebastian Goldt

In an attempt to better understand generalization in deep learning, we study several possible explanations. We show that implicit regularization induced by the optimization method is playing a key role in generalization and success of deep…

Machine Learning · Computer Science 2017-09-11 Behnam Neyshabur

Autoencoders are widely used for unsupervised learning and as a regularization scheme in semi-supervised learning. However, theoretical understanding of their generalization properties and of the manner in which they can assist supervised…

Machine Learning · Statistics 2019-02-06 Baruch Epstein , Ron Meir

PAC-Bayesian is an analysis framework where the training error can be expressed as the weighted average of the hypotheses in the posterior distribution whilst incorporating the prior knowledge. In addition to being a pure generalization…

Machine Learning · Computer Science 2022-02-07 Wei Huang , Chunrui Liu , Yilan Chen , Tianyu Liu , Richard Yi Da Xu

Deep neural networks have gained tremendous popularity in last few years. They have been applied for the task of classification in almost every domain. Despite the success, deep networks can be incredibly slow to train for even moderate…

Machine Learning · Computer Science 2018-10-11 Gaurav Singh , John Shawe-Taylor

In this paper we study the generalization capabilities of fully-connected neural networks trained in the context of time series forecasting. Time series do not satisfy the typical assumption in statistical learning theory of the data being…

Machine Learning · Statistics 2019-07-30 Anastasia Borovykh , Cornelis W. Oosterlee , Sander M. Bohte

The robust generalization of models to rare, in-distribution (ID) samples drawn from the long tail of the training distribution and to out-of-training-distribution (OOD) samples is one of the major challenges of current deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Paul Gavrikov , Janis Keuper

In recent years, several results in the supervised learning setting suggested that classical statistical learning-theoretic measures, such as VC dimension, do not adequately explain the performance of deep learning models which prompted a…

Machine Learning · Computer Science 2021-12-09 Pascal Mattia Esser , Leena Chennuru Vankadara , Debarghya Ghoshdastidar

We carry out an information-theoretical analysis of a two-layer neural network trained from input-output pairs generated by a teacher network with matching architecture, in overparametrized regimes. Our results come in the form of bounds…

Machine Learning · Computer Science 2023-07-13 Francesco Camilli , Daria Tieplova , Jean Barbier