English
Related papers

Related papers: Sharp Minima Can Generalize For Deep Nets

200 papers

This dissertation studies a fundamental open challenge in deep learning theory: why do deep networks generalize well even while being overparameterized, unregularized and fitting the training data to zero error? In the first part of the…

Machine Learning · Computer Science 2021-10-19 Vaishnavh Nagarajan

Normalization methods play an important role in enhancing the performance of deep learning while their theoretical understandings have been limited. To theoretically elucidate the effectiveness of normalization, we quantify the geometry of…

Machine Learning · Statistics 2019-10-29 Ryo Karakida , Shotaro Akaho , Shun-ichi Amari

A main puzzle of deep networks revolves around the absence of overfitting despite large overparametrization and despite the large capacity demonstrated by zero training error on randomly labeled data. In this note, we show that the dynamics…

The key to generalization is controlling the complexity of the network. However, there is no obvious control of complexity -- such as an explicit regularization term -- in the training of deep networks for classification. We will show that…

Machine Learning · Computer Science 2020-04-14 Andrzej Banburski , Qianli Liao , Brando Miranda , Lorenzo Rosasco , Fernanda De La Torre , Jack Hidary , Tomaso Poggio

Sharpness-Aware Minimization (SAM) is a recent optimization framework aiming to improve the deep neural network generalization, through obtaining flatter (i.e. less sharp) solutions. As SAM has been numerically successful, recent papers…

Machine Learning · Statistics 2023-05-22 Kayhan Behdin , Rahul Mazumder

Deep artificial neural networks achieve surprising generalization abilities that remain poorly understood. In this paper, we present a new approach to analyzing generalization for deep feed-forward ReLU networks that takes advantage of the…

Machine Learning · Computer Science 2023-07-06 Ramchandran Muthukumar , Jeremias Sulam

It is widely believed that a neural network can fit a training set containing at least as many samples as it has parameters, underpinning notions of overparameterized and underparameterized models. In practice, however, we only find…

Machine Learning · Computer Science 2024-06-18 Ravid Shwartz-Ziv , Micah Goldblum , Arpit Bansal , C. Bayan Bruss , Yann LeCun , Andrew Gordon Wilson

It is arguably believed that flatter minima can generalize better. However, it has been pointed out that the usual definitions of sharpness, which consider either the maxima or the integral of loss over a $\delta$ ball of parameters around…

Machine Learning · Computer Science 2021-01-11 Mingyang Yi , Huishuai Zhang , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu

Empirical studies of the loss landscape of deep networks have revealed that many local minima are connected through low-loss valleys. Yet, little is known about the theoretical origin of such valleys. We present a general framework for…

Machine Learning · Computer Science 2023-03-24 Bo Zhao , Iordan Ganev , Robin Walters , Rose Yu , Nima Dehmamy

Aimed at explaining the surprisingly good generalization behavior of overparameterized deep networks, recent works have developed a variety of generalization bounds for deep learning, all based on the fundamental learning-theoretic…

Machine Learning · Computer Science 2021-10-19 Vaishnavh Nagarajan , J. Zico Kolter

While the optimization problem behind deep neural networks is highly non-convex, it is frequently observed in practice that training deep networks seems possible without getting stuck in suboptimal points. It has been argued that this is…

Machine Learning · Computer Science 2017-06-14 Quynh Nguyen , Matthias Hein

Deep learning is recognized to be capable of discovering deep features for representation learning and pattern recognition without requiring elegant feature engineering techniques by taking advantage of human ingenuity and prior knowledge.…

Machine Learning · Computer Science 2020-04-02 Zhi Han , Siquan Yu , Shao-Bo Lin , Ding-Xuan Zhou

Recently, Sharpness-Aware Minimization (SAM) algorithm has shown state-of-the-art generalization abilities in vision tasks. It demonstrates that flat minima tend to imply better generalization abilities. However, it has some difficulty…

Machine Learning · Computer Science 2022-10-14 Zhiyuan Zhang , Ruixuan Luo , Qi Su , Xu Sun

Neural networks appear to have mysterious generalization properties when using parameter counting as a proxy for complexity. Indeed, neural networks often have many more parameters than there are data points, yet still provide good…

Machine Learning · Computer Science 2020-05-26 Wesley J. Maddox , Gregory Benton , Andrew Gordon Wilson

Flat minima, known to enhance generalization and robustness in supervised learning, remain largely unexplored in generative models. In this work, we systematically investigate the role of loss surface flatness in generative models, both…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Taehwan Lee , Kyeongkook Seo , Jaejun Yoo , Sung Whan Yoon

Neural networks with a large number of parameters often do not overfit, owing to implicit regularization that favors \lq good\rq{} networks. Other related and puzzling phenomena include properties of flat minima, saddle-to-saddle dynamics,…

Artificial Intelligence · Computer Science 2026-01-06 Joachim Bona-Pellissier , François Malgouyres , François Bachoc

Promising resolutions of the generalization puzzle observe that the actual number of parameters in a deep network is much smaller than naive estimates suggest. The renormalization group is a compelling example of a problem which has very…

Machine Learning · Computer Science 2020-12-08 Anita de Mello Koch , Ellen de Mello Koch , Robert de Mello Koch

We show how the success of deep learning could depend not only on mathematics but also on physics: although well-known mathematical theorems guarantee that neural networks can approximate arbitrary functions well, the class of functions of…

Disordered Systems and Neural Networks · Physics 2017-09-13 Henry W. Lin , Max Tegmark , David Rolnick

It has been empirically observed that the flatness of minima obtained from training deep networks seems to correlate with better generalization. However, for deep networks with positively homogeneous activations, most measures of…

Machine Learning · Statistics 2019-02-08 Akshay Rangamani , Nam H. Nguyen , Abhishek Kumar , Dzung Phan , Sang H. Chin , Trac D. Tran

The pursuit of explaining and improving generalization in deep learning has elicited efforts both in regularization techniques as well as visualization techniques of the loss surface geometry. The latter is related to the intuition…

Machine Learning · Computer Science 2019-07-23 Vinay Uday Prabhu , Dian Ang Yap , Joyce Xu , John Whaley