English
Related papers

Related papers: Generalization at the Edge of Stability

200 papers

Recent works have shown that on sufficiently over-parametrized neural nets, gradient descent with relatively large initialization optimizes a prediction function in the RKHS of the Neural Tangent Kernel (NTK). This analysis leads to global…

Machine Learning · Statistics 2020-04-28 Colin Wei , Jason D. Lee , Qiang Liu , Tengyu Ma

Understanding generalization in deep neural networks is an active area of research. A promising avenue of exploration has been that of margin measurements: the shortest distance to the decision boundary for a given sample or that sample's…

Machine Learning · Computer Science 2024-05-29 Coenraad Mouton

Many modern learning tasks involve fitting nonlinear models to data which are trained in an overparameterized regime where the parameters of the model exceed the size of the training dataset. Due to this overparameterization, the training…

Machine Learning · Computer Science 2018-12-27 Samet Oymak , Mahdi Soltanolkotabi

Recent studies showed that the generalization of neural networks is correlated with the sharpness of the loss landscape, and flat minima suggests a better generalization ability than sharp minima. In this paper, we propose a novel method…

Machine Learning · Computer Science 2024-05-24 Yuyan Zhou , Ye Li , Lei Feng , Sheng-Jun Huang

In this paper, we study the implicit regularization of stochastic gradient descent (SGD) through the lens of {\em dynamical stability} (Wu et al., 2018). We start by revising existing stability analyses of SGD, showing how the Frobenius…

Machine Learning · Statistics 2023-06-02 Lei Wu , Weijie J. Su

This article studies the dynamics of the mean-field approximation of continuous random networks. These networks are stochastic integrodifferential equations driven by Gaussian noise. The kernels in the integral operators are realizations of…

Disordered Systems and Neural Networks · Physics 2025-02-04 W. A. Zúñiga-Galindo

In this work, we unify several expected generalization error bounds based on random subsets using the framework developed by Hellstr\"om and Durisi [1]. First, we recover the bounds based on the individual sample mutual information from Bu…

Information Theory · Computer Science 2021-07-27 Borja Rodríguez-Gálvez , Germán Bassi , Ragnar Thobaben , Mikael Skoglund

Recent progress has been made in understanding optimisation dynamics in neural networks trained with full-batch gradient descent with momentum with the uncovering of the edge of stability phenomenon in supervised learning. The edge of…

Machine Learning · Computer Science 2023-07-11 Rares Iordan , Marc Peter Deisenroth , Mihaela Rosca

In this paper, we derive a PAC-Bayes bound on the generalisation gap, in a supervised time-series setting for a special class of discrete-time non-linear dynamical systems. This class includes stable recurrent neural networks (RNN), and the…

Machine Learning · Computer Science 2024-04-12 Deividas Eringis , John Leth , Zheng-Hua Tan , Rafal Wisniewski , Mihaly Petreczky

Recently, researchers observed that gradient descent for deep neural networks operates in an ``edge-of-stability'' (EoS) regime: the sharpness (maximum eigenvalue of the Hessian) is often larger than stability threshold $2/\eta$ (where…

Machine Learning · Computer Science 2023-02-22 Xingyu Zhu , Zixuan Wang , Xiang Wang , Mo Zhou , Rong Ge

Uniform stability of a learning algorithm is a classical notion of algorithmic stability introduced to derive high-probability bounds on the generalization error (Bousquet and Elisseeff, 2002). Specifically, for a loss function with range…

Machine Learning · Computer Science 2019-03-19 Vitaly Feldman , Jan Vondrak

The mean field (MF) theory of multilayer neural networks centers around a particular infinite-width scaling, where the learning dynamics is closely tracked by the MF limit. A random fluctuation around this infinite-width limit is expected…

Machine Learning · Computer Science 2021-11-01 Huy Tuan Pham , Phan-Minh Nguyen

In this paper we present a novel quasi-Newton algorithm for use in stochastic optimisation. Quasi-Newton methods have had an enormous impact on deterministic optimisation problems because they afford rapid convergence and computationally…

Systems and Control · Electrical Eng. & Systems 2019-09-04 Adrian Wills , Thomas Schön

We study the generalization behavior of Markov Logic Networks (MLNs) across relational structures of different sizes. Multiple works have noticed that MLNs learned on a given domain generalize poorly across domains of different sizes. This…

Artificial Intelligence · Computer Science 2024-06-04 Florian Chen , Felix Weitkämper , Sagar Malhotra

Neural networks typically generalize well when fitting the data perfectly, even though they are heavily overparameterized. Many factors have been pointed out as the reason for this phenomenon, including an implicit bias of stochastic…

Machine Learning · Computer Science 2025-02-04 Amit Peleg , Matthias Hein

We explore in some detail the notion of algorithmic stability as a viable framework for analyzing the generalization error of learning algorithms. We introduce the new notion of training stability of a learning algorithm and show that, in a…

Machine Learning · Computer Science 2013-01-07 Samuel Kutin , Partha Niyogi

What enables Stochastic Gradient Descent (SGD) to achieve better generalization than Gradient Descent (GD) in Neural Network training? This question has attracted much attention. In this paper, we study the distribution of the Stochastic…

Machine Learning · Computer Science 2019-10-28 Abhishek Panigrahi , Raghav Somani , Navin Goyal , Praneeth Netrapalli

In the era of large-scale neural network models, optimization algorithms often struggle with generalization due to an overreliance on training loss. One key insight widely accepted in the machine learning community is the idea that wide…

Machine Learning · Computer Science 2025-09-01 Bodu Gong , Gustavo Enrique Batista , Pierre Lafaye de Micheaux

In some settings neural networks exhibit a phenomenon known as \textit{grokking}, where they achieve perfect or near-perfect accuracy on the validation set long after the same performance has been achieved on the training set. In this…

Machine Learning · Computer Science 2024-04-02 Jack Miller , Charles O'Neill , Thang Bui

The algorithms used to train neural networks, like stochastic gradient descent (SGD), have close parallels to natural processes that navigate a high-dimensional parameter space -- for example protein folding or evolution. Our study uses a…

Machine Learning · Computer Science 2023-06-07 Shishir Adhikari , Alkan Kabakçıoğlu , Alexander Strang , Deniz Yuret , Michael Hinczewski