English
Related papers

Related papers: Spectral alignment of stochastic gradient descent …

200 papers

Understanding the training dynamics of deep neural networks is challenging due to their high-dimensional nature and intricate loss landscapes. Recent studies have revealed that, along the training trajectory, the gradient approximately…

Machine Learning · Computer Science 2025-03-12 Minhak Song , Kwangjun Ahn , Chulhee Yun

Despite the non-convex optimization landscape, over-parametrized shallow networks are able to achieve global convergence under gradient descent. The picture can be radically different for narrow networks, which tend to get stuck in…

Machine Learning · Statistics 2023-06-16 Rodrigo Veiga , Ludovic Stephan , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

Stochastic gradient descent (SGD) is widely used in deep learning due to its computational efficiency, but a complete understanding of why SGD performs so well remains a major challenge. It has been observed empirically that most…

Machine Learning · Statistics 2022-06-20 Carmina Fjellström , Kaj Nyström

While stochastic gradient descent (SGD) and variants have been surprisingly successful for training deep nets, several aspects of the optimization dynamics and generalization are still not well understood. In this paper, we present new…

Machine Learning · Computer Science 2019-07-26 Xinyan Li , Qilong Gu , Yingxue Zhou , Tiancong Chen , Arindam Banerjee

Stochastic gradient descent (SGD) forms the core optimization method for deep neural networks. While some theoretical progress has been made, it still remains unclear why SGD leads the learning dynamics in overparameterized networks to…

Machine Learning · Computer Science 2019-10-30 Mingwei Wei , David J Schwab

Deep neural networks achieve stellar generalisation even when they have enough parameters to easily fit all their training data. We study this phenomenon by analysing the dynamics and the performance of over-parameterised two-layer neural…

Machine Learning · Statistics 2022-03-28 Sebastian Goldt , Madhu S. Advani , Andrew M. Saxe , Florent Krzakala , Lenka Zdeborová

This paper presents a comprehensive study on the convergence rates of the stochastic gradient descent (SGD) algorithm when applied to overparameterized two-layer neural networks. Our approach combines the Neural Tangent Kernel (NTK)…

Machine Learning · Statistics 2024-07-11 Dinghao Cao , Zheng-Chu Guo , Lei Shi

We analyze the dynamics of streaming stochastic gradient descent (SGD) in the high-dimensional limit when applied to generalized linear models and multi-index models (e.g. logistic regression, phase retrieval) with general data-covariance.…

Optimization and Control · Mathematics 2023-08-21 Elizabeth Collins-Woodfin , Courtney Paquette , Elliot Paquette , Inbar Seroussi

This manuscript investigates the one-pass stochastic gradient descent (SGD) dynamics of a two-layer neural network trained on Gaussian data and labels generated by a similar, though not necessarily identical, target function. We rigorously…

Machine Learning · Statistics 2023-02-14 Luca Arnaboldi , Ludovic Stephan , Florent Krzakala , Bruno Loureiro

Neural networks are usually trained by some form of stochastic gradient descent (SGD)). A number of strategies are in common use intended to improve SGD optimization, such as learning rate schedules, momentum, and batching. These are…

Neural and Evolutionary Computing · Computer Science 2015-08-13 Thomas M. Breuel

Stochastic gradient descent (SGD) is widely believed to perform implicit regularization when used to train deep neural networks, but the precise manner in which this occurs has thus far been elusive. We prove that SGD minimizes an average…

Machine Learning · Computer Science 2018-01-17 Pratik Chaudhari , Stefano Soatto

We show that in a variety of large-scale deep learning scenarios the gradient dynamically converges to a very small subspace after a short period of training. The subspace is spanned by a few top eigenvectors of the Hessian (equal to the…

Machine Learning · Computer Science 2018-12-13 Guy Gur-Ari , Daniel A. Roberts , Ethan Dyer

Recent work has highlighted a surprising alignment between gradients and the top eigenspace of the Hessian -- termed the Dominant subspace -- during neural network training. Concurrently, there has been growing interest in the distinct…

Machine Learning · Computer Science 2025-05-20 Daniyar Zakarin , Sidak Pal Singh

Stochastic gradient descent (SGD) is a widely used algorithm in machine learning, particularly for neural network training. Recent studies on SGD for canonical quadratic optimization or linear regression show it attains well generalization…

Machine Learning · Computer Science 2024-09-17 Haihan Zhang , Yuanshi Liu , Qianwen Chen , Cong Fang

We analyze in a closed form the learning dynamics of stochastic gradient descent (SGD) for a single-layer neural network classifying a high-dimensional Gaussian mixture where each cluster is assigned one of two labels. This problem provides…

Machine Learning · Computer Science 2022-03-28 Francesca Mignacco , Florent Krzakala , Pierfrancesco Urbani , Lenka Zdeborová

We develop a framework for analyzing the training and learning rate dynamics on a variety of high- dimensional optimization problems trained using one-pass stochastic gradient descent (SGD) with data generated from multiple anisotropic…

Machine Learning · Statistics 2025-10-17 Elizabeth Collins-Woodfin , Inbar Seroussi

Stochastic gradients for deep neural networks exhibit strong correlations along the optimization trajectory, and are often aligned with a small set of Hessian eigenvectors associated with outlier eigenvalues. Recent work shows that…

Machine Learning · Computer Science 2026-02-04 Julien Nicolas , Mohamed Maouche , Sonia Ben Mokhtar , Mark Coates

Recent work has established an empirically successful framework for adapting learning rates for stochastic gradient descent (SGD). This effectively removes all needs for tuning, while automatically reducing learning rates over time on…

Machine Learning · Computer Science 2013-03-28 Tom Schaul , Yann LeCun

Stochastic gradient descent (SGD) is a pillar of modern machine learning, serving as the go-to optimization algorithm for a diverse array of problems. While the empirical success of SGD is often attributed to its computational efficiency…

Machine Learning · Statistics 2022-06-16 Courtney Paquette , Elliot Paquette , Ben Adlam , Jeffrey Pennington

This study investigates leveraging stochastic gradient descent (SGD) to learn operators between general Hilbert spaces. We propose weak and strong regularity conditions for the target operator to depict its intrinsic structure and…

Machine Learning · Statistics 2026-01-13 Lei Shi , Jia-Qi Yang
‹ Prev 1 2 3 10 Next ›