English
Related papers

Related papers: First Exit Time Analysis of Stochastic Gradient De…

200 papers

We propose a new framework, inspired by random matrix theory, for analyzing the dynamics of stochastic gradient descent (SGD) when both number of samples and dimensions are large. This framework applies to any fixed stepsize and the finite…

Optimization and Control · Mathematics 2021-02-09 Courtney Paquette , Kiwon Lee , Fabian Pedregosa , Elliot Paquette

We consider stochastic optimization problems where the objective depends on some parameter, as commonly found in hyperparameter optimization for instance. We investigate the behavior of the derivatives of the iterates of Stochastic Gradient…

Optimization and Control · Mathematics 2024-11-21 Franck Iutzeler , Edouard Pauwels , Samuel Vaiter

Stochastic Gradient Descent (SGD) is a fundamental algorithm in machine learning, representing the optimization backbone for training several classic models, from regression to neural networks. Given the recent practical focus on…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-25 Dan Alistarh , Christopher De Sa , Nikola Konstantinov

Stochastic gradient descent~(SGD) and its variants have been the dominating optimization methods in machine learning. Compared to SGD with small-batch training, SGD with large-batch training can better utilize the computational power of…

Machine Learning · Statistics 2024-04-16 Shen-Yi Zhao , Chang-Wei Shi , Yin-Peng Xie , Wu-Jun Li

Modern deep networks are trained with stochastic gradient descent (SGD) whose key hyperparameters are the number of data considered at each step or batch size $B$, and the step size or learning rate $\eta$. For small $B$ and large $\eta$,…

Machine Learning · Computer Science 2024-02-29 Antonio Sclocchi , Matthieu Wyart

Stochastic gradient descent (SGD) is widely used in machine learning. Although being commonly viewed as a fast but not accurate version of gradient descent (GD), it always finds better solutions than GD for modern neural networks. In order…

Machine Learning · Computer Science 2018-08-17 Robert Kleinberg , Yuanzhi Li , Yang Yuan

In this paper, we investigate the impact of stochasticity and large stepsizes on the implicit regularisation of gradient descent (GD) and stochastic gradient descent (SGD) over diagonal linear networks. We prove the convergence of GD and…

Machine Learning · Computer Science 2023-10-26 Mathieu Even , Scott Pesme , Suriya Gunasekar , Nicolas Flammarion

This article suggests that deterministic Gradient Descent, which does not use any stochastic gradient approximation, can still exhibit stochastic behaviors. In particular, it shows that if the objective function exhibit multiscale…

Machine Learning · Computer Science 2020-11-03 Lingkai Kong , Molei Tao

We consider a class of stochastic smooth convex optimization problems under rather general assumptions on the noise in the stochastic gradient observation. As opposed to the classical problem setting in which the variance of noise is…

Optimization and Control · Mathematics 2024-08-23 Sasila Ilandarideva , Anatoli Juditsky , Guanghui Lan , Tianjiao Li

Stochastic Gradient Descent (SGD) is a popular tool in training large-scale machine learning models. Its performance, however, is highly variable, depending crucially on the choice of the step sizes. Accordingly, a variety of strategies for…

Machine Learning · Statistics 2021-06-11 Xiaoyu Li , Zhenxun Zhuang , Francesco Orabona

In Deep Learning, Stochastic Gradient Descent (SGD) is usually selected as a training method because of its efficiency; however, recently, a problem in SGD gains research interest: sharp minima in Deep Neural Networks (DNNs) have poor…

Machine Learning · Computer Science 2018-12-04 Wei Wen , Yandan Wang , Feng Yan , Cong Xu , Chunpeng Wu , Yiran Chen , Hai Li

We study Stochastic Gradient Descent with AdaGrad stepsizes: a popular adaptive (self-tuning) method for first-order stochastic optimization. Despite being well studied, existing analyses of this method suffer from various shortcomings:…

Machine Learning · Computer Science 2023-06-13 Amit Attia , Tomer Koren

Cyclic and randomized stepsizes are widely used in the deep learning practice and can often outperform standard stepsize choices such as constant stepsize in SGD. Despite their empirical success, not much is currently known about when and…

Machine Learning · Statistics 2023-08-30 Mert Gürbüzbalaban , Yuanhan Hu , Umut Şimşekli , Lingjiong Zhu

In distributed training of deep neural networks, people usually run Stochastic Gradient Descent (SGD) or its variants on each machine and communicate with other machines periodically. However, SGD might converge slowly in training some deep…

Machine Learning · Computer Science 2022-10-14 Mingrui Liu , Zhenxun Zhuang , Yunwei Lei , Chunyang Liao

While significant theoretical progress has been achieved, unveiling the generalization mystery of overparameterized neural networks still remains largely elusive. In this paper, we study the generalization behavior of shallow neural…

Machine Learning · Computer Science 2022-09-21 Yunwen Lei , Rong Jin , Yiming Ying

Stochastic first-order methods such as Stochastic Extragradient (SEG) or Stochastic Gradient Descent-Ascent (SGDA) for solving smooth minimax problems and, more generally, variational inequality problems (VIP) have been gaining a lot of…

Optimization and Control · Mathematics 2022-11-02 Eduard Gorbunov , Marina Danilova , David Dobre , Pavel Dvurechensky , Alexander Gasnikov , Gauthier Gidel

Continuous-time models provide important insights into the training dynamics of optimization algorithms in deep learning. In this work, we establish a non-asymptotic convergence analysis of stochastic gradient Langevin dynamics (SGLD),…

Machine Learning · Computer Science 2026-01-30 Noah Oberweis , Semih Cayci

Understanding the implicit bias of Stochastic Gradient Descent (SGD) is one of the key challenges in deep learning, especially for overparametrized models, where the local minimizers of the loss function $L$ can form a manifold.…

Machine Learning · Computer Science 2022-07-29 Zhiyuan Li , Tianhao Wang , Sanjeev Arora

Large-batch stochastic gradient descent (SGD) is widely used for training in distributed deep learning because of its training-time efficiency, however, extremely large-batch SGD leads to poor generalization and easily converges to sharp…

Machine Learning · Computer Science 2019-06-27 Kosuke Haruki , Taiji Suzuki , Yohei Hamakawa , Takeshi Toda , Ryuji Sakai , Masahiro Ozawa , Mitsuhiro Kimura

Stochastic gradient methods are central to large-scale learning, yet their generalization theory typically relies on independent sampling assumptions. In many practical applications, data are generated by Markov chains and learning is…

Machine Learning · Computer Science 2026-05-05 Jiahuan Wang , Ziqing Wen , Ping Luo , Dongsheng Li , Tao Sun