English
Related papers

Related papers: Derivatives of Stochastic Gradient Descent in para…

200 papers

Stochastic approximation (SA) and stochastic gradient descent (SGD) algorithms are work-horses for modern machine learning algorithms. Their constant stepsize variants are preferred in practice due to fast convergence behavior. However,…

Machine Learning · Computer Science 2021-11-12 Zaiwei Chen , Shancong Mou , Siva Theja Maguluri

Modern machine learning focuses on highly expressive models that are able to fit or interpolate the data completely, resulting in zero training loss. For such models, we show that the stochastic gradients of common loss functions satisfy a…

Machine Learning · Computer Science 2019-04-09 Sharan Vaswani , Francis Bach , Mark Schmidt

We introduce a general framework for nonlinear stochastic gradient descent (SGD) for the scenarios when gradient noise exhibits heavy tails. The proposed framework subsumes several popular nonlinearity choices, like clipped, normalized,…

Optimization and Control · Mathematics 2022-04-07 Dusan Jakovetic , Dragana Bajovic , Anit Kumar Sahu , Soummya Kar , Nemanja Milosevic , Dusan Stamenkovic

A variant of consensus based distributed gradient descent (\textbf{DGD}) is studied for finite sums of smooth but possibly non-convex functions. In particular, the local gradient term in the fixed step-size iteration of each agent is…

Optimization and Control · Mathematics 2026-05-27 Lei Qin , Michael Cantoni , Ye Pu

We give a new separation result between the generalization performance of stochastic gradient descent (SGD) and of full-batch gradient descent (GD) in the fundamental stochastic convex optimization model. While for SGD it is well-known that…

Machine Learning · Computer Science 2021-07-01 Idan Amir , Tomer Koren , Roi Livni

Iterative procedures for parameter estimation based on stochastic gradient descent allow the estimation to scale to massive data sets. However, in both theory and practice, they suffer from numerical instability. Moreover, they are…

Methodology · Statistics 2016-06-08 Panos Toulis , Dustin Tran , Edoardo M. Airoldi

As one of the most fundamental stochastic optimization algorithms, stochastic gradient descent (SGD) has been intensively developed and extensively applied in machine learning in the past decade. There have been some modified SGD-type…

Machine Learning · Computer Science 2022-01-28 Ruinan Jin , Yu Xing , Xingkang He

We consider smooth stochastic convex optimization problems in the context of algorithms which are based on directional derivatives of the objective function. This context can be considered as an intermediate one between derivative-free…

Optimization and Control · Mathematics 2020-09-22 Pavel Dvurechensky , Eduard Gorbunov , Alexander Gasnikov

Stochastic gradient descent (SGD) gives an optimal convergence rate when minimizing convex stochastic objectives $f(x)$. However, in terms of making the gradients small, the original SGD does not give an optimal rate, even when $f(x)$ is…

Machine Learning · Computer Science 2021-07-30 Zeyuan Allen-Zhu

Recent research has observed that in machine learning optimization, gradient descent (GD) often operates at the edge of stability (EoS) [Cohen, et al., 2021], where the stepsizes are set to be large, resulting in non-monotonic losses…

Machine Learning · Computer Science 2023-10-17 Jingfeng Wu , Vladimir Braverman , Jason D. Lee

In this paper, we provide a comprehensive theoretical analysis of Stochastic Gradient Descent (SGD) and its momentum variants (Polyak Heavy-Ball and Nesterov) for tracking time-varying optima under strong convexity and smoothness. Our…

Machine Learning · Statistics 2026-05-20 Sharan Sahu , Cameron J. Hogan , Martin T. Wells

We study the generalization performance of gradient methods in the fundamental stochastic convex optimization setting, focusing on its dimension dependence. First, for full-batch gradient descent (GD) we give a construction of a learning…

Machine Learning · Computer Science 2024-01-23 Matan Schliserman , Uri Sherman , Tomer Koren

A framework is introduced for solving a sequence of slowly changing optimization problems, including those arising in regression and classification applications, using optimization algorithms such as stochastic gradient descent (SGD). The…

Machine Learning · Computer Science 2015-09-25 Craig Wilson , Venugopal V. Veeravalli

Stochastic Gradient Descent (SGD) based training of neural networks with a large learning rate or a small batch-size typically ends in well-generalizing, flat regions of the weight space, as indicated by small eigenvalues of the Hessian of…

Machine Learning · Statistics 2019-12-24 Stanisław Jastrzębski , Zachary Kenton , Nicolas Ballas , Asja Fischer , Yoshua Bengio , Amos Storkey

Uniform stability is a notion of algorithmic stability that bounds the worst case change in the model output by the algorithm when a single data point in the dataset is replaced. An influential work of Hardt et al. (2016) provides strong…

Machine Learning · Computer Science 2020-06-15 Raef Bassily , Vitaly Feldman , Cristóbal Guzmán , Kunal Talwar

Stochastic gradient descent (SGD) provides a simple and efficient way to solve a broad range of machine learning problems. Here, we focus on distribution regression (DR), involving two stages of sampling: Firstly, we regress from…

Machine Learning · Statistics 2021-03-08 Nicole Mücke

We analyze the complexity of biased stochastic gradient methods (SGD), where individual updates are corrupted by deterministic, i.e. biased error terms. We derive convergence results for smooth (non-convex) functions and give improved rates…

Machine Learning · Computer Science 2021-05-11 Ahmad Ajalloeian , Sebastian U. Stich

Stochastic gradient descent (SGD) algorithm is the method of choice in many machine learning tasks thanks to its scalability and efficiency in dealing with large-scale problems. In this paper, we focus on the shuffling version of SGD which…

Machine Learning · Computer Science 2023-10-27 Lam M. Nguyen , Trang H. Tran

Stochastic optimization methods have been hugely successful in making large-scale optimization problems feasible when computing the full gradient is computationally prohibitive. Using the theory of modified equations for numerical…

Optimization and Control · Mathematics 2023-09-06 Stefano Di Giovacchino , Desmond J. Higham , Konstantinos Zygalakis

Stochastic gradient descent (SGD) is the workhorse of large-scale learning, yet classical analyses rely on assumptions that can be either too strong (bounded variance) or too coarse (uniform noise). The expected smoothness (ES) condition…

Machine Learning · Computer Science 2025-10-28 Yuta Kawamoto , Hideaki Iiduka