English
Related papers

Related papers: Linearly convergent stochastic heavy ball method f…

200 papers

The adaptive stochastic gradient descent (SGD) with momentum has been widely adopted in deep learning as well as convex optimization. In practice, the last iterate is commonly used as the final solution to make decisions. However, the…

Machine Learning · Computer Science 2021-02-16 Wei Tao , Sheng Long , Gaowei Wu , Qing Tao

A stochastic gradient method for finite-sum minimization subject to deterministic linear constraints is proposed and analyzed. The procedure presented adapts the projected gradient method on convex set to the use of both a stochastic…

Optimization and Control · Mathematics 2026-05-19 Natasa Krklec Jerinkic , Benedetta Morini , Mahsa Yousefi

We analyze a batched variant of Stochastic Gradient Descent (SGD) with weighted sampling distribution for smooth and non-smooth objective functions. We show that by distributing the batches computationally, a significant speedup in the…

Numerical Analysis · Mathematics 2017-03-02 Deanna Needell , Rachel Ward

The stochastic gradient descent (SGD) optimization algorithm plays a central role in a series of machine learning applications. The scientific literature provides a vast amount of upper error bounds for the SGD method. Much less attention…

Numerical Analysis · Mathematics 2020-10-05 Arnulf Jentzen , Philippe von Wurstemberger

Recently, Stochastic Gradient Descent (SGD) and its variants have become the dominant methods in the large-scale optimization of machine learning (ML) problems. A variety of strategies have been proposed for tuning the step sizes, ranging…

Machine Learning · Computer Science 2022-08-02 Xiaoyu Li

This paper establishes global convergence and provides global bounds of the convergence rate of the Heavy-ball method for convex optimization problems. When the objective function has Lipschitz-continuous gradient, we show that the Cesaro…

Optimization and Control · Mathematics 2014-12-24 Euhanna Ghadimi , Hamid Reza Feyzmahdavian , Mikael Johansson

We investigate the Randomized Stochastic Accelerated Gradient (RSAG) method, utilizing either constant or adaptive step sizes, for stochastic optimization problems with generalized smooth objective functions. Under relaxed affine variance…

Optimization and Control · Mathematics 2025-02-25 Chenhao Yu , Yusu Hong , Junhong Lin

Heavy-Ball method (HB) is known for its simplicity in implementation and practical efficiency. However, as with other momentum methods, it has non-monotone behavior, and for optimal parameters, the method suffers from the so-called peak…

Optimization and Control · Mathematics 2021-11-11 Marina Danilova , Grigory Malinovsky

First-order stochastic methods for solving large-scale non-convex optimization problems are widely used in many big-data applications, e.g. training deep neural networks as well as other complex and potentially non-convex machine learning…

Machine Learning · Computer Science 2020-11-23 Matilde Gargiani , Andrea Zanelli , Quoc Tran-Dinh , Moritz Diehl , Frank Hutter

The article considers minimization of the expectation of convex function. Problems of this type often arise in machine learning and a number of other applications. In practice, stochastic gradient descent (SGD) and similar procedures are…

Optimization and Control · Mathematics 2020-11-10 Egor Gladin , Karina Zaynullina

In this contribution, we present a full overview of the continuous stochastic gradient (CSG) method, including convergence results, step size rules and algorithmic insights. We consider optimization problems in which the objective function…

Optimization and Control · Mathematics 2023-03-23 Max Grieshammer , Lukas Pflug , Michael Stingl , Andrian Uihlein

Stochastic Gradient Descent (SGD) is widely used in machine learning research. Previous convergence analyses of SGD under the vanishing step-size setting typically require Robbins-Monro conditions. However, in practice, a wider variety of…

Machine Learning · Computer Science 2025-04-18 Ruinan Jin , Difei Cheng , Hong Qiao , Xin Shi , Shaodong Liu , Bo Zhang

In this thesis, we propose new theoretical frameworks for the analysis of stochastic and distributed methods with error compensation and local updates. Using these frameworks, we develop more than 20 new optimization methods, including the…

Optimization and Control · Mathematics 2021-12-21 Eduard Gorbunov

Stochastic gradient descent (SGD) is a popular and efficient method with wide applications in training deep neural nets and other nonconvex models. While the behavior of SGD is well understood in the convex learning setting, the existing…

Machine Learning · Computer Science 2019-12-16 Yunwen Lei , Ting Hu , Guiying Li , Ke Tang

The proximal gradient algorithm for minimizing the sum of a smooth and a nonsmooth convex function often converges linearly even without strong convexity. One common reason is that a multiple of the step length at each iteration may…

Optimization and Control · Mathematics 2016-06-29 Dmitriy Drusvyatskiy , Adrian S. Lewis

We present a convergence rate analysis for biased stochastic gradient descent (SGD), where individual gradient updates are corrupted by computation errors. We develop stochastic quadratic constraints to formulate a small linear matrix…

Optimization and Control · Mathematics 2020-03-31 Bin Hu , Peter Seiler , Laurent Lessard

In this work, we propose an adaptive variation on the classical Heavy-ball method for convex quadratic minimization. The adaptivity crucially relies on so-called "Polyak step-sizes", which consists in using the knowledge of the optimal…

Optimization and Control · Mathematics 2022-10-13 Baptiste Goujaud , Adrien Taylor , Aymeric Dieuleveut

While momentum-based methods, in conjunction with stochastic gradient descent (SGD), are widely used when training machine learning models, there is little theoretical understanding on the generalization error of such methods. In this work,…

Machine Learning · Computer Science 2021-09-27 Ali Ramezani-Kebrya , Ashish Khisti , Ben Liang

A framework is introduced for sequentially solving convex stochastic minimization problems, where the objective functions change slowly, in the sense that the distance between successive minimizers is bounded. The minimization problems are…

Optimization and Control · Mathematics 2018-03-12 Craig Wilson , Venugopal Veeravalli , Angelia Nedich

The stochastic heavy ball method (SHB), also known as stochastic gradient descent (SGD) with Polyak's momentum, is widely used in training neural networks. However, despite the remarkable success of such algorithm in practice, its…

Machine Learning · Computer Science 2023-02-07 Diyuan Wu , Vyacheslav Kungurtsev , Marco Mondelli