English
Related papers

Related papers: SVRG Meets AdaGrad: Painless Variance Reduction

200 papers

In decentralized learning, a network of nodes cooperate to minimize an overall objective function that is usually the finite-sum of their local objectives, and incorporates a non-smooth regularization term for the better generalization…

Machine Learning · Computer Science 2022-01-25 Xuanjie Li , Yuedong Xu , Jessie Hui Wang , Xin Wang , John C. S. Lui

Stochastic variance-reduced gradient (SVRG) algorithms have been shown to work favorably in solving large-scale learning problems. Despite the remarkable success, the stochastic gradient complexity of SVRG-type algorithms usually scales…

Machine Learning · Computer Science 2020-09-22 Pan Zhou , Xiaotong Yuan

In this paper, we study decentralized empirical risk minimization problems, where the goal is to minimize a finite-sum of smooth and strongly-convex functions available over a network of nodes. In this Part I, we propose…

Optimization and Control · Mathematics 2019-12-12 Ran Xin , Usman A. Khan , Soummya Kar

Consider composite nonconvex optimization problems where the objective function consists of a smooth nonconvex term (with Lipschitz-continuous gradient) and a convex (possibly nonsmooth) term. Existing parameter-free methods for such…

Optimization and Control · Mathematics 2025-10-08 Zilong Ye , Shiqian Ma , Junfeng Yang , Danqing Zhou

The stochastic gradient descent (SGD) method is a widely used approach for solving stochastic optimization problems, but its convergence is typically slow. Existing variance reduction techniques, such as SAGA, improve convergence by…

Optimization and Control · Mathematics 2025-11-21 Fabio Nobile , Matteo Raviola , Nathan Schaeffer

Adaptive gradient methods like AdaGrad are widely used in optimizing neural networks. Yet, existing convergence guarantees for adaptive gradient methods require either convexity or smoothness, and, in the smooth setting, only guarantee…

Machine Learning · Computer Science 2019-10-22 Xiaoxia Wu , Simon S. Du , Rachel Ward

This paper explores the non-convex composition optimization in the form including inner and outer finite-sum functions with a large number of component functions. This problem arises in some important applications such as nonlinear…

Machine Learning · Statistics 2017-11-15 Liu Liu , Ji Liu , Dacheng Tao

Alternating Direction Method of Multipliers (ADMM) is a popular method for solving large-scale Machine Learning problems. Stochastic ADMM was proposed to reduce the per iteration computational complexity, which is more suitable for big data…

Numerical Analysis · Computer Science 2023-04-25 Chao Zhang , Zebang Shen , Hui Qian , Tengfei Zhou , Jianya Zhou , Jianying Zhou

Stochastic variance-reduced gradient (SVRG) is a classical optimization method. Although it is theoretically proved to have better convergence performance than stochastic gradient descent (SGD), the generalization performance of SVRG…

Machine Learning · Statistics 2019-08-20 Hao Jin , Dachao Lin , Zhihua Zhang

Stochastic gradient descent is the method of choice for large scale optimization of machine learning objective functions. Yet, its performance is greatly variable and heavily depends on the choice of the stepsizes. This has motivated a…

Machine Learning · Statistics 2019-02-28 Xiaoyu Li , Francesco Orabona

Current state-of-the-art optimizers are adaptive gradient-based optimization methods such as Adam. Recently, there has been an increasing interest in formulating gradient-based optimizers in a probabilistic framework for better modeling the…

Machine Learning · Computer Science 2025-04-21 Haotian Chen , Anna Kuzina , Babak Esmaeili , Jakub M Tomczak

Stochastic gradient methods for machine learning and optimization problems are usually analyzed assuming data points are sampled \emph{with} replacement. In practice, however, sampling \emph{without} replacement is very common, easier to…

Machine Learning · Computer Science 2016-10-18 Ohad Shamir

Stochastic-gradient-based optimization has been a core enabling methodology in applications to large-scale problems in machine learning and related areas. Despite the progress, the gap between theory and practice remains significant, with…

Optimization and Control · Mathematics 2021-01-01 Lihua Lei , Michael I. Jordan

This paper investigates different vector step-size adaptation approaches for non-stationary online, continual prediction problems. Vanilla stochastic gradient descent can be considerably improved by scaling the update with a vector of…

Machine Learning · Computer Science 2019-12-16 Andrew Jacobsen , Matthew Schlegel , Cameron Linke , Thomas Degris , Adam White , Martha White

Reducing the variance of the gradient estimator is known to improve the convergence rate of stochastic gradient-based optimization and sampling algorithms. One way of achieving variance reduction is to design importance sampling strategies.…

Machine Learning · Computer Science 2021-03-24 Ayoub El Hanchi , David A. Stephens

In this paper, we propose a vector transport-free stochastic variance reduced gradient (SVRG) method with general retraction for empirical risk minimization over Riemannian manifold. Existing SVRG methods on manifold usually consider a…

Optimization and Control · Mathematics 2017-05-26 Bo Jiang , Shiqian Ma , Anthony Man-Cho So , Shuzhong Zhang

Techniques for reducing the variance of gradient estimates used in stochastic programming algorithms for convex finite-sum problems have received a great deal of attention in recent years. By leveraging dissipativity theory from control, we…

Optimization and Control · Mathematics 2018-06-12 Bin Hu , Stephen Wright , Laurent Lessard

Recent advances in deep reinforcement learning have achieved human-level performance on a variety of real-world applications. However, the current algorithms still suffer from poor gradient estimation with excessive variance, resulting in…

Machine Learning · Computer Science 2019-05-21 Wei-Ye Zhao , Xi-Ya Guan , Yang Liu , Xiaoming Zhao , Jian Peng

A novel approach is given to overcome the computational challenges of the full-matrix Adaptive Gradient algorithm (Full AdaGrad) in stochastic optimization. By developing a recursive method that estimates the inverse of the square root of…

Statistics Theory · Mathematics 2025-02-28 Antoine Godichon-Baggioni , Wei Lu , Bruno Portier

Most popular optimizers for deep learning can be broadly categorized as adaptive methods (e.g. Adam) and accelerated schemes (e.g. stochastic gradient descent (SGD) with momentum). For many models such as convolutional neural networks…

Machine Learning · Computer Science 2020-12-22 Juntang Zhuang , Tommy Tang , Yifan Ding , Sekhar Tatikonda , Nicha Dvornek , Xenophon Papademetris , James S. Duncan