English
Related papers

Related papers: Escaping Saddle Points with Adaptive Gradient Meth…

200 papers

In recent centralized nonconvex distributed learning and federated learning, local methods are one of the promising approaches to reduce communication time. However, existing work has mainly focused on studying first-order optimality…

Machine Learning · Computer Science 2022-10-13 Tomoya Murata , Taiji Suzuki

Several recently proposed stochastic optimization methods that have been successfully used in training deep networks such as RMSProp, Adam, Adadelta, Nadam are based on using gradient updates scaled by square roots of exponential moving…

Machine Learning · Computer Science 2019-04-22 Sashank J. Reddi , Satyen Kale , Sanjiv Kumar

Through theoretical and experimental validation, unlike all existing adaptive methods like Adam which penalize frequently-changing parameters and are only applicable to sparse gradients, we propose the simplest SGD enhanced method,…

Machine Learning · Computer Science 2023-10-04 Gongyue Zhang , Dinghuang Zhang , Shuwen Zhao , Donghan Liu , Carrie M. Toptan , Honghai Liu

We introduce Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments. The method is straightforward to implement, is computationally efficient, has…

Machine Learning · Computer Science 2017-01-31 Diederik P. Kingma , Jimmy Ba

We propose NovoGrad, an adaptive stochastic gradient descent method with layer-wise gradient normalization and decoupled weight decay. In our experiments on neural networks for image classification, speech recognition, machine translation,…

We present the remote stochastic gradient (RSG) method, which computes the gradients at configurable remote observation points, in order to improve the convergence rate and suppress gradient noise at the same time for different curvatures.…

Machine Learning · Computer Science 2020-09-08 Yushu Chen , Hao Jing , Wenlai Zhao , Zhiqiang Liu , Ouyi Li , Liang Qiao , Wei Xue , Guangwen Yang

Stochastic gradient algorithms have been the main focus of large-scale learning problems and they led to important successes in machine learning. The convergence of SGD depends on the careful choice of learning rate and the amount of the…

Machine Learning · Computer Science 2015-11-03 Caglar Gulcehre , Marcin Moczulski , Yoshua Bengio

Adam is widely adopted in practical applications due to its fast convergence. However, its theoretical analysis is still far from satisfactory. Existing convergence analyses for Adam rely on the bounded smoothness assumption, referred to as…

Machine Learning · Computer Science 2024-06-25 Bohan Wang , Yushun Zhang , Huishuai Zhang , Qi Meng , Ruoyu Sun , Zhi-Ming Ma , Tie-Yan Liu , Zhi-Quan Luo , Wei Chen

Two-point zeroth order methods are important in many applications of zeroth-order optimization, such as robotics, wind farms, power systems, online optimization, and adversarial robustness to black-box attacks in deep neural networks, where…

Optimization and Control · Mathematics 2023-05-10 Zhaolin Ren , Yujie Tang , Na Li

Although adaptive optimization algorithms such as Adam show fast convergence in many machine learning tasks, this paper identifies a problem of Adam by analyzing its performance in a simple non-convex synthetic problem, showing that Adam's…

Machine Learning · Computer Science 2020-05-06 Wenjie Li , Zhaoyang Zhang , Xinjiang Wang , Ping Luo

Adaptive learning rate methods have been successfully applied in many fields, especially in training deep neural networks. Recent results have shown that adaptive methods with exponential increasing weights on squared past gradients (i.e.,…

Machine Learning · Computer Science 2021-01-05 Hui Zhong , Zaiyi Chen , Chuan Qin , Zai Huang , Vincent W. Zheng , Tong Xu , Enhong Chen

Training deep neural networks is challenging. To accelerate training and enhance performance, we propose PadamP, a novel optimization algorithm. PadamP is derived by applying the adaptive estimation of the p-th power of the second-order…

Optimization and Control · Mathematics 2025-03-14 Yongqi Li , Xiaowei Zhang

An algorithm is said to be adaptive to a certain parameter (of the problem) if it does not need a priori knowledge of such a parameter but performs competitively to those that know it. This dissertation presents our work on adaptive…

Machine Learning · Computer Science 2023-07-10 Zhenxun Zhuang

We prove local convergence of several notable gradient descent algorithms used in machine learning, for which standard stochastic gradient descent theory does not apply directly. This includes, first, online algorithms for recurrent models…

Dynamical Systems · Mathematics 2021-01-11 Pierre-Yves Massé , Yann Ollivier

In this paper, we provide a rigorous proof of convergence of the Adaptive Moment Estimate (Adam) algorithm for a wide class of optimization objectives. Despite the popularity and efficiency of the Adam algorithm in training deep neural…

Optimization and Control · Mathematics 2023-11-08 Haochuan Li , Alexander Rakhlin , Ali Jadbabaie

Loss spikes commonly emerge during neural network training with the Adam optimizer across diverse architectures and scales, yet their underlying mechanism remains elusive. While previous explanations attribute these phenomena to sharper…

Machine Learning · Computer Science 2026-05-26 Zhiwei Bai , Zhangchen Zhou , Jiajie Zhao , Xiaolong Li , Zhiyu Li , Feiyu Xiong , Hongkang Yang , Yaoyu Zhang , Zhi-Qin John Xu

The alternating gradient descent (AGD) is a simple but popular algorithm which has been applied to problems in optimization, machine learning, data ming, and signal processing, etc. The algorithm updates two blocks of variables in an…

Optimization and Control · Mathematics 2018-03-01 Songtao Lu , Mingyi Hong , Zhengdao Wang

Transformers are difficult to optimize with stochastic gradient descent (SGD) and largely rely on adaptive optimizers such as Adam. Despite their empirical success, the reasons behind Adam's superior performance over SGD remain poorly…

Machine Learning · Computer Science 2026-02-19 Akiyoshi Tomihari , Issei Sato

Stochastic gradient descent (SGD) has taken the stage as the primary workhorse for large-scale machine learning. It is often used with its adaptive variants such as AdaGrad, Adam, and AMSGrad. This paper proposes an adaptive stochastic…

Machine Learning · Computer Science 2021-01-01 Tianyi Chen , Ziye Guo , Yuejiao Sun , Wotao Yin

The vast majority of successful deep neural networks are trained using variants of stochastic gradient descent (SGD) algorithms. Recent attempts to improve SGD can be broadly categorized into two approaches: (1) adaptive learning rate…

Machine Learning · Computer Science 2019-12-04 Michael R. Zhang , James Lucas , Geoffrey Hinton , Jimmy Ba