English
Related papers

Related papers: Non-Convergence and Limit Cycles in the Adam optim…

200 papers

Nonconvex and nonsmooth optimization problems are frequently encountered in much of statistics, business, science and engineering, but they are not yet widely recognized as a technology in the sense of scalability. A reason for this…

Optimization and Control · Mathematics 2018-01-19 Bo Jiang , Tianyi Lin , Shiqian Ma , Shuzhong Zhang

We introduce a new method inspired by Adam that enhances convergence speed and achieves better loss function minima. Traditional optimizers, including Adam, apply uniform or globally adjusted learning rates across neural networks without…

Machine Learning · Computer Science 2024-11-01 Remi Genet , Hugo Inzirillo

Adaptive gradient methods are workhorses in deep learning. However, the convergence guarantees of adaptive gradient methods for nonconvex optimization have not been thoroughly studied. In this paper, we provide a fine-grained convergence…

Machine Learning · Computer Science 2024-06-21 Dongruo Zhou , Jinghui Chen , Yuan Cao , Ziyan Yang , Quanquan Gu

Nonconvex minimax problems appear frequently in emerging machine learning applications, such as generative adversarial networks and adversarial learning. Simple algorithms such as the gradient descent ascent (GDA) are the common practice…

Optimization and Control · Mathematics 2020-02-25 Junchi Yang , Negar Kiyavash , Niao He

Current deep neural networks are highly overparameterized (up to billions of connection weights) and nonlinear. Yet they can fit data almost perfectly through variants of gradient descent algorithms and achieve unexpected levels of…

In this paper, we focus on a theory-practice gap for Adam and its variants (AMSgrad, AdamNC, etc.). In practice, these algorithms are used with a constant first-order moment parameter $\beta_{1}$ (typically between $0.9$ and $0.99$). In…

Machine Learning · Statistics 2020-03-24 Ahmet Alacaoglu , Yura Malitsky , Panayotis Mertikopoulos , Volkan Cevher

Primal-dual methods for solving convex optimization problems with functional constraints often exhibit a distinct two-stage behavior. Initially, they converge towards a solution at a sublinear rate. Then, after a certain point, the method…

Optimization and Control · Mathematics 2026-02-12 Mateo Díaz , Pedro Izquierdo Lehmann , Haihao Lu , Jinwen Yang

The learning rate is a crucial hyperparameter in deep learning, with its ideal value depending on the problem and potentially changing during training. In this paper, we investigate the practical utility of adaptive learning rate mechanisms…

Machine Learning · Computer Science 2025-08-08 Asma Atamna , Tom Maus , Fabian Kievelitz , Tobias Glasmachers

Adaptive optimizers such as Adam have achieved great success in training large-scale models like large language models and diffusion models. However, they often generalize worse than non-adaptive methods, such as SGD on classical…

Machine Learning · Computer Science 2025-12-23 Yiheng Zhang , Shaowu Wu , Yuanzhuo Xu , Jiajun Wu , Shang Xu , Steve Drew , Xiaoguang Niu

This paper provides the first tight convergence analyses for RMSProp and Adam in non-convex optimization under the most relaxed assumptions of coordinate-wise generalized smoothness and affine noise variance. We first analyze RMSProp, which…

Machine Learning · Statistics 2025-03-11 Qi Zhang , Yi Zhou , Shaofeng Zou

This paper aims to clearly distinguish between Stochastic Gradient Descent with Momentum (SGDM) and Adam in terms of their convergence rates. We demonstrate that Adam achieves a faster convergence compared to SGDM under the condition of…

Machine Learning · Computer Science 2024-03-25 Bohan Wang , Huishuai Zhang , Qi Meng , Ruoyu Sun , Zhi-Ming Ma , Wei Chen

To the best of our knowledge, for the first time, we propose adaptive moment estimation (Adam) algorithm based on batch gradient descent (BGD) to design a time-domain equalizer (TDE) for PAM-based optical interconnects. Adam algorithm has…

Information Theory · Computer Science 2020-02-19 Haide Wang , Ji Zhou , Weiping Liu , Jianping Li , Xincheng Huang , Long Liu , Weixian Liang , Changyuan Yu , Fan Li , Zhaohui Li

We propose a stochastic optimization method for minimizing loss functions, expressed as an expected value, that adaptively controls the batch size used in the computation of gradient approximations and the step size used to move along such…

Machine Learning · Computer Science 2020-03-04 Achraf Bahamou , Donald Goldfarb

Adaptive momentum methods have recently attracted a lot of attention for training of deep neural networks. They use an exponential moving average of past gradients of the objective function to update both search directions and learning…

Optimization and Control · Mathematics 2021-04-27 Babak Barazandeh , Davoud Ataee Tarzanagh , George Michailidis

In several recently proposed stochastic optimization methods (e.g. RMSProp, Adam, Adadelta), parameter updates are scaled by the inverse square roots of exponential moving averages of squared past gradients. Maintaining these per-parameter…

Machine Learning · Computer Science 2018-04-13 Noam Shazeer , Mitchell Stern

Adaptive gradient-based optimizers such as Adagrad and Adam are crucial for achieving state-of-the-art performance in machine translation and language modeling. However, these methods maintain second-order statistics for each parameter,…

Machine Learning · Computer Science 2019-09-13 Rohan Anil , Vineet Gupta , Tomer Koren , Yoram Singer

Existing analysis of AdaGrad and other adaptive methods for smooth convex optimization is typically for functions with bounded domain diameter. In unconstrained problems, previous works guarantee an asymptotic convergence rate without an…

Machine Learning · Computer Science 2023-10-05 Zijian Liu , Ta Duy Nguyen , Alina Ene , Huy L. Nguyen

Training deep reinforcement learning (RL) agents necessitates overcoming the highly unstable nonconvex stochastic optimization inherent in the trial-and-error mechanism. To tackle this challenge, we propose a physics-inspired optimization…

Machine Learning · Computer Science 2024-12-10 Yao Lyu , Xiangteng Zhang , Shengbo Eben Li , Jingliang Duan , Letian Tao , Qing Xu , Lei He , Keqiang Li

In the recent years, various gradient descent algorithms including the methods of gradient descent, gradient descent with momentum, adaptive gradient (AdaGrad), root-mean-square propagation (RMSProp) and adaptive moment estimation (Adam)…

Machine Learning · Computer Science 2024-09-19 Abel C. H. Chen

Adam is applied widely to train neural networks. Different kinds of Adam methods with different features pop out. Recently two new adam optimizers, AdaBelief and Padam are introduced among the community. We analyze these two adam optimizers…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Zhaoyang Zhu , Haozhe Sun , Chi Zhang