English
Related papers

Related papers: An Improved Adaptive PID Optimizer with Enhanced C…

200 papers

Gradient descent based optimization methods are the methods of choice to train deep neural networks in machine learning. Beyond the standard gradient descent method, also suitable modified variants of standard gradient descent involving…

Optimization and Control · Mathematics 2025-04-29 Steffen Dereich , Arnulf Jentzen , Adrian Riekert

We study adaptive methods for differentially private convex optimization, proposing and analyzing differentially private variants of a Stochastic Gradient Descent (SGD) algorithm with adaptive stepsizes, as well as the AdaGrad algorithm. We…

Machine Learning · Computer Science 2021-06-28 Hilal Asi , John Duchi , Alireza Fallah , Omid Javidbakht , Kunal Talwar

While stochastic gradient descent (SGD) is still the \emph{de facto} algorithm in deep learning, adaptive methods like Clipped SGD/Adam have been observed to outperform SGD across important tasks, such as attention models. The settings…

Optimization and Control · Mathematics 2020-10-26 Jingzhao Zhang , Sai Praneeth Karimireddy , Andreas Veit , Seungyeon Kim , Sashank J Reddi , Sanjiv Kumar , Suvrit Sra

Sharpness aware minimization (SAM) optimizer has been extensively explored as it can generalize better for training deep neural networks via introducing extra perturbation steps to flatten the landscape of deep learning models. Integrating…

Machine Learning · Computer Science 2023-03-02 Hao Sun , Li Shen , Qihuang Zhong , Liang Ding , Shixiang Chen , Jingwei Sun , Jing Li , Guangzhong Sun , Dacheng Tao

Vanilla gradient methods are often highly sensitive to the choice of stepsize, which typically requires manual tuning. Adaptive methods alleviate this issue and have therefore become widely used. Among them, AdaGrad has been particularly…

Machine Learning · Statistics 2026-02-16 Matia Bojovic , Saverio Salzo , Massimiliano Pontil

As a well-known optimization framework, the Alternating Direction Method of Multipliers (ADMM) has achieved tremendous success in many classification and regression applications. Recently, it has attracted the attention of deep learning…

Machine Learning · Computer Science 2021-12-23 Junxiang Wang , Hongyi Li , Liang Zhao

We make contributions towards improving adaptive-optimizer performance. Our improvements are based on suppression of the range of adaptive stepsizes in the AdaBelief optimizer. Firstly, we show that the particular placement of the parameter…

Machine Learning · Computer Science 2023-01-25 Guoqiang Zhang , Kenta Niwa , W. Bastiaan Kleijn

The Adam optimizer is currently presumably the most popular optimization method in deep learning. In this article we develop an ODE based method to study the Adam optimizer in a fast-slow scaling regime. For fixed momentum parameters and…

Optimization and Control · Mathematics 2025-11-07 Steffen Dereich , Arnulf Jentzen , Sebastian Kassing

Loss spikes remain a persistent obstacle in large-scale language model pretraining. While previous research has attempted to identify the root cause of loss spikes by investigating individual factors, we observe that, in practice, such…

Machine Learning · Computer Science 2026-02-24 Guoxia Wang , Shuai Li , Congliang Chen , Jinle Zeng , Jiabin Yang , Dianhai Yu , Yanjun Ma , Li Shen

Within the current sphere of deep learning research, despite the extensive application of optimization algorithms such as Stochastic Gradient Descent (SGD) and Adaptive Moment Estimation (Adam), there remains a pronounced inadequacy in…

Machine Learning · Computer Science 2025-10-30 Zhifeng Wang , Longlong Li , Chunyan Zeng

Stochastic gradient descent (SGD) is a standard optimization method to minimize a training error with respect to network parameters in modern neural network learning. However, it typically suffers from proliferation of saddle points in the…

Machine Learning · Computer Science 2017-11-23 Haiping Huang , Taro Toyoizumi

Adaptive gradient methods (AGMs) have become popular in optimizing the nonconvex problems in deep learning area. We revisit AGMs and identify that the adaptive learning rate (A-LR) used by AGMs varies significantly across the dimensions of…

Machine Learning · Computer Science 2019-09-12 Qianqian Tong , Guannan Liang , Jinbo Bi

Hyperparameter tuning, particularly the selection of an appropriate learning rate in adaptive gradient training methods, remains a challenge. To tackle this challenge, in this paper, we propose a novel parameter-free optimizer,…

Machine Learning · Computer Science 2024-05-28 Yijiang Pang , Shuyang Yu , Bao Hoang , Jiayu Zhou

Training language models becomes increasingly expensive with scale, prompting numerous attempts to improve optimization efficiency. Despite these efforts, the Adam optimizer remains the most widely used, due to a prevailing view that it is…

Machine Learning · Computer Science 2025-03-03 Rosie Zhao , Depen Morwani , David Brandfonbrener , Nikhil Vyas , Sham Kakade

The adaptive optimizer for training neural networks has continually evolved to overcome the limitations of the previously proposed adaptive methods. Recent studies have found the rare counterexamples that Adam cannot converge to the optimal…

Machine Learning · Computer Science 2019-11-04 Kiwook Bae , Heechang Ryu , Hayong Shin

In this paper, we aim at providing an introduction to the gradient descent based optimization algorithms for learning deep neural network models. Deep learning models involving multiple nonlinear projection layers are very challenging to…

Machine Learning · Computer Science 2019-03-12 Jiawei Zhang

Optimizer is an essential component for the success of deep learning, which guides the neural network to update the parameters according to the loss on the training set. SGD and Adam are two classical and effective optimizers on which…

Machine Learning · Computer Science 2023-07-04 Yineng Chen , Zuchao Li , Lefei Zhang , Bo Du , Hai Zhao

Training deep reinforcement learning (RL) agents necessitates overcoming the highly unstable nonconvex stochastic optimization inherent in the trial-and-error mechanism. To tackle this challenge, we propose a physics-inspired optimization…

Machine Learning · Computer Science 2024-12-10 Yao Lyu , Xiangteng Zhang , Shengbo Eben Li , Jingliang Duan , Letian Tao , Qing Xu , Lei He , Keqiang Li

A framework is introduced for solving a sequence of slowly changing optimization problems, including those arising in regression and classification applications, using optimization algorithms such as stochastic gradient descent (SGD). The…

Machine Learning · Computer Science 2015-09-25 Craig Wilson , Venugopal V. Veeravalli

Adam is widely adopted in practical applications due to its fast convergence. However, its theoretical analysis is still far from satisfactory. Existing convergence analyses for Adam rely on the bounded smoothness assumption, referred to as…

Machine Learning · Computer Science 2024-06-25 Bohan Wang , Yushun Zhang , Huishuai Zhang , Qi Meng , Ruoyu Sun , Zhi-Ming Ma , Tie-Yan Liu , Zhi-Quan Luo , Wei Chen