English
Related papers

Related papers: Continuous-Time Analysis of Adaptive Optimization …

200 papers

Traditional theories of optimization cannot describe the dynamics of optimization in deep learning, even in the simple setting of deterministic training. The challenge is that optimizers typically operate in a complex, oscillatory regime…

Machine Learning · Computer Science 2025-09-26 Jeremy M. Cohen , Alex Damian , Ameet Talwalkar , J. Zico Kolter , Jason D. Lee

Selecting an optimizer is a central step in the contemporary deep learning pipeline. In this paper, we demonstrate the sensitivity of optimizer comparisons to the hyperparameter tuning protocol. Our findings suggest that the hyperparameter…

Machine Learning · Computer Science 2020-06-17 Dami Choi , Christopher J. Shallue , Zachary Nado , Jaehoon Lee , Chris J. Maddison , George E. Dahl

Adam has become one of the most popular optimizers for training modern deep neural networks, such as transformers. However, its applicability is largely restricted to single-level optimization problems. In this paper, we aim to extend…

Machine Learning · Computer Science 2025-03-07 Xiaochuan Gong , Jie Hao , Mingrui Liu

Deep learning algorithms - typically consisting of a class of deep neural networks trained by a stochastic gradient descent (SGD) optimization method - are nowadays the key ingredients in many artificial intelligence (AI) systems and have…

Machine Learning · Computer Science 2024-07-12 Steffen Dereich , Robin Graeber , Arnulf Jentzen

Several recently proposed stochastic optimization methods that have been successfully used in training deep networks such as RMSProp, Adam, Adadelta, Nadam are based on using gradient updates scaled by square roots of exponential moving…

Machine Learning · Computer Science 2019-04-22 Sashank J. Reddi , Satyen Kale , Sanjiv Kumar

Training large language models (LLMs) typically relies on adaptive optimizers like Adam (Kingma & Ba, 2015) which store additional state information to accelerate convergence but incur significant memory overhead. Recent efforts, such as…

Machine Learning · Computer Science 2025-02-11 Meyer Scetbon , Chao Ma , Wenbo Gong , Edward Meeds

Adaptive optimizers, such as Adam, have achieved remarkable success in deep learning. A key component of these optimizers is the so-called preconditioning matrix, providing enhanced gradient information and regulating the step size of each…

Machine Learning · Computer Science 2024-12-10 Yun Yue , Zhiling Ye , Jiadi Jiang , Yongchao Liu , Ke Zhang

AdamW has been the default optimizer for transformer pretraining. For many years, our community searched for faster and more stable optimizers with only constrained positive outcomes. In this work, we propose a \textbf{one-line modification…

Machine Learning · Computer Science 2026-02-17 Kaizhao Liang , Lizhang Chen , Bo Liu , Qiang Liu

This work introduces ZetA, a novel deep learning optimizer that extends Adam by incorporating dynamic scaling based on the Riemann zeta function. To the best of our knowledge, ZetA is the first optimizer to apply zeta-based gradient scaling…

Machine Learning · Computer Science 2025-08-06 Samiksha BC

Hyperparameter tuning, particularly the selection of an appropriate learning rate in adaptive gradient training methods, remains a challenge. To tackle this challenge, in this paper, we propose a novel parameter-free optimizer,…

Machine Learning · Computer Science 2024-05-28 Yijiang Pang , Shuyang Yu , Bao Hoang , Jiayu Zhou

Optimization lies at the core of modern deep learning, yet existing methods often face a fundamental trade-off between adapting to problem geometry and leveraging curvature utilization. Steepest descent algorithms adapt to different…

Predicting high-fidelity future human poses, from a historically observed sequence, is decisive for intelligent robots to interact with humans. Deep end-to-end learning approaches, which typically train a generic pre-trained model on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Qiongjie Cui , Huaijiang Sun , Jianfeng Lu , Bin Li , Weiqing Li

In this paper, we consider reinforcement learning of nonlinear systems with continuous state and action spaces. We present an episodic learning algorithm, where we for each episode use convex optimization to find a two-layer neural network…

Optimization and Control · Mathematics 2024-06-25 Ather Gattami

MLP is a heavily used backbone in modern deep learning (DL) architectures for supervised learning on tabular data, and AdamW is the go-to optimizer used to train tabular DL models. Unlike architecture design, however, the choice of…

Machine Learning · Computer Science 2026-04-20 Yury Gorishniy , Ivan Rubachev , Dmitrii Feoktistov , Artem Babenko

We provide a theoretical analysis of Adam under non-stationary stochastic objectives, separating two regimes: Euclidean tracking under adaptive strong monotonicity of the Adam-preconditioned mean-gradient operator, and high-probability…

Machine Learning · Statistics 2026-05-07 Sharan Sahu , Abir Sarkar , Cameron J. Hogan , Martin T. Wells

Very little is known about the training dynamics of adaptive gradient methods like Adam in deep learning. In this paper, we shed light on the behavior of these algorithms in the full-batch and sufficiently large batch settings.…

In this paper, we present a comprehensive study on the convergence properties of Adam-family methods for nonsmooth optimization, especially in the training of nonsmooth neural networks. We introduce a novel two-timescale framework that…

Optimization and Control · Mathematics 2024-02-20 Nachuan Xiao , Xiaoyin Hu , Xin Liu , Kim-Chuan Toh

Although ADAM is a very popular algorithm for optimizing the weights of neural networks, it has been recently shown that it can diverge even in simple convex optimization examples. Several variants of ADAM have been proposed to circumvent…

Optimization and Control · Mathematics 2020-09-25 Anas Barakat , Pascal Bianchi

Modern convolutional networks, incorporating rectifiers and max-pooling, are neither smooth nor convex; standard guarantees therefore do not apply. Nevertheless, methods from convex optimization such as gradient descent and Adam are widely…

Machine Learning · Computer Science 2018-06-07 David Balduzzi , Brian McWilliams , Tony Butler-Yeoman

Accelerated gradient-based methods are being extensively used for solving non-convex machine learning problems, especially when the data points are abundant or the available data is distributed across several agents. Two of the prominent…

Machine Learning · Computer Science 2021-10-04 Kushal Chakrabarti , Nikhil Chopra