English
Related papers

Related papers: Convergence and Dynamical Behavior of the ADAM Alg…

200 papers

A number of recent adaptive optimizers improve the generalisation performance of Adam by essentially reducing the variance of adaptive stepsizes to get closer to SGD with momentum. Following the above motivation, we suppress the range of…

Machine Learning · Computer Science 2024-07-15 Guoqiang Zhang

In continual learning, a learner has to keep learning from the data over its whole life time. A key issue is to decide what knowledge to keep and what knowledge to let go. In a neural network, this can be implemented by using a step-size…

Machine Learning · Computer Science 2024-02-01 Thomas Degris , Khurram Javed , Arsalan Sharifnassab , Yuxin Liu , Richard Sutton

We propose a general scheme for solving convex and non-convex optimization problems on manifolds. The central idea is that, by adding a multiple of the squared retraction distance to the objective function in question, we "convexify" the…

Computation · Statistics 2020-10-20 Lizhen Lin , Bayan Saparbayeva , Michael Minyi Zhang , David B. Dunson

Adaptive gradient optimizers (AdaGrad), which dynamically adjust the learning rate based on iterative gradients, have emerged as powerful tools in deep learning. These adaptive methods have significantly succeeded in various deep learning…

Optimization and Control · Mathematics 2024-12-31 Ruinan Jin , Xiaoyu Wang , Baoxiang Wang

Gradient descent (GD) based optimization methods are these days the standard tools to train deep neural networks in artificial intelligence systems. In optimization procedures in deep learning the employed optimizer is often not the…

Optimization and Control · Mathematics 2025-09-24 Steffen Dereich , Robin Graeber , Arnulf Jentzen , Adrian Riekert

Adam is the default algorithm for training neural networks, including large language models (LLMs). However, \citet{reddi2019convergence} provided an example that Adam diverges, raising concerns for its deployment in AI model training. We…

Machine Learning · Computer Science 2026-03-03 Yushun Zhang , Bingran Li , Congliang Chen , Zhi-Quan Luo , Ruoyu Sun

Adam is widely adopted in practical applications due to its fast convergence. However, its theoretical analysis is still far from satisfactory. Existing convergence analyses for Adam rely on the bounded smoothness assumption, referred to as…

Machine Learning · Computer Science 2024-06-25 Bohan Wang , Yushun Zhang , Huishuai Zhang , Qi Meng , Ruoyu Sun , Zhi-Ming Ma , Tie-Yan Liu , Zhi-Quan Luo , Wei Chen

It is known that adaptive optimization algorithms represent the key pillar behind the rise of the Machine Learning field. In the Optimization literature numerous studies have been devoted to accelerated gradient methods but only recently…

Optimization and Control · Mathematics 2024-02-02 Cristian Daniel Alecsa

Non-convex constrained optimizations are ubiquitous in robotic applications such as multi-agent navigation, UAV trajectory optimization, and soft robot simulation. For this problem class, conventional optimizers suffer from small step sizes…

Optimization and Control · Mathematics 2025-10-08 Zherong Pan , Kui Wu

In this paper, we investigate the non-asymptotic stationary convergence behavior of Stochastic Mirror Descent (SMD) for nonconvex optimization. We focus on a general class of nonconvex nonsmooth stochastic optimization problems, in which…

Optimization and Control · Mathematics 2018-06-14 Siqi Zhang , Niao He

In this paper, we propose and analyse a family of generalised stochastic composite mirror descent algorithms. With adaptive step sizes, the proposed algorithms converge without requiring prior knowledge of the problem. Combined with an…

Optimization and Control · Mathematics 2022-11-22 Weijia Shao , Fikret Sivrikaya , Sahin Albayrak

We consider the minimization of a sum of an expectation-valued coordinate-wise $L_i$-smooth nonconvex function and a nonsmooth block-separable convex regularizer. We propose an asynchronous variance-reduced algorithm, where in each…

Optimization and Control · Mathematics 2020-02-20 Jinlong Lei , Uday V. Shanbhag

Gradient Descent Ascent (GDA) methods are the mainstream algorithms for minimax optimization in generative adversarial networks (GANs). Convergence properties of GDA have drawn significant interest in the recent literature. Specifically,…

Optimization and Control · Mathematics 2022-07-05 Haochuan Li , Farzan Farnia , Subhro Das , Ali Jadbabaie

In this paper, we establish new convergence results for the quantized distributed gradient descent and suggest a novel strategy of choosing the stepsizes for the high-performance of the algorithm. Under the strongly convexity assumption on…

Optimization and Control · Mathematics 2023-07-03 Woocheol Choi , Myeong-Su Lee

We implement the adaptive step size scheme from the optimization methods AdaGrad and Adam in a novel variant of the Proximal Gradient Method (PGM). Our algorithm, dubbed AdaProx, avoids the need for explicit computation of the Lipschitz…

Optimization and Control · Mathematics 2020-07-06 Peter Melchior , Rémy Joseph , Fred Moolekamp

In this paper, we consider nonconvex decentralised optimisation and learning over a network of distributed agents. We develop an ADMM algorithm based on the Randomised Block Coordinate Douglas-Rachford splitting method which enables agents…

Optimization and Control · Mathematics 2025-07-31 Behnam Mafakheri , Jonathan H. Manton , Iman Shames

We prove local convergence of several notable gradient descent algorithms used in machine learning, for which standard stochastic gradient descent theory does not apply directly. This includes, first, online algorithms for recurrent models…

Dynamical Systems · Mathematics 2021-01-11 Pierre-Yves Massé , Yann Ollivier

We propose a unifying algorithm for non-smooth non-convex optimization. The algorithm approximates the objective function by a convex model function and finds an approximate (Bregman) proximal point of the convex model. This approximate…

Optimization and Control · Mathematics 2018-06-27 Peter Ochs , Jalal Fadili , Thomas Brox

In this note, we show a sublinear nonergodic convergence rate for the algorithm developed in [Bai, et al. Generalized symmetric ADMM for separable convex optimization. Comput. Optim. Appl. 70, 129-170 (2018)], as well as its linear…

Numerical Analysis · Mathematics 2019-06-20 Jianchao Bai , Xiaokai Chang , Jicheng Li , Fengmin Xu

Stochastic gradient descent is a canonical tool for addressing stochastic optimization problems, and forms the bedrock of modern machine learning and statistics. In this work, we seek to balance the fact that attenuating step-size is…

Signal Processing · Electrical Eng. & Systems 2020-07-10 Zhan Gao , Alec Koppel , Alejandro Ribeiro