English
Related papers

Related papers: AdGT: Decentralized Gradient Tracking with Tuning-…

200 papers

We present a distributed conjugate gradient method for distributed optimization problems, where each agent computes an optimal solution of the problem locally without any central computation or coordination, while communicating with its…

Optimization and Control · Mathematics 2024-02-27 Ola Shorinwa , Mac Schwager

Stochastic methods with coordinate-wise adaptive stepsize (such as RMSprop and Adam) have been widely used in training deep neural networks. Despite their fast convergence, they can generalize worse than stochastic gradient descent. In this…

Machine Learning · Computer Science 2019-05-27 Shuai Zheng , James T. Kwok

In neural network training, RMSProp and Adam remain widely favoured optimisation algorithms. One of the keys to their performance lies in selecting the correct step size, which can significantly influence their effectiveness. Additionally,…

Machine Learning · Computer Science 2024-04-05 Alokendu Mazumder , Rishabh Sabharwal , Manan Tayal , Bhartendu Kumar , Punit Rathore

In this paper, we establish new convergence results for the quantized distributed gradient descent and suggest a novel strategy of choosing the stepsizes for the high-performance of the algorithm. Under the strongly convexity assumption on…

Optimization and Control · Mathematics 2023-07-03 Woocheol Choi , Myeong-Su Lee

The practical performance of online stochastic gradient descent algorithms is highly dependent on the chosen step size, which must be tediously hand-tuned in many applications. The same is true for more advanced variants of stochastic…

Optimization and Control · Mathematics 2015-11-10 Pierre-Yves Massé , Yann Ollivier

Stochastic Gradient Descent (SGD) has played a central role in machine learning. However, it requires a carefully hand-picked stepsize for fast convergence, which is notoriously tedious and time-consuming to tune. Over the last several…

Machine Learning · Computer Science 2019-06-10 Zhenxun Zhuang , Ashok Cutkosky , Francesco Orabona

In this paper, we consider solving the distributed optimization problem over a multi-agent network under the communication restricted setting. We study a compressed decentralized stochastic gradient method, termed ``compressed exact…

Optimization and Control · Mathematics 2024-10-01 Kun Huang , Shi Pu

This paper investigates different vector step-size adaptation approaches for non-stationary online, continual prediction problems. Vanilla stochastic gradient descent can be considerably improved by scaling the update with a vector of…

Machine Learning · Computer Science 2019-12-16 Andrew Jacobsen , Matthew Schlegel , Cameron Linke , Thomas Degris , Adam White , Martha White

Communication compression techniques are of growing interests for solving the decentralized optimization problem under limited communication, where the global objective is to minimize the average of local cost functions over a multi-agent…

Optimization and Control · Mathematics 2022-05-26 Yiwei Liao , Zhuorui Li , Kun Huang , Shi Pu

Learning adversarial examples can be formulated as an optimization problem of maximizing the loss function with some box-constraints. However, for solving this induced optimization problem, the state-of-the-art gradient-based methods such…

Machine Learning · Computer Science 2023-02-03 Wei Tao , Lei Bao , Sheng Long , Gaowei Wu , Qing Tao

In this paper, we study a large-scale multi-agent minimax optimization problem, which models many interesting applications in statistical learning and game theory, including Generative Adversarial Networks (GANs). The overall objective is a…

Machine Learning · Computer Science 2023-06-07 Zhenyu Sun , Ermin Wei

Most popular optimizers for deep learning can be broadly categorized as adaptive methods (e.g. Adam) and accelerated schemes (e.g. stochastic gradient descent (SGD) with momentum). For many models such as convolutional neural networks…

Machine Learning · Computer Science 2020-12-22 Juntang Zhuang , Tommy Tang , Yifan Ding , Sekhar Tatikonda , Nicha Dvornek , Xenophon Papademetris , James S. Duncan

The Primal-Dual hybrid gradient (PDHG) method is a powerful optimization scheme that breaks complex problems into simple sub-steps. Unfortunately, PDHG methods require the user to choose stepsize parameters, and the speed of convergence is…

Numerical Analysis · Mathematics 2015-03-25 Tom Goldstein , Min Li , Xiaoming Yuan , Ernie Esser , Richard Baraniuk

The local gradient points to the direction of the steepest slope in an infinitesimal neighborhood. An optimizer guided by the local gradient is often trapped in local optima when the loss landscape is multi-modal. A directional Gaussian…

Machine Learning · Computer Science 2020-11-05 Hoang Tran , Guannan Zhang

We propose AEGD, a new algorithm for first-order gradient-based optimization of non-convex objective functions, based on a dynamically updated energy variable. The method is shown to be unconditionally energy stable, irrespective of the…

Optimization and Control · Mathematics 2021-10-04 Hailiang Liu , Xuping Tian

Approximate dynamic programming (ADP) has proven itself in a wide range of applications spanning large-scale transportation problems, health care, revenue management, and energy systems. The design of effective ADP algorithms has many…

Optimization and Control · Mathematics 2014-07-15 Ilya O. Ryzhov , Peter I. Frazier , Warren B. Powell

We introduce a novel dynamic learning-rate scheduling scheme grounded in theory with the goal of simplifying the manual and time-consuming tuning of schedules in practice. Our approach is based on estimating the locally-optimal stepsize,…

Machine Learning · Computer Science 2023-11-27 Gilad Yehudai , Alon Cohen , Amit Daniely , Yoel Drori , Tomer Koren , Mariano Schain

In continual learning, a learner has to keep learning from the data over its whole life time. A key issue is to decide what knowledge to keep and what knowledge to let go. In a neural network, this can be implemented by using a step-size…

Machine Learning · Computer Science 2024-02-01 Thomas Degris , Khurram Javed , Arsalan Sharifnassab , Yuxin Liu , Richard Sutton

Adaptive Gradient Descent with Energy (AEGD) is a variant of gradient descent (GD) designed to mitigate step-size sensitivity through an energy-based formulation. AEGD is notable for its unconditional energy stability, which guarantees…

Optimization and Control · Mathematics 2025-12-16 Lin Feng , Hailiang Liu

We introduce a new adaptive step-size strategy for convex optimization with stochastic gradient that exploits the local geometry of the objective function only by means of a first-order stochastic oracle and without any hyper-parameter…

Machine Learning · Computer Science 2025-09-19 Jean-François Aujol , Jérémie Bigot , Camille Castera