English
Related papers

Related papers: Complexity Guarantees for Polyak Steps with Moment…

200 papers

We propose and analyze a randomized zeroth-order approach based on approximating the exact gradient byfinite differences computed in a set of orthogonal random directions that changes with each iteration. A number ofpreviously proposed…

Optimization and Control · Mathematics 2021-11-16 David Kozak , Cesare Molinari , Lorenzo Rosasco , Luis Tenorio , Silvia Villa

We analyze the convergence rate of various momentum-based optimization algorithms from a dynamical systems point of view. Our analysis exploits fundamental topological properties, such as the continuous dependence of iterates on their…

Optimization and Control · Mathematics 2021-04-13 Michael Muehlebach , Michael I. Jordan

We develop multi-step gradient methods for network-constrained optimization of strongly convex functions with Lipschitz-continuous gradients. Given the topology of the underlying network and bounds on the Hessian of the objective function,…

Optimization and Control · Mathematics 2015-06-12 Euhanna Ghadimi , Iman Shames , Mikael Johansson

We study the problem of meta-learning through the lens of online convex optimization, developing a meta-algorithm bridging the gap between popular gradient-based meta-learning and classical regularization-based multi-task transfer methods.…

Machine Learning · Computer Science 2019-05-17 Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar

We use matrix iteration theory to characterize acceleration in smooth games. We define the spectral shape of a family of games as the set containing all eigenvalues of the Jacobians of standard gradient dynamics in the family. Shapes…

Machine Learning · Computer Science 2020-03-10 Waïss Azizian , Damien Scieur , Ioannis Mitliagkas , Simon Lacoste-Julien , Gauthier Gidel

We study the connection between gradient-based meta-learning and convex op-timisation. We observe that gradient descent with momentum is a special case of meta-gradients, and building on recent results in optimisation, we prove convergence…

Machine Learning · Computer Science 2023-01-10 Sebastian Flennerhag , Tom Zahavy , Brendan O'Donoghue , Hado van Hasselt , András György , Satinder Singh

The success of deep learning over the past decade mainly relies on gradient-based optimisation and backpropagation. This paper focuses on analysing the performance of first-order gradient-based optimisation algorithms, gradient descent and…

Optimization and Control · Mathematics 2022-12-08 Behnam Mafakheri , Iman Shames , Jonathan H. Manton

We propose two new alternating direction methods to solve "fully" nonsmooth constrained convex problems. Our algorithms have the best known worst-case iteration-complexity guarantee under mild assumptions for both the objective residual and…

Optimization and Control · Mathematics 2018-01-16 Quoc Tran-Dinh , Volkan Cevher

We consider smooth stochastic convex optimization problems in the context of algorithms which are based on directional derivatives of the objective function. This context can be considered as an intermediate one between derivative-free…

Optimization and Control · Mathematics 2020-09-22 Pavel Dvurechensky , Eduard Gorbunov , Alexander Gasnikov

We propose an accelerated meta-algorithm, which allows to obtain accelerated methods for convex unconstrained minimization in different settings. As an application of the general scheme we propose nearly optimal methods for minimizing…

We analyze worst-case convergence guarantees of first-order optimization methods over a function class extending that of smooth and convex functions. This class contains convex functions that admit a simple quadratic upper bound. Its study…

Optimization and Control · Mathematics 2022-05-31 Baptiste Goujaud , Adrien Taylor , Aymeric Dieuleveut

Heavy Ball (HB) nowadays is one of the most popular momentum methods in non-convex optimization. It has been widely observed that incorporating the Heavy Ball dynamic in gradient-based methods accelerates the training process of modern…

Optimization and Control · Mathematics 2023-08-30 Jun-Kun Wang , Chi-Heng Lin , Andre Wibisono , Bin Hu

Policy gradient (PG) methods are popular and efficient for large-scale reinforcement learning due to their relative stability and incremental nature. In recent years, the empirical success of PG methods has led to the development of a…

Machine Learning · Computer Science 2022-05-24 Yuhao Ding , Junzi Zhang , Javad Lavaei

We consider minimizing an objective function subject to constraints defined by the intersection of lower-level sets of convex functions. We study two cases: (i) strongly convex and Lipschitz-smooth objective function and (ii) convex but…

Optimization and Control · Mathematics 2026-01-29 Abhishek Chakraborty , Angelia Nedić

In this paper, we study a class of deterministically constrained stochastic optimization problems. Existing methods typically aim to find an $\epsilon$-stochastic stationary point, where the expected violations of both constraints and…

Optimization and Control · Mathematics 2025-09-03 Zhaosong Lu , Sanyou Mei , Yifeng Xiao

We study momentum-based first-order optimization algorithms in which the iterations utilize information from the two previous steps and are subject to an additive white noise. This setup uses noise to account for uncertainty in either…

Optimization and Control · Mathematics 2024-06-21 Hesameddin Mohammadi , Meisam Razaviyayn , Mihailo R. Jovanović

In this paper, we introduce faster accelerated primal-dual algorithms for minimizing a convex function subject to strongly convex function constraints. Prior to our work, the best complexity bound was $\mathcal{O}(1/{\varepsilon})$,…

Optimization and Control · Mathematics 2024-11-28 Zhenwei Lin , Qi Deng

We study trade-offs between convergence rate and robustness to gradient errors in the context of first-order methods. Our focus is on generalized momentum methods (GMMs)--a broad class that includes Nesterov's accelerated gradient,…

Optimization and Control · Mathematics 2026-01-14 Mert Gürbüzbalaban , Yasa Syed , Necdet Serhat Aybat

In this paper we consider a composite optimization problem that minimizes the sum of a weakly smooth function and a convex function with either a bounded domain or a uniformly convex structure. In particular, we first present a…

Optimization and Control · Mathematics 2023-05-30 Masaru Ito , Zhaosong Lu , Chuan He

In this thesis we develop a novel framework to study smooth and strongly convex optimization algorithms, both deterministic and stochastic. Focusing on quadratic functions we are able to examine optimization algorithms as a recursive…

Optimization and Control · Mathematics 2014-10-24 Yossi Arjevani