English
Related papers

Related papers: Complexity Guarantees for Polyak Steps with Moment…

200 papers

The convergence rates for convex and non-convex optimization methods depend on the choice of a host of constants, including step sizes, Lyapunov function constants and momentum constants. In this work we propose the use of factorial powers…

Machine Learning · Computer Science 2023-04-13 Aaron Defazio , Robert M. Gower

Gradient descent is slow to converge for ill-conditioned problems and non-convex problems. An important technique for acceleration is step-size adaptation. The first part of this paper contains a detailed review of step-size adaptation…

Machine Learning · Computer Science 2022-05-27 Hengshuai Yao

Policy gradient is a widely utilized and foundational algorithm in the field of reinforcement learning (RL). Renowned for its convergence guarantees and stability compared to other RL algorithms, its practical application is often hindered…

Machine Learning · Computer Science 2024-04-12 Yunxiang Li , Rui Yuan , Chen Fan , Mark Schmidt , Samuel Horváth , Robert M. Gower , Martin Takáč

We obtain a new lower bound on the information-based complexity of first-order minimization of smooth and convex functions. We show that the bound matches the worst-case performance of the recently introduced Optimized Gradient Method,…

Optimization and Control · Mathematics 2016-06-07 Yoel Drori

In this paper, we propose new accelerated methods for smooth convex optimization, called contracting proximal methods. At every step of these methods, we need to minimize a contracted version of the objective function augmented by a…

Optimization and Control · Mathematics 2021-05-21 Nikita Doikov , Yurii Nesterov

In this paper, we investigate accelerated first-order methods for smooth convex optimization problems under inexact information on the gradient of the objective. The noise in the gradient is considered to be additive with two possibilities:…

Optimization and Control · Mathematics 2023-01-10 Vasin Artem , Alexander Gasnikov , Pavel Dvurechensky , Vladimir Spokoiny

We consider the problem of minimizing a strongly convex function that depends on an uncertain parameter $\theta$. The uncertainty in the objective function means that the optimum, $x^*(\theta)$, is also a function of $\theta$. We propose an…

Optimization and Control · Mathematics 2021-12-02 Conor McMeel , Panos Parpas

In this paper, we propose a new way to obtain optimal convergence rates for smooth stochastic (strong) convex optimization tasks. Our approach is based on results for optimization tasks where gradients have nonrandom noise. In contrast to…

Optimization and Control · Mathematics 2020-04-16 Darina Dvinskikh , Alexander Tyurin , Alexander Gasnikov , Sergey Omelchenko

In this letter we study the proximal gradient dynamics. This recently-proposed continuous-time dynamics solves optimization problems whose cost functions are separable into a nonsmooth convex and a smooth component. First, we show that the…

Optimization and Control · Mathematics 2024-11-22 Anand Gokhale , Alexander Davydov , Francesco Bullo

Two major momentum-based techniques that have achieved tremendous success in optimization are Polyak's heavy ball method and Nesterov's accelerated gradient. A crucial step in all momentum-based methods is the choice of the momentum…

Machine Learning · Statistics 2017-12-21 Vishwak Srinivasan , Adepu Ravi Sankar , Vineeth N Balasubramanian

It is well-known that accelerated gradient first order methods possess optimal complexity estimates for the class of convex smooth minimization problems. In many practical situations, it makes sense to work with inexact gradients. However,…

Optimization and Control · Mathematics 2024-07-02 Ilya Kuruzov , Fedor Stonyakin

We propose a single-loop variance-reduced acceleration framework, which relates checkpoint update probabilities to momentum parameters, for solving the composite general convex problem where the smooth part has the finite-sum structure.…

Optimization and Control · Mathematics 2026-02-26 Hai Liu , Tiande Guo , Congying Han

We consider solving nonconvex composite optimization problems in which the sum of a smooth function and a nonsmooth function is minimized. Many of convergence analyses of proximal gradient-type methods rely on global descent property…

Optimization and Control · Mathematics 2026-04-09 Shotaro Yagishita , Masaru Ito

Current state-of-the-art analyses on the convergence of gradient descent for training neural networks focus on characterizing properties of the loss landscape, such as the Polyak-Lojaciewicz (PL) condition and the restricted strong…

Machine Learning · Computer Science 2024-01-08 Fangshuo Liao , Anastasios Kyrillidis

Nonconvex optimization is central in solving many machine learning problems, in which block-wise structure is commonly encountered. In this work, we propose cyclic block coordinate methods for nonconvex optimization problems with…

Optimization and Control · Mathematics 2023-01-31 Xufeng Cai , Chaobing Song , Stephen J. Wright , Jelena Diakonikolas

Riemannian accelerated gradient methods have been well studied for smooth optimization, typically treating geodesically convex and geodesically strongly convex cases separately. However, their extension to nonsmooth problems on manifolds…

Optimization and Control · Mathematics 2025-09-29 Shuailing Feng , Yuhang Jiang , Wen Huang , Shihui Ying

We present a new feasible proximal gradient method for constrained optimization where both the objective and constraint functions are given by the summation of a smooth, possibly nonconvex function and a convex simple function. The…

Optimization and Control · Mathematics 2024-02-01 Digvijay Boob , Qi Deng , Guanghui Lan

We propose a globally-accelerated, first-order method for the optimization of smooth and (strongly or not) geodesically-convex functions in a wide class of Hadamard manifolds. We achieve the same convergence rates as Nesterov's accelerated…

Optimization and Control · Mathematics 2023-01-18 David Martínez-Rubio , Sebastian Pokutta

Momentum method has been used extensively in optimizers for deep learning. Recent studies show that distributed training through K-step averaging has many nice properties. We propose a momentum method for such model averaging approaches. At…

Machine Learning · Computer Science 2021-10-05 Guojing Cong , Tianyi Liu

Lower-bound analyses for nonconvex strongly-concave minimax optimization problems have shown that stochastic first-order algorithms require at least $\mathcal{O}(\varepsilon^{-4})$ oracle complexity to find an $\varepsilon$-stationary…

Machine Learning · Computer Science 2025-05-15 Haoyuan Cai , Sulaiman A. Alghunaim , Ali H. Sayed