English
Related papers

Related papers: Non-monotone Behavior of the Heavy Ball Method

200 papers

This paper addresses smooth convexly constrained optimization problems where the Euclidean projection onto the feasible set is computationally tractable. Although momentum techniques like Polyak's heavy-ball are known for accelerating…

Optimization and Control · Mathematics 2026-03-20 Federica Donnini , Pierluigi Mansueto

We propose an implicit iterative algorithm for an exact penalty method arising from inequality constrained optimization problems. A rapidly convergent fixed point method is developed for a regularized penalty functional. The applicability…

Optimization and Control · Mathematics 2012-10-05 Kazufumi Ito , Tomoya Takeuchi

In this paper, we consider nonconvex optimization problems with nonsmooth nonconvex objective function and nonlinear equality constraints. We assume that both the objective function and the functional constraints can be separated into 2…

Optimization and Control · Mathematics 2025-03-04 Lahcen El Bourkhissi , Ion Necoara

The optimization step in many machine learning problems rarely relies on vanilla gradient descent but it is common practice to use momentum-based accelerated methods. Despite these algorithms being widely applied to arbitrary loss…

Disordered Systems and Neural Networks · Physics 2021-10-29 Stefano Sarao Mannelli , Pierfrancesco Urbani

The aim of this survey is to present the main important techniques and tools from variational analysis used for first and second order dynamical systems of implicit type for solving monotone inclusions and non-smooth optimization problems.…

Optimization and Control · Mathematics 2020-07-02 Ernö Robert Csetnek

In this letter we revisit the famous heavy ball method and study its global convergence for a class of non-convex problems with sector-bounded gradient. We characterize the parameters that render the method globally convergent and yield the…

Optimization and Control · Mathematics 2022-03-28 Valery Ugrinovskii , Ian R. Petersen , Iman Shames

Machine learning and deep learning are widely researched fields that provide solutions to many modern problems. Due to the complexity of new problems related to the size of datasets, efficient approaches are obligatory. In optimization…

Optimization and Control · Mathematics 2025-10-01 Stepan Trifonov , Leonid Levin , Savelii Chezhegov , Aleksandr Beznosikov

We propose a hybrid control algorithm that guarantees fast convergence and uniform global asymptotic stability of the unique minimizer of a continuously differentiable, convex objective function. The algorithm, developed using hybrid system…

Optimization and Control · Mathematics 2023-10-10 Dawn M. Hustig-Schultz , Ricardo G. Sanfelice

Two algorithms are proposed, analyzed, and tested for solving continuous optimization problems with nonlinear equality constraints. Each is an extension of a stochastic momentum-based method from the unconstrained setting to the setting of…

Optimization and Control · Mathematics 2026-01-21 Qi Wang , Christian Piermarini , Yunlang Zhu , Frank E. Curtis

We study the convergence behavior of the stochastic heavy-ball method with a small stepsize. Under a change of time scale, we approximate the discrete method by a stochastic differential equation that models small random perturbations of a…

Probability · Mathematics 2019-10-21 Wenqing Hu , Chris Junchi Li , Xiang Zhou

First-order methods are often analyzed via their continuous-time models, where their worst-case convergence properties are usually approached via Lyapunov functions. In this work, we provide a systematic and principled approach to find and…

Numerical Analysis · Mathematics 2024-03-12 Céline Moucer , Adrien Taylor , Francis Bach

Polyak momentum (PM), also known as the heavy-ball method, is a widely used optimization method that enjoys an asymptotic optimal worst-case complexity on quadratic objectives. However, its remarkable empirical success is not fully…

Optimization and Control · Mathematics 2021-01-25 Damien Scieur , Fabian Pedregosa

First order optimization algorithms play a major role in large scale machine learning. A new class of methods, called adaptive algorithms, were recently introduced to adjust iteratively the learning rate for each coordinate. Despite great…

Machine Learning · Computer Science 2019-10-01 André Belotto da Silva , Maxime Gazeau

This paper presents an inverse optimality method to solve the Hamilton-Jacobi-Bellman equation for a class of nonlinear problems for which the cost is quadratic and the dynamics are affine in the input. The method is inverse optimal because…

Optimization and Control · Mathematics 2011-10-11 Luis Rodrigues , Didier Henrion , Mehdi Abedinpour Fallah

We take a Hamiltonian-based perspective to generalize Nesterov's accelerated gradient descent and Polyak's heavy ball method to a broad class of momentum methods in the setting of (possibly) constrained minimization in Euclidean and…

Optimization and Control · Mathematics 2020-11-17 Jelena Diakonikolas , Michael I. Jordan

Recently, there has been great interest in connections between continuous-time dynamical systems and optimization methods, notably in the context of accelerated methods for smooth and unconstrained problems. In this paper we extend this…

Optimization and Control · Mathematics 2023-01-25 Guilherme França , Daniel P. Robinson , René Vidal

We propose a single time-scale stochastic subgradient method for constrained optimization of a composition of several nonsmooth and nonconvex functions. The functions are assumed to be locally Lipschitz and differentiable in a generalized…

Optimization and Control · Mathematics 2020-12-22 Andrzej Ruszczynski

We introduce a new approach to evaluate the largest Lyapunov exponent of a family of nonnegative matrices. The method is based on using special positive homogeneous functionals on $R^{d}_+,$ which gives iterative lower and upper bounds for…

Optimization and Control · Mathematics 2012-01-17 Vladimir Yu. Protasov , Raphael M. Jungers

This paper focuses on stochastic methods for solving smooth non-convex strongly-concave min-max problems, which have received increasing attention due to their potential applications in deep learning (e.g., deep AUC maximization,…

Machine Learning · Computer Science 2023-04-19 Zhishuai Guo , Yan Yan , Zhuoning Yuan , Tianbao Yang

This paper presents a new method for synthesizing stochastic control Lyapunov functions for a class of nonlinear stochastic control systems. The technique relies on a transformation of the classical nonlinear Hamilton-Jacobi-Bellman partial…

Optimization and Control · Mathematics 2017-09-07 Yoke Peng Leong , Matanya B. Horowitz , Joel W. Burdick