English
Related papers

Related papers: Gradient Descent Can Take Exponential Time to Esca…

200 papers

A central challenge to many fields of science and engineering involves minimizing non-convex error functions over continuous, high dimensional spaces. Gradient descent or quasi-Newton methods are almost ubiquitously used to perform such…

Machine Learning · Computer Science 2014-05-29 Razvan Pascanu , Yann N. Dauphin , Surya Ganguli , Yoshua Bengio

Gradient descent algorithm is the most utilized method when optimizing machine learning issues. However, there exists many local minimums and saddle points in the loss function, especially for high dimensional non-convex optimization…

Machine Learning · Computer Science 2021-07-19 Zhicheng Cai

We study the asymptotic behavior of second-order algorithms mixing Newton's method and inertial gradient descent in non-convex landscapes. We show that, despite the Newtonian behavior of these methods, they almost always escape strict…

Optimization and Control · Mathematics 2024-02-13 Camille Castera

Previous works on stochastic gradient descent (SGD) often focus on its success. In this work, we construct worst-case optimization problems illustrating that, when not in the regimes that the previous works often assume, SGD can exhibit…

Machine Learning · Computer Science 2023-05-30 Liu Ziyin , Botao Li , James B. Simon , Masahito Ueda

The main aim of this paper is to provide an analysis of gradient descent (GD) algorithms with gradient errors that do not necessarily vanish, asymptotically. In particular, sufficient conditions are presented for both stability (almost sure…

Systems and Control · Computer Science 2017-09-19 Arunselvan Ramaswamy , Shalabh Bhatnagar

We show that stochastic gradient descent (SGD) escapes from sharp minima exponentially fast even before SGD reaches stationary distribution. SGD has been a de-facto standard training algorithm for various machine learning tasks. However,…

Machine Learning · Computer Science 2022-03-22 Hikaru Ibayashi , Masaaki Imaizumi

Stochastic gradient descent (SGD) is widely used in machine learning. Although being commonly viewed as a fast but not accurate version of gradient descent (GD), it always finds better solutions than GD for modern neural networks. In order…

Machine Learning · Computer Science 2018-08-17 Robert Kleinberg , Yuanzhi Li , Yang Yuan

Gradient Descent Ascent (GDA) methods for min-max optimization problems typically produce oscillatory behavior that can lead to instability, e.g., in bilinear settings. To address this problem, we introduce a dissipation term into the GDA…

Optimization and Control · Mathematics 2024-03-15 Tianqi Zheng , Nicolas Loizou , Pengcheng You , Enrique Mallada

Momentum Stochastic Gradient Descent (MSGD) algorithm has been widely applied to many nonconvex optimization problems in machine learning, e.g., training deep neural networks, variational Bayesian inference, and etc. Despite its empirical…

Machine Learning · Computer Science 2021-03-09 Tianyi Liu , Zhehui Chen , Enlu Zhou , Tuo Zhao

When training neural networks, it has been widely observed that a large step size is essential in stochastic gradient descent (SGD) for obtaining superior models. However, the effect of large step sizes on the success of SGD is not well…

Machine Learning · Computer Science 2023-02-17 Amirkeivan Mohtashami , Martin Jaggi , Sebastian Stich

In overparameterized logistic regression, gradient descent (GD) iterates diverge in norm while converging in direction to the maximum $\ell_2$-margin solution -- a phenomenon known as the implicit bias of GD. This work investigates…

Machine Learning · Computer Science 2025-07-01 Jingfeng Wu , Peter Bartlett , Matus Telgarsky , Bin Yu

This paper considers a class of distributed resource allocation problems where each agent privately holds a smooth, potentially non-convex local objective, subject to a globally coupled equality constraint. Built upon the existing method,…

Optimization and Control · Mathematics 2025-08-12 Lei Qin , Ye Pu

Bilevel optimization is one of the fundamental problems in machine learning and optimization. Recent theoretical developments in bilevel optimization focus on finding the first-order stationary points for nonconvex-strongly-convex cases. In…

Machine Learning · Computer Science 2023-05-11 Minhui Huang , Xuxing Chen , Kaiyi Ji , Shiqian Ma , Lifeng Lai

Nonconvex optimization algorithms with random initialization have attracted increasing attention recently. It has been showed that many first-order methods always avoid saddle points with random starting points. In this paper, we answer a…

Optimization and Control · Mathematics 2019-07-24 Tao Sun , Dongsheng Li , Zhe Quan , Hao Jiang , Shengguo Li , Yong Dou

Many problems encountered in science and engineering can be formulated as estimating a low-rank object (e.g., matrices and tensors) from incomplete, and possibly corrupted, linear measurements. Through the lens of matrix and tensor…

Machine Learning · Computer Science 2023-10-11 Cong Ma , Xingyu Xu , Tian Tong , Yuejie Chi

We consider minimizing a nonconvex, smooth function $f$ on a Riemannian manifold $\mathcal{M}$. We show that a perturbed version of Riemannian gradient descent algorithm converges to a second-order stationary point (and hence is able to…

Optimization and Control · Mathematics 2019-06-19 Yue Sun , Nicolas Flammarion , Maryam Fazel

Gradient Descent (GD) is a powerful workhorse of modern machine learning thanks to its scalability and efficiency in high-dimensional spaces. Its ability to find local minimisers is only guaranteed for losses with Lipschitz gradients, where…

Machine Learning · Computer Science 2023-07-27 Lei Chen , Joan Bruna

Saddle points constitute a crucial challenge for first-order gradient descent algorithms. In notions of classical machine learning, they are avoided for example by means of stochastic gradient descent methods. In this work, we provide…

Quantum Physics · Physics 2025-05-26 Junyu Liu , Frederik Wilde , Antonio Anna Mele , Xin Jin , Liang Jiang , Jens Eisert

We provide larger step-size restrictions for which gradient descent based algorithms (almost surely) avoid strict saddle points. In particular, consider a twice differentiable (non-convex) objective function whose gradient has Lipschitz…

Machine Learning · Statistics 2019-08-06 Hayden Schaeffer , Scott G. McCalla

We consider distributed smooth nonconvex unconstrained optimization over networks, modeled as a connected graph. We examine the behavior of distributed gradient-based algorithms near strict saddle points. Specifically, we establish that (i)…

Optimization and Control · Mathematics 2020-05-26 Amir Daneshmand , Gesualdo Scutari , Vyacheslav Kungurtsev