English
Related papers

Related papers: Quasi-Newton Optimization Methods For Deep Learnin…

200 papers

In Part I of this work, we have proposed a general framework of decentralized stochastic quasi-Newton methods, which converge linearly to the optimal solution under the assumption that the local Hessian inverse approximations have bounded…

Optimization and Control · Mathematics 2022-01-20 Jiaojiao Zhang , Huikang Liu , Anthony Man-Cho So , Qing Ling

In recent years, various subspace algorithms have been developed to handle large-scale optimization problems. Although existing subspace Newton methods require fewer iterations to converge in practice, the matrix operations and full…

Optimization and Control · Mathematics 2024-06-05 Taisei Miyaishi , Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

Neural networks are trained by optimizing multi-dimensional sets of fitting parameters on non-convex loss landscapes. Low-loss regions of the landscapes correspond to the parameter sets that perform well on the training data. A key issue in…

Machine Learning · Computer Science 2026-02-26 Jianneng Yu , Alexandre V. Morozov

Second-order methods for neural network optimization have several advantages over methods based on first-order gradient descent, including better scaling to large mini-batch sizes and fewer updates needed for convergence. But they are…

Machine Learning · Computer Science 2017-12-21 Huishuai Zhang , Caiming Xiong , James Bradbury , Richard Socher

The main focus in this paper is exact linesearch methods for minimizing a quadratic function whose Hessian is positive definite. We give a class of limited-memory quasi-Newton Hessian approximations which generate search directions parallel…

Optimization and Control · Mathematics 2023-05-04 David Ek , Anders Forsgren

The question of how to incorporate curvature information in stochastic approximation methods is challenging. The direct application of classical quasi- Newton updating techniques for deterministic optimization leads to noisy curvature…

Optimization and Control · Mathematics 2015-02-19 R. H. Byrd , S. L. Hansen , J. Nocedal , Y. Singer

Non-asymptotic convergence analysis of quasi-Newton methods has gained attention with a landmark result establishing an explicit local superlinear rate of O$((1/\sqrt{t})^t)$. The methods that obtain this rate, however, exhibit a well-known…

Optimization and Control · Mathematics 2023-10-19 Zhan Gao , Aryan Mokhtari , Alec Koppel

Second-order optimization methods are among the most widely used optimization approaches for convex optimization problems, and have recently been used to optimize non-convex optimization problems such as deep learning models. The widely…

Optimization and Control · Mathematics 2022-02-01 Dinesh Singh , Hardik Tankaria , Makoto Yamada

We extend the well-known BFGS quasi-Newton method and its memory-limited variant LBFGS to the optimization of nonsmooth convex objectives. This is done in a rigorous fashion by generalizing three components of BFGS to subdifferentials: the…

Machine Learning · Statistics 2010-11-30 Jin Yu , S. V. N. Vishwanathan , Simon Guenter , Nicol N. Schraudolph

Quasi-Newton algorithms are among the most popular iterative methods for solving unconstrained minimization problems, largely due to their favorable superlinear convergence property. However, existing results for these algorithms are…

Optimization and Control · Mathematics 2023-07-26 Ruichen Jiang , Qiujiang Jin , Aryan Mokhtari

Although first-order stochastic algorithms, such as stochastic gradient descent, have been the main force to scale up machine learning models, such as deep neural nets, the second-order quasi-Newton methods start to draw attention due to…

Optimization and Control · Mathematics 2020-11-03 Qianqian Tong , Guannan Liang , Xingyu Cai , Chunjiang Zhu , Jinbo Bi

The question of how to parallelize the stochastic gradient descent (SGD) method has received much attention in the literature. In this paper, we focus instead on batch methods that use a sizeable fraction of the training set at each…

Optimization and Control · Mathematics 2016-10-26 Albert S. Berahas , Jorge Nocedal , Martin Takáč

In this paper, we study structured quasi-Newton methods for optimization problems with orthogonality constraints. Note that the Riemannian Hessian of the objective function requires both the Euclidean Hessian and the Euclidean gradient. In…

Optimization and Control · Mathematics 2018-09-05 Jiang Hu , Bo Jiang , Lin Lin , Zaiwen Wen , Yaxiang Yuan

Quasi-Newton methods are widely used in practise for convex loss minimization problems. These methods exhibit good empirical performance on a wide variety of tasks and enjoy super-linear convergence to the optimal solution. For large-scale…

Machine Learning · Computer Science 2015-06-10 Aurelien Lucchi , Brian McWilliams , Thomas Hofmann

Incorporating second order curvature information in gradient based methods have shown to improve convergence drastically despite its computational intensity. In this paper, we propose a stochastic (online) quasi-Newton method with…

Machine Learning · Computer Science 2020-10-16 S. Indrapriyadarsini , Shahrzad Mahboubi , Hiroshi Ninomiya , Hideki Asai

While first-order optimization methods such as stochastic gradient descent (SGD) are popular in machine learning (ML), they come with well-known deficiencies, including relatively-slow convergence, sensitivity to the settings of…

Optimization and Control · Mathematics 2018-02-19 Peng Xu , Farbod Roosta-Khorasani , Michael W. Mahoney

We propose a new stochastic proximal quasi-Newton method for minimizing the sum of two convex functions in the particular context that one of the functions is the average of a large number of smooth functions and the other one is nonsmooth.…

Optimization and Control · Mathematics 2024-12-24 Yongcun Song , Zimeng Wang , Xiaoming Yuan , Hangrui Yue

Recently several methods were proposed for sparse optimization which make careful use of second-order information [10, 28, 16, 3] to improve local convergence rates. These methods construct a composite quadratic approximation using Hessian…

Machine Learning · Computer Science 2015-07-15 Katya Scheinberg , Xiaocheng Tang

Using quasi-Newton methods in stochastic optimization is not a trivial task given the difficulty of extracting curvature information from the noisy gradients. Moreover, pre-conditioning noisy gradient observations tend to amplify the noise.…

Optimization and Control · Mathematics 2024-04-02 Andre Carlon , Luis Espath , Raul Tempone

Non-asymptotic analysis of quasi-Newton methods have gained traction recently. In particular, several works have established a non-asymptotic superlinear rate of $\mathcal{O}((1/\sqrt{t})^t)$ for the (classic) BFGS method by exploiting the…

Optimization and Control · Mathematics 2022-06-17 Qiujiang Jin , Alec Koppel , Ketan Rajawat , Aryan Mokhtari