English
Related papers

Related papers: A Progressive Batching L-BFGS Method for Machine L…

200 papers

We revisit the stochastic limited-memory BFGS (L-BFGS) algorithm. By proposing a new framework for the convergence analysis, we prove improved convergence rates and computational complexities of the stochastic L-BFGS algorithms compared to…

Optimization and Control · Mathematics 2018-02-14 Renbo Zhao , William B. Haskell , Vincent Y. F. Tan

Recent studies have illustrated that stochastic gradient Markov Chain Monte Carlo techniques have a strong potential in non-convex optimization, where local and global convergence guarantees can be shown under certain conditions. By…

Machine Learning · Statistics 2018-06-08 Umut Şimşekli , Çağatay Yıldız , Thanh Huy Nguyen , Gaël Richard , A. Taylan Cemgil

The limited memory BFGS (L-BFGS) method is one of the popular methods for solving large-scale unconstrained optimization. Since the standard L-BFGS method uses a line search to guarantee its global convergence, it sometimes requires a large…

Optimization and Control · Mathematics 2022-01-20 Hardik Tankaria , Shinji Sugimoto , Nobuo Yamashita

Non-asymptotic analysis of quasi-Newton methods have gained traction recently. In particular, several works have established a non-asymptotic superlinear rate of $\mathcal{O}((1/\sqrt{t})^t)$ for the (classic) BFGS method by exploiting the…

Optimization and Control · Mathematics 2022-06-17 Qiujiang Jin , Alec Koppel , Ketan Rajawat , Aryan Mokhtari

Global convergence of an online (stochastic) limited memory version of the Broyden-Fletcher- Goldfarb-Shanno (BFGS) quasi-Newton method for solving optimization problems with stochastic objectives that arise in large scale machine learning…

Optimization and Control · Mathematics 2014-09-09 Aryan Mokhtari , Alejandro Ribeiro

We investigate quasi-Newton methods for minimizing a strictly convex quadratic function which is subject to errors in the evaluation of the gradients. The methods all give identical behavior in exact arithmetic, generating minimizers of…

Optimization and Control · Mathematics 2025-02-26 Shen Peng , Gianpiero Canessa , David Ek , Anders Forsgren

We present a modified limited memory BFGS (L-BFGS) method that converges globally and linearly for nonconvex objective functions. Its distinguishing feature is that it turns into L-BFGS if the iterates cluster at a point near which the…

Optimization and Control · Mathematics 2024-09-12 Florian Mannel

We consider the problem of minimizing a continuous function that may be nonsmooth and nonconvex, subject to bound constraints. We propose an algorithm that uses the L-BFGS quasi-Newton approximation of the problem's curvature together with…

Optimization and Control · Mathematics 2016-12-23 Nitish Shirish Keskar , Andreas Waechter

In this paper, we present a unified and general framework for analyzing the batch updating approach to nonlinear, high-dimensional optimization. The framework encompasses all the currently used batch updating approaches, and is applicable…

Optimization and Control · Mathematics 2023-01-30 Tadipatri Uday Kiran Reddy , M. Vidyasagar

Algorithms for solving nonconvex, nonsmooth, finite-sum optimization problems are proposed and tested. In particular, the algorithms are proposed and tested in the context of an optimization problem formulation arising in semi-supervised…

Optimization and Control · Mathematics 2022-07-21 Gulcin Dinc Yalcin , Frank E. Curtis

In this paper, we introduce the Quasi-Quadratic Gradient (QQG), a novel search direction designed to accelerate the BFGS method within the quasi-Newton framework. By defining the QQG as the product of the inverse Hessian approximation and…

Optimization and Control · Mathematics 2026-04-28 John Chiang

We consider the development of practical stochastic quasi-Newton, and in particular Kronecker-factored block-diagonal BFGS and L-BFGS methods, for training deep neural networks (DNNs). In DNN training, the number of variables and components…

Machine Learning · Computer Science 2021-01-11 Donald Goldfarb , Yi Ren , Achraf Bahamou

Sequential Monte Carlo samplers represent a compelling approach to posterior inference in Bayesian models, due to being parallelisable and providing an unbiased estimate of the posterior normalising constant. In this work, we significantly…

Methodology · Statistics 2022-11-24 Samuel Duffield , Sumeetpal S. Singh

We develop and analyze a broad family of stochastic/randomized algorithms for inverting a matrix. We also develop specialized variants maintaining symmetry or positive definiteness of the iterates. All methods in the family converge…

Numerical Analysis · Mathematics 2016-03-24 Robert M. Gower , Peter Richtárik

Classical stochastic gradient methods for optimization rely on noisy gradient approximations that become progressively less accurate as iterates approach a solution. The large noise and small signal in the resulting gradients makes it…

Machine Learning · Computer Science 2017-04-10 Soham De , Abhay Yadav , David Jacobs , Tom Goldstein

We consider the use of a curvature-adaptive step size in gradient-based iterative methods, including quasi-Newton methods, for minimizing self-concordant functions, extending an approach first proposed for Newton's method by Nesterov. This…

Optimization and Control · Mathematics 2018-08-13 Wenbo Gao , Donald Goldfarb

Non-asymptotic convergence analysis of quasi-Newton methods has gained attention with a landmark result establishing an explicit local superlinear rate of O$((1/\sqrt{t})^t)$. The methods that obtain this rate, however, exhibit a well-known…

Optimization and Control · Mathematics 2023-10-19 Zhan Gao , Aryan Mokhtari , Alec Koppel

We propose a new stochastic proximal quasi-Newton method for minimizing the sum of two convex functions in the particular context that one of the functions is the average of a large number of smooth functions and the other one is nonsmooth.…

Optimization and Control · Mathematics 2024-12-24 Yongcun Song , Zimeng Wang , Xiaoming Yuan , Hangrui Yue

L-BFGS is the state-of-the-art optimization method for many large scale inverse problems. It has a small memory footprint and achieves superlinear convergence. The method approximates Hessian based on an initial approximation and an update…

Numerical Analysis · Mathematics 2021-03-19 Hari Om Aggrawal , Jan Modersitzki

Choosing appropriate step sizes is critical for reducing the computational cost of training large-scale neural network models. Mini-batch sub-sampling (MBSS) is often employed for computational tractability. However, MBSS introduces a…

Machine Learning · Statistics 2019-09-17 Younghwan Chae , Daniel N. Wilke