English
Related papers

Related papers: Complexity reduction in online stochastic Newton m…

200 papers

We consider distributed optimization problems where forming the Hessian is computationally challenging and communication is a significant bottleneck. We develop unbiased parameter averaging methods for randomized second order optimization…

Machine Learning · Statistics 2020-02-18 Burak Bartan , Mert Pilanci

Using quasi-Newton methods in stochastic optimization is not a trivial task given the difficulty of extracting curvature information from the noisy gradients. Moreover, pre-conditioning noisy gradient observations tend to amplify the noise.…

Optimization and Control · Mathematics 2024-04-02 Andre Carlon , Luis Espath , Raul Tempone

Recently a majorization method for optimizing partition functions of log-linear models was proposed alongside a novel quadratic variational upper-bound. In the batch setting, it outperformed state-of-the-art first- and second-order…

Machine Learning · Computer Science 2013-09-24 Anna Choromanska , Tony Jebara

Optimization of convex functions under stochastic zeroth-order feedback has been a major and challenging question in online learning. In this work, we consider the problem of optimizing second-order smooth and strongly convex functions…

Machine Learning · Computer Science 2024-07-01 Qian Yu , Yining Wang , Baihe Huang , Qi Lei , Jason D. Lee

We consider the stochastic approximation problem where a convex function has to be minimized, given only the knowledge of unbiased estimates of its gradients at certain points, a framework which includes machine learning methods based on…

Machine Learning · Computer Science 2013-06-11 Francis Bach , Eric Moulines

Superlinear convergence has been an elusive goal for black-box nonsmooth optimization. Even in the convex case, the subgradient method is very slow, and while some cutting plane algorithms, including traditional bundle methods, are popular…

Optimization and Control · Mathematics 2019-07-30 Adrian Lewis , Calvin Wylie

In this paper, we generalize (accelerated) Newton's method with cubic regularization under inexact second-order information for (strongly) convex optimization problems. Under mild assumptions, we provide global rate of convergence of these…

Optimization and Control · Mathematics 2017-10-17 Saeed Ghadimi , Han Liu , Tong Zhang

Quasi-Newton algorithms are among the most popular iterative methods for solving unconstrained minimization problems, largely due to their favorable superlinear convergence property. However, existing results for these algorithms are…

Optimization and Control · Mathematics 2023-07-26 Ruichen Jiang , Qiujiang Jin , Aryan Mokhtari

In this paper, we discuss the problem of minimizing the sum of two convex functions: a smooth function plus a non-smooth function. Further, the smooth part can be expressed by the average of a large number of smooth component functions, and…

Machine Learning · Computer Science 2016-11-17 Luo Luo , Zihao Chen , Zhihua Zhang , Wu-Jun Li

Trust-region (TR) and adaptive regularization using cubics (ARC) have proven to have some very appealing theoretical properties for non-convex optimization by concurrently computing function value, gradient, and Hessian matrix to obtain the…

Machine Learning · Computer Science 2023-10-19 Liu Liu , Xuanqing Liu , Cho-Jui Hsieh , Dacheng Tao

We focus on analyzing the classical stochastic projected gradient methods under a general dependent data sampling scheme for constrained smooth nonconvex optimization. We show the worst-case rate of convergence $\tilde{O}(t^{-1/4})$ and…

Optimization and Control · Mathematics 2023-06-26 Ahmet Alacaoglu , Hanbaek Lyu

The use of network Newton methods for the decentralized optimization of a sum cost distributed through agents of a network is considered. Network Newton methods reinterpret distributed gradient descent as a penalty method, observe that the…

Optimization and Control · Mathematics 2015-04-24 Aryan Mokhtari , Qing Ling , Alejandro Ribeiro

Efficiently approximating local curvature information of the loss function is a key tool for optimization and compression of deep neural networks. Yet, most existing methods to approximate second-order information have high computational or…

Machine Learning · Computer Science 2021-11-19 Elias Frantar , Eldar Kurtic , Dan Alistarh

In this paper, we propose a new randomized second-order optimization algorithm---Stochastic Subspace Cubic Newton (SSCN)---for minimizing a high dimensional convex function $f$. Our method can be seen both as a {\em stochastic} extension of…

Optimization and Control · Mathematics 2020-02-25 Filip Hanzely , Nikita Doikov , Peter Richtárik , Yurii Nesterov

Stochastic optimization methods have become a class of popular optimization tools in machine learning. Especially, stochastic gradient descent (SGD) has been widely used for machine learning problems such as training neural networks due to…

Optimization and Control · Mathematics 2021-02-26 Qingsong Zhang , Feihu Huang , Cheng Deng , Heng Huang

Consider the problem of minimizing an expected logarithmic loss over either the probability simplex or the set of quantum density matrices. This problem includes tasks such as solving the Poisson inverse problem, computing the…

Optimization and Control · Mathematics 2024-03-12 Chung-En Tsai , Hao-Chung Cheng , Yen-Huan Li

Incorporating second order curvature information in gradient based methods have shown to improve convergence drastically despite its computational intensity. In this paper, we propose a stochastic (online) quasi-Newton method with…

Machine Learning · Computer Science 2020-10-16 S. Indrapriyadarsini , Shahrzad Mahboubi , Hiroshi Ninomiya , Hideki Asai

In this paper, we propose and analyze zeroth-order stochastic approximation algorithms for nonconvex and convex optimization, with a focus on addressing constrained optimization, high-dimensional setting and saddle-point avoiding. To handle…

Optimization and Control · Mathematics 2019-01-16 Krishnakumar Balasubramanian , Saeed Ghadimi

In this paper, we study the iteration complexity of cubic regularization of Newton method for solving composite minimization problems with uniformly convex objective. We introduce the notion of second-order condition number of a certain…

Optimization and Control · Mathematics 2021-05-21 Nikita Doikov , Yurii Nesterov

When the nonconvex problem is complicated by stochasticity, the sample complexity of stochastic first-order methods may depend linearly on the problem dimension, which is undesirable for large-scale problems. In this work, we propose…

Optimization and Control · Mathematics 2024-10-01 Yue Xie , Jiawen Bi , Hongcheng Liu