English
Related papers

Related papers: Newton Meets Marchenko-Pastur: Massively Parallel …

200 papers

Despite their popularity in the field of continuous optimisation, second-order quasi-Newton methods are challenging to apply in machine learning, as the Hessian matrix is intractably large. This computational burden is exacerbated by the…

Machine Learning · Computer Science 2024-02-28 Elre T. Oldewage , Ross M. Clarke , José Miguel Hernández-Lobato

We present an algorithm for minimizing a sum of functions that combines the computational efficiency of stochastic gradient descent (SGD) with the second order curvature information leveraged by quasi-Newton methods. We unify these…

Machine Learning · Computer Science 2014-12-02 Jascha Sohl-Dickstein , Ben Poole , Surya Ganguli

Reliable decision-making with streaming data requires principled uncertainty quantification of online methods. While first-order methods enable efficient iterate updates, their inference procedures still require updating proper (covariance)…

Machine Learning · Statistics 2026-04-28 Haoxuan Wang , Xinchen Du , Sen Na

In this work, we present a globalized stochastic semismooth Newton method for solving stochastic optimization problems involving smooth nonconvex and nonsmooth convex terms in the objective function. We assume that only noisy gradient and…

Optimization and Control · Mathematics 2018-03-12 Andre Milzarek , Xiantao Xiao , Shicong Cen , Zaiwen Wen , Michael Ulbrich

We present a novel statistical inference framework for convex empirical risk minimization, using approximate stochastic Newton steps. The proposed algorithm is based on the notion of finite differences and allows the approximation of a…

Machine Learning · Computer Science 2019-02-06 Tianyang Li , Anastasios Kyrillidis , Liu Liu , Constantine Caramanis

We consider minimizing a function consisting of a quadratic term and a proximable term which is possibly nonconvex and nonsmooth. This problem is also known as scaled proximal operator. Despite its simple form, existing methods suffer from…

Optimization and Control · Mathematics 2024-03-01 Yiming Zhou , Wei Dai

In a multi-agent network, we consider the problem of minimizing an objective function that is expressed as the sum of private convex and smooth functions, and a (possibly) non-differentiable convex regularizer. We propose a novel…

Optimization and Control · Mathematics 2021-09-30 Yichuan Li , Nikolaos M. Freris , Petros Voulgaris , Dusan Stipanovic

Inspired by the recent work FedNL (Safaryan et al, FedNL: Making Newton-Type Methods Applicable to Federated Learning), we propose a new communication efficient second-order framework for Federated learning, namely FLECS. The proposed…

Optimization and Control · Mathematics 2022-06-07 Artem Agafonov , Dmitry Kamzolov , Rachael Tappenden , Alexander Gasnikov , Martin Takáč

In this paper, we consider the problem of stochastic optimization, where the objective function is in terms of the expectation of a (possibly non-convex) cost function that is parametrized by a random variable. While the convergence speed…

Information Theory · Computer Science 2019-10-23 Naeimeh Omidvar , An Liu , Vincent Lau , Danny H. K. Tsang , Mohammad Reza Pakravan

Optimization plays a key role in machine learning. Recently, stochastic second-order methods have attracted much attention due to their low computational cost in each iteration. However, these algorithms might perform poorly especially if…

Machine Learning · Computer Science 2017-10-25 Haishan Ye , Zhihua Zhang

Sketching, a dimensionality reduction technique, has received much attention in the statistics community. In this paper, we study sketching in the context of Newton's method for solving finite-sum optimization problems in which the number…

Optimization and Control · Mathematics 2019-06-03 Albert S. Berahas , Raghu Bollapragada , Jorge Nocedal

In this paper, we present a detailed convergence analysis of a recently developed approximate Newton-type fully distributed optimization method for smooth, strongly convex local loss functions, called Network-GIANT, which has been…

Optimization and Control · Mathematics 2026-02-17 Souvik Das , Luca Schenato , Subhrakanti Dey

One of the most important problems in the field of distributed optimization is the problem of minimizing a sum of local convex objective functions over a networked system. Most of the existing work in this area focus on developing…

Optimization and Control · Mathematics 2019-01-08 Fatemeh Mansoori , Ermin Wei

In this paper, we propose a new randomized second-order optimization algorithm---Stochastic Subspace Cubic Newton (SSCN)---for minimizing a high dimensional convex function $f$. Our method can be seen both as a {\em stochastic} extension of…

Optimization and Control · Mathematics 2020-02-25 Filip Hanzely , Nikita Doikov , Peter Richtárik , Yurii Nesterov

Second-order optimization methods have desirable convergence properties. However, the exact Newton method requires expensive computation for the Hessian and its inverse. In this paper, we propose SPAN, a novel approximate and fast Newton…

Optimization and Control · Mathematics 2020-03-04 Xunpeng Huang , Xianfeng Liang , Zhengyang Liu , Yitan Li , Linyun Yu , Yue Yu , Lei Li

This paper proposes a nonmonotone proximal quasi-Newton algorithm for unconstrained convex multiobjective composite optimization problems. To design the search direction, we minimize the max-scalarization of the variations of the Hessian…

Optimization and Control · Mathematics 2023-10-04 Xiaoxue Jiang

Federated learning faces a critical challenge in balancing communication efficiency with rapid convergence, especially for second-order methods. While Newton-type algorithms achieve linear convergence in communication rounds, transmitting…

Machine Learning · Computer Science 2024-10-02 Sunny Gupta , Mohit Jindal , Pankhi Kashyap , Pranav Jeevan , Amit Sethi

We study stochastic Cubic Newton methods for solving general possibly non-convex minimization problems. We propose a new framework, which we call the helper framework, that provides a unified view of the stochastic and variance-reduced…

Optimization and Control · Mathematics 2025-12-19 El Mahdi Chayti , Nikita Doikov , Martin Jaggi

Second-order optimization methods, such as cubic regularized Newton methods, are known for their rapid convergence rates; nevertheless, they become impractical in high-dimensional problems due to their substantial memory requirements and…

Optimization and Control · Mathematics 2024-01-09 Ruichen Jiang , Parameswaran Raman , Shoham Sabach , Aryan Mokhtari , Mingyi Hong , Volkan Cevher

Many machine learning models depend on solving a large scale optimization problem. Recently, sub-sampled Newton methods have emerged to attract much attention for optimization due to their efficiency at each iteration, rectified a weakness…

Optimization and Control · Mathematics 2016-09-06 Haishan Ye , Luo Luo , Zhihua Zhang