English
Related papers

Related papers: Complexity of normalized stochastic first-order me…

200 papers

We initiate the study of stochastic optimization with oblivious noise, broadly generalizing the standard heavy-tailed noise setup. In our setting, in addition to random observation noise, the stochastic gradient may be subject to…

Data Structures and Algorithms · Computer Science 2024-08-06 Ilias Diakonikolas , Sushrut Karmalkar , Jongho Park , Christos Tzamos

We establish maximal concentration bounds for the iterates generated by stochastic approximation algorithms with general step sizes, where the noise has a finite-state Markovian component plus a Martingale-difference component. When the…

Probability · Mathematics 2026-05-21 Shubhada Agrawal , Siva Theja Maguluri , Martin Zubeldia

We study the optimization of non-convex functions that are not necessarily smooth (gradient and/or Hessian are Lipschitz) using first order methods. Smoothness is a restrictive assumption in machine learning in both theory and practice,…

Optimization and Control · Mathematics 2025-06-27 Daniel Yiming Cao , August Y. Chen , Karthik Sridharan , Benjamin Tang

During recent years the interest of optimization and machine learning communities in high-probability convergence of stochastic optimization methods has been growing. One of the main reasons for this is that high-probability complexity…

We present high-probability (and expectation) complexity bounds for two versions of stochastic adaptive regularization methods with cubics (SARC), also known as regularized Newton methods. The first algorithm aims to find first-order…

Optimization and Control · Mathematics 2025-04-23 Katya Scheinberg , Miaolan Xie

In machine learning applications, it is well known that carefully designed learning rate (step size) schedules can significantly improve the convergence of commonly used first-order optimization algorithms. Therefore how to set step size…

Optimization and Control · Mathematics 2023-10-19 Xiaoyu Wang , Mikael Johansson , Tong Zhang

In this paper, we propose robust stochastic algorithms for solving convex compositional problems of the form $f(\E_\xi g(\cdot; \xi)) + r(\cdot)$ by establishing {\bf sub-Gaussian confidence bounds} under weak assumptions about the tails of…

Machine Learning · Computer Science 2020-06-19 Yan Yan , Xin Man , Tianbao Yang

Algorithms for bilevel optimization often encounter Hessian computations, which are prohibitive in high dimensions. While recent works offer first-order methods for unconstrained bilevel problems, the constrained setting remains relatively…

Optimization and Control · Mathematics 2025-04-22 Guy Kornowski , Swati Padmanabhan , Kai Wang , Zhe Zhang , Suvrit Sra

We study oracle complexity of gradient based methods for stochastic approximation problems. Though in many settings optimal algorithms and tight lower bounds are known for such problems, these optimal algorithms do not achieve the best…

Optimization and Control · Mathematics 2022-06-20 Jingzhao Zhang , Hongzhou Lin , Subhro Das , Suvrit Sra , Ali Jadbabaie

We prove lower bounds on the complexity of finding $\epsilon$-stationary points (points $x$ such that $\|\nabla f(x)\| \le \epsilon$) of smooth, high-dimensional, and potentially non-convex functions $f$. We consider oracle-based complexity…

Optimization and Control · Mathematics 2019-08-16 Yair Carmon , John C. Duchi , Oliver Hinder , Aaron Sidford

Constrained optimization problems where both the objective and constraints may be nonsmooth and nonconvex arise across many learning and data science settings. In this paper, we show for any Lipschitz, weakly convex objectives and…

Optimization and Control · Mathematics 2025-01-17 Zhichao Jia , Benjamin Grimmer

Although stochastic optimization is central to modern machine learning, the precise mechanisms underlying its success, and in particular, the precise role of the stochasticity, still remain unclear. Modelling stochastic optimization…

Machine Learning · Statistics 2020-06-12 Liam Hodgkinson , Michael W. Mahoney

Polyak-{\L}ojasiewicz (PL) [Polyak, 1963] condition is a weaker condition than the strong convexity but suffices to ensure a global convergence for the Gradient Descent algorithm. In this paper, we study the lower bound of algorithms using…

Optimization and Control · Mathematics 2023-08-03 Pengyun Yue , Cong Fang , Zhouchen Lin

We lower bound the complexity of finding $\epsilon$-stationary points (with gradient norm at most $\epsilon$) using stochastic first-order methods. In a well-studied model where algorithms access smooth, potentially non-convex functions…

Optimization and Control · Mathematics 2022-03-01 Yossi Arjevani , Yair Carmon , John C. Duchi , Dylan J. Foster , Nathan Srebro , Blake Woodworth

In this paper we consider stochastic composite convex optimization problems with the objective function satisfying a stochastic bounded gradient condition, with or without a quadratic functional growth property. These models include the…

Optimization and Control · Mathematics 2020-03-10 Ion Necoara

We propose dynamic sampled stochastic approximation (SA) methods for stochastic optimization with a heavy-tailed distribution (with finite 2nd moment). The objective is the sum of a smooth convex function with a convex regularizer.…

Optimization and Control · Mathematics 2017-05-26 Alejandro Jofré , Philip Thompson

In many practical applications, heuristic or approximation algorithms are used to efficiently solve the task at hand. However their solutions frequently do not satisfy natural monotonicity properties of optimal solutions. In this work we…

Machine Learning · Computer Science 2020-03-24 Evangelia Gergatsouli , Brendan Lucier , Christos Tzamos

Stochastic nonconvex minimax problems have attracted wide attention in machine learning, signal processing and many other fields in recent years. In this paper, we propose an accelerated first-order regularized momentum descent ascent…

Optimization and Control · Mathematics 2024-10-16 Huiling Zhang , Zi Xu

We design an algorithm which finds an $\epsilon$-approximate stationary point (with $\|\nabla F(x)\|\le \epsilon$) using $O(\epsilon^{-3})$ stochastic gradient and Hessian-vector products, matching guarantees that were previously available…

Machine Learning · Computer Science 2020-06-25 Yossi Arjevani , Yair Carmon , John C. Duchi , Dylan J. Foster , Ayush Sekhari , Karthik Sridharan

We present a new class of numerical methods for solving stochastic differential equations with additive noise on general Riemannian manifolds with high weak order of accuracy. In opposition to the popular approach with projection methods,…

Numerical Analysis · Mathematics 2025-06-19 Eugen Bronasco , Adrien Busnot Laurent , Baptiste Huguet