English
Related papers

Related papers: Variance-Reduced Gradient Estimator for Nonconvex …

200 papers

In this paper, we consider smooth convex optimization problems with simple constraints and inexactness in the oracle information such as value, partial or directional derivatives of the objective function. We introduce a unifying framework,…

Optimization and Control · Mathematics 2020-12-17 Pavel Dvurechensky , Alexander Gasnikov , Alexander Tiurin , Vladimir Zholobov

In this paper, we show how to transform any optimization problem that arises from fitting a machine learning model into one that (1) detects and removes contaminated data from the training set while (2) simultaneously fitting the trimmed…

Machine Learning · Statistics 2017-02-07 Aleksandr Aravkin , Damek Davis

We lower bound the complexity of finding $\epsilon$-stationary points (with gradient norm at most $\epsilon$) using stochastic first-order methods. In a well-studied model where algorithms access smooth, potentially non-convex functions…

Optimization and Control · Mathematics 2022-03-01 Yossi Arjevani , Yair Carmon , John C. Duchi , Dylan J. Foster , Nathan Srebro , Blake Woodworth

Recently introduced distributed zeroth-order optimization (ZOO) algorithms have shown their utility in distributed reinforcement learning (RL). Unfortunately, in the gradient estimation process, almost all of them require random samples…

Systems and Control · Electrical Eng. & Systems 2024-05-06 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty , Piyush K. Sharma

We propose an enhanced zeroth-order stochastic Frank-Wolfe framework to address constrained finite-sum optimization problems, a structure prevalent in large-scale machine-learning applications. Our method introduces a novel double variance…

Machine Learning · Computer Science 2025-01-24 Haishan Ye , Yinghui Huang , Hao Di , Xiangyu Chang

In this work, we propose a distributed algorithm for stochastic non-convex optimization. We consider a worker-server architecture where a set of $K$ worker nodes (WNs) in collaboration with a server node (SN) jointly aim to minimize a…

Optimization and Control · Mathematics 2020-05-04 Prashant Khanduri , Pranay Sharma , Swatantra Kafle , Saikiran Bulusu , Ketan Rajawat , Pramod K. Varshney

Randomly initialized first-order optimization algorithms are the method of choice for solving many high-dimensional nonconvex problems in machine learning, yet general theoretical guarantees cannot rule out convergence to critical points of…

Optimization and Control · Mathematics 2018-09-28 Dar Gilboa , Sam Buchanan , John Wright

We study a standard distributed optimization framework where $N$ networked nodes collaboratively minimize the sum of their local convex costs. The main body of existing work considers the described problem when the underling network is…

Optimization and Control · Mathematics 2018-03-22 Anit Kumar Sahu , Dusan Jakovetic , Dragana Bajovic , Soummya Kar

In this paper, we study a class of deterministically constrained stochastic optimization problems. Existing methods typically aim to find an $\epsilon$-stochastic stationary point, where the expected violations of both constraints and…

Optimization and Control · Mathematics 2025-09-03 Zhaosong Lu , Sanyou Mei , Yifeng Xiao

We introduce biased gradient oracles to capture a setting where the function measurements have an estimation error that can be controlled through a batch size parameter. Our proposed oracles are appealing in several practical contexts, for…

Machine Learning · Computer Science 2021-05-18 Nirav Bhavsar , Prashanth L. A

In this paper, we propose and analyze algorithms for zeroth-order optimization of non-convex composite objectives, focusing on reducing the complexity dependence on dimensionality. This is achieved by exploiting the low dimensional…

Optimization and Control · Mathematics 2022-08-16 Weijia Shao , Sahin Albayrak

In this paper, a novel stochastic extra-step quasi-Newton method is developed to solve a class of nonsmooth nonconvex composite optimization problems. We assume that the gradient of the smooth part of the objective function can only be…

Optimization and Control · Mathematics 2019-10-22 Minghan Yang , Andre Milzarek , Zaiwen Wen , Tong Zhang

We present a method for solving general nonconvex-strongly-convex bilevel optimization problems. Our method -- the \emph{Restarted Accelerated HyperGradient Descent} (\texttt{RAHGD}) method -- finds an $\epsilon$-first-order stationary…

Optimization and Control · Mathematics 2023-07-04 Haikuo Yang , Luo Luo , Chris Junchi Li , Michael I. Jordan

In machine learning, nonconvex optimization problems with multiple local optimums are often encountered. Graduated Optimization Algorithm (GOA) is a popular heuristic method to obtain global optimums of nonconvex problems through…

Machine Learning · Computer Science 2017-07-11 Li Chen , Shuisheng Zhou , Zhuan Zhang

We consider the case of derivative-free algorithms for non-convex optimization, also known as zero order algorithms, that use only function evaluations rather than gradients. For a wide variety of gradient approximators based on finite…

Optimization and Control · Mathematics 2019-10-30 Lampros Flokas , Emmanouil-Vasileios Vlatakis-Gkaragkounis , Georgios Piliouras

We consider non-smooth saddle point optimization problems. To solve these problems, we propose a zeroth-order method under bounded or Lipschitz continuous noise, possible adversarial. In contrast to the state-of-the-art algorithms, our…

Optimization and Control · Mathematics 2023-03-28 Darina Dvinskikh , Vladislav Tominin , Yaroslav Tominin , Alexander Gasnikov

Min-max optimization is emerging as a key framework for analyzing problems of robustness to strategically and adversarially generated data. We propose a random reshuffling-based gradient free Optimistic Gradient Descent-Ascent algorithm for…

Optimization and Control · Mathematics 2022-02-22 Chinmay Maheshwari , Chih-Yuan Chiu , Eric Mazumdar , S. Shankar Sastry , Lillian J. Ratliff

In this work, we focus on the study of stochastic zeroth-order (ZO) optimization which does not require first-order gradient information and uses only function evaluations. The problem of ZO optimization has emerged in many recent machine…

Machine Learning · Statistics 2020-12-22 Pranay Sharma , Kaidi Xu , Sijia Liu , Pin-Yu Chen , Xue Lin , Pramod K. Varshney

In this paper, we propose a new method based on the Sliding Algorithm from Lan(2016, 2019) for the convex composite optimization problem that includes two terms: smooth one and non-smooth one. Our method uses the stochastic noised…

Optimization and Control · Mathematics 2021-06-16 Aleksandr Beznosikov , Eduard Gorbunov , Alexander Gasnikov

We study the problem of estimating low-rank matrices from linear measurements (a.k.a., matrix sensing) through nonconvex optimization. We propose an efficient stochastic variance reduced gradient descent algorithm to solve a nonconvex…

Machine Learning · Statistics 2017-01-17 Xiao Zhang , Lingxiao Wang , Quanquan Gu