English
Related papers

Related papers: A Unified Zeroth-Order Optimization Framework via …

200 papers

Recently introduced distributed zeroth-order optimization (ZOO) algorithms have shown their utility in distributed reinforcement learning (RL). Unfortunately, in the gradient estimation process, almost all of them require random samples…

Systems and Control · Electrical Eng. & Systems 2024-05-06 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty , Piyush K. Sharma

We propose novel randomized optimization methods for high-dimensional convex problems based on restrictions of variables to random subspaces. We consider oblivious and data-adaptive subspaces and study their approximation properties via…

Information Theory · Computer Science 2020-12-15 Jonathan Lacotte , Mert Pilanci

Zeroth-order optimization addresses problems where gradient information is inaccessible or impractical to compute. While most existing methods rely on first-order approximations, incorporating second-order (curvature) information can, in…

Machine Learning · Computer Science 2025-07-09 Dongyoon Kim , Sungjae Lee , Wonjin Lee , Kwang In Kim

We study a standard distributed optimization framework where $N$ networked nodes collaboratively minimize the sum of their local convex costs. The main body of existing work considers the described problem when the underling network is…

Optimization and Control · Mathematics 2018-03-22 Anit Kumar Sahu , Dusan Jakovetic , Dragana Bajovic , Soummya Kar

Zeroth-order methods are extensively used in machine learning applications where gradients are infeasible or expensive to compute, such as black-box attacks, reinforcement learning, and language model fine-tuning. Existing optimization…

Machine Learning · Computer Science 2025-11-12 Liang Zhang , Bingcong Li , Kiran Koshy Thekumparampil , Sewoong Oh , Michael Muehlebach , Niao He

In this paper, we propose and analyze zeroth-order stochastic approximation algorithms for nonconvex and convex optimization, with a focus on addressing constrained optimization, high-dimensional setting and saddle-point avoiding. To handle…

Optimization and Control · Mathematics 2019-01-16 Krishnakumar Balasubramanian , Saeed Ghadimi

A methodology for using random sketching in the context of model order reduction for high-dimensional parameter-dependent systems of equations was introduced in [Balabanov and Nouy 2019, Part I]. Following this framework, we here construct…

Numerical Analysis · Mathematics 2022-03-25 Oleg Balabanov , Anthony Nouy

Zeroth-order optimization, which does not use derivative information, is one of the significant research areas in the field of mathematical optimization and machine learning. Although various studies have explored zeroth-order algorithms,…

Optimization and Control · Mathematics 2024-07-16 Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

We consider a distributed convex optimization problem in a network which is time-varying and not always strongly connected. The local cost function of each node is affected by some stochastic process. All nodes of the network collaborate to…

Optimization and Control · Mathematics 2021-05-27 Wenjie Li , Mohamad Assaad

In stochastic convex optimization problems, most existing adaptive methods rely on prior knowledge about the diameter bound $D$ when the smoothness or the Lipschitz constant is unknown. This often significantly affects performance as only a…

Optimization and Control · Mathematics 2025-10-08 Clément Lezane , Alexandre d'Aspremont

In this paper, we consider smooth convex optimization problems with simple constraints and inexactness in the oracle information such as value, partial or directional derivatives of the objective function. We introduce a unifying framework,…

Optimization and Control · Mathematics 2020-12-17 Pavel Dvurechensky , Alexander Gasnikov , Alexander Tiurin , Vladimir Zholobov

Safe derivative-free optimization under unknown constraints is a fundamental challenge in modern learning and control. Existing zeroth-order (ZO) methods typically still assume access to a first-order oracle of the constraint functions or…

Optimization and Control · Mathematics 2026-01-29 Runyu Zhang , Gioele Zardini , Asuman Ozdaglar , Jeff Shamma , Na Li

Zeroth-order optimization aims to minimize an objective function using only function evaluations, and is therefore fundamental in black-box optimization, hyperparameter tuning, bandit learning, and adversarial machine learning. While…

Optimization and Control · Mathematics 2026-04-28 Haishan Ye

Randomized algorithms are important for solving large-scale optimization problems. In this paper, we propose a fast sketching algorithm for least square problems regularized by convex or nonconvex regularization functions, Sketching for…

Optimization and Control · Mathematics 2023-11-06 Yingzhen Yang , Ping Li

This paper explores the performance of a random Gaussian smoothing zeroth-order (ZO) scheme for minimising quasar-convex (QC) and strongly quasar-convex (SQC) functions in both unconstrained and constrained settings. For the unconstrained…

Optimization and Control · Mathematics 2026-02-03 Amir Ali Farzin , Yuen-Man Pun , Philipp Braun , Iman Shames

Variance reduction techniques are designed to decrease the sampling variance, thereby accelerating convergence rates of first-order (FO) and zeroth-order (ZO) optimization methods. However, in composite optimization problems, ZO methods…

Machine Learning · Computer Science 2024-05-29 Hao Di , Haishan Ye , Yueling Zhang , Xiangyu Chang , Guang Dai , Ivor W. Tsang

This paper concerns a convex, stochastic zeroth-order optimization (S-ZOO) problem. The objective is to minimize the expectation of a cost function whose gradient is not directly accessible. For this problem, traditional optimization…

Optimization and Control · Mathematics 2022-02-08 Hongcheng Liu , Yu Yang

Zeroth-order (ZO) optimization provides a gradient-free alternative to first-order (FO) methods by estimating gradients via finite differences of function evaluations, and has recently emerged as a memory-efficient paradigm for fine-tuning…

Machine Learning · Computer Science 2026-02-24 Yicheng Lang , Changsheng Wang , Yihua Zhang , Mingyi Hong , Zheng Zhang , Wotao Yin , Sijia Liu

Finite-difference methods are a class of algorithms designed to solve black-box optimization problems by approximating a gradient of the target function on a set of directions. In black-box optimization, the non-smooth setting is…

Optimization and Control · Mathematics 2023-11-07 Marco Rando , Cesare Molinari , Lorenzo Rosasco , Silvia Villa