Near-Optimal Lower Bounds for Exact Zeroth-Order Convex Optimization
Abstract
The fundamental oracle limits of exact function value access remain poorly understood in zeroth-order optimization: even for canonical convex problems, the optimal joint dependence on dimension and accuracy has remained unresolved. We resolve this question for arbitrary adaptive randomized algorithms minimizing nonsmooth -Lipschitz convex functions over the -dimensional Euclidean unit ball, where each query returns only the exact scalar value of a fixed objective. With universal , let denote the minimum number of queries required to return an -suboptimal point with probability at least , uniformly over the function class. We prove that for all and , for universal constants and . In the low-accuracy regime , this matches the two-point exact value upper bound up to a logarithmic factor. In the high-accuracy regime , the lower bound saturates at , independently of , matching the evaluation oracle upper bound up to polylogarithmic factors. The proof uses a random support function hard family and develops a posterior mean energy method for adaptive exact max observations, in place of first-order zero chain constructions and noise based transcript inequalities.
Cite
@article{arxiv.2607.16558,
title = {Near-Optimal Lower Bounds for Exact Zeroth-Order Convex Optimization},
author = {Haihan Zhang and Chenheng Zhang and Zhiquan Qi and Zhouchen Lin},
journal= {arXiv preprint arXiv:2607.16558},
year = {2026}
}