English

Near-Optimal Lower Bounds for Exact Zeroth-Order Convex Optimization

Optimization and Control 2026-07-18 v1

Abstract

The fundamental oracle limits of exact function value access remain poorly understood in zeroth-order optimization: even for canonical convex problems, the optimal joint dependence on dimension dd and accuracy ϵ\epsilon has remained unresolved. We resolve this question for arbitrary adaptive randomized algorithms minimizing nonsmooth L0L_0-Lipschitz convex functions over the dd-dimensional Euclidean unit ball, where each query returns only the exact scalar value f(x)f(\mathbf x) of a fixed objective. With universal L0>0L_0>0, let TϵT_\epsilon denote the minimum number of queries required to return an ϵ\epsilon-suboptimal point with probability at least 1/21/2, uniformly over the function class. We prove that Tϵcdmin{d,ϵ2}log ⁣(emin{d,ϵ2}), T_\epsilon \ge c\, \frac{ d\min\{d,\epsilon^{-2}\} }{ \log\!\bigl(e\min\{d,\epsilon^{-2}\}\bigr) }, for all dd0d\ge d_0 and 0<ϵϵ00<\epsilon\le\epsilon_0, for universal constants c,ϵ0>0c,\epsilon_0>0 and d0Nd_0\in\mathbb N. In the low-accuracy regime ϵd1/2\epsilon\ge d^{-1/2}, this matches the O(dϵ2)O(d\epsilon^{-2}) two-point exact value upper bound up to a logarithmic factor. In the high-accuracy regime ϵd1/2\epsilon\le d^{-1/2}, the lower bound saturates at Ω(d2/log(ed))\Omega(d^2/\log(ed)), independently of ϵ\epsilon, matching the O~(d2)\widetilde O(d^2) evaluation oracle upper bound up to polylogarithmic factors. The proof uses a random support function hard family and develops a posterior mean energy method for adaptive exact max observations, in place of first-order zero chain constructions and noise based transcript inequalities.

Cite

@article{arxiv.2607.16558,
  title  = {Near-Optimal Lower Bounds for Exact Zeroth-Order Convex Optimization},
  author = {Haihan Zhang and Chenheng Zhang and Zhiquan Qi and Zhouchen Lin},
  journal= {arXiv preprint arXiv:2607.16558},
  year   = {2026}
}