English

Improved Iteration Complexity in Black-Box Optimization Problems under Higher Order Smoothness Function Condition

Optimization and Control 2024-07-08 v1

Abstract

This paper is devoted to the study (common in many applications) of the black-box optimization problem, where the black-box represents a gradient-free oracle f~=f(x)+ξ\tilde{f} = f(x) + \xi providing the objective function value with some stochastic noise. Assuming that the objective function is μ\mu-strongly convex, and also not just LL-smooth, but has a higher order of smoothness (β2\beta \geq 2) we provide a novel optimization method: Zero-Order Accelerated Batched Stochastic Gradient Descent, whose theoretical analysis closes the question regarding the iteration complexity, achieving optimal estimates. Moreover, we provide a thorough analysis of the maximum noise level, and show under which condition the maximum noise level will take into account information about batch size BB as well as information about the smoothness order of the function β\beta.

Keywords

Cite

@article{arxiv.2407.03507,
  title  = {Improved Iteration Complexity in Black-Box Optimization Problems under Higher Order Smoothness Function Condition},
  author = {Aleksandr Lobanov},
  journal= {arXiv preprint arXiv:2407.03507},
  year   = {2024}
}
R2 v1 2026-06-28T17:28:33.799Z