English

Stochastic global optimization of continuous functions via random walks on Grassmannians

Optimization and Control 2026-05-27 v1 Machine Learning

Abstract

We introduce a stochastic global optimization method based on random walks on Grassmannian manifolds. To minimize a continuous objective :RdR\ell:\mathbb{R}^d\rightarrow\mathbb{R}, the method repeatedly samples random kk-dimensional linear subspaces (with kdk\ll d), solves the resulting low-dimensional restrictions of these problems to these subspaces using an arbitrary black-box optimizer, and updates the iterate (which monotonically improves upon the previous iterate). Unlike classical optimization analyses that rely on convexity, smoothness, Lipschitz bounds, or Polyak-Lojasiewicz-type conditions, our convergence guarantees depend only on the geometric distribution of restricted minima across the kk-dimensional subspaces passing through a given point in Rd\mathbb{R}^d. We identify a gap parameter -- an analogue of a spectral gap for random walks -- that controls the rate at which the iterates approach the global minimum value. Finally, we argue that the same analysis yields a blind-spot robustness property: sufficiently narrow, deep dips of the loss function (small-measure regions where \ell spikes downward) have limited influence on the algorithm's trajectory, since they are unlikely to be encountered by random subspace sampling.

Keywords

Cite

@article{arxiv.2605.14151,
  title  = {Stochastic global optimization of continuous functions via random walks on Grassmannians},
  author = {Kartik Gupta and Stephen D. Miller and Pradeep Ravikumar and Ramarathnam Venkatesan},
  journal= {arXiv preprint arXiv:2605.14151},
  year   = {2026}
}

Comments

21 pages

R2 v1 2026-07-22T07:11:13.989Z