Two-level trust-region method with random subspaces
Numerical Analysis
2024-09-10 v1 Numerical Analysis
Abstract
We introduce a two-level trust-region method (TLTR) for solving unconstrained nonlinear optimization problems. Our method uses a composite iteration step, which is based on two distinct search directions. The first search direction is obtained through minimization in the full/high-resolution space, ensuring global convergence to a critical point. The second search direction is obtained through minimization in the randomly generated subspace, which, in turn, allows for convergence acceleration. The efficiency of the proposed TLTR method is demonstrated through numerical experiments in the field of machine learning
Cite
@article{arxiv.2409.05479,
title = {Two-level trust-region method with random subspaces},
author = {Andrea Angino and Alena Kopaničáková and Rolf Krause},
journal= {arXiv preprint arXiv:2409.05479},
year = {2024}
}