English
Related papers

Related papers: Adaptive Algorithms for Nonconvex Bilevel Optimiza…

200 papers

Stochastic Bilevel optimization usually involves minimizing an upper-level (UL) function that is dependent on the arg-min of a strongly-convex lower-level (LL) function. Several algorithms utilize Neumann series to approximate certain…

Optimization and Control · Mathematics 2023-06-22 Xuxing Chen , Tesi Xiao , Krishnakumar Balasubramanian

This paper presents new first-order methods for achieving optimal oracle complexities in convex optimization with convex functional constraints. Oracle complexities are measured by the number of function and gradient evaluations. To achieve…

Optimization and Control · Mathematics 2026-04-17 Qi Deng , Guanghui Lan , Zhenwei Lin

Although adaptive optimization algorithms have been successful in many applications, there are still some mysteries in terms of convergence analysis that have not been unraveled. This paper provides a novel non-convex analysis of adaptive…

Optimization and Control · Mathematics 2025-04-08 Zhishuai Guo , Yi Xu , Wotao Yin , Rong Jin , Tianbao Yang

Bilevel optimization (BLO) is a popular approach with many applications including hyperparameter optimization, neural architecture search, adversarial robustness and model-agnostic meta-learning. However, the approach suffers from time and…

Machine Learning · Computer Science 2021-06-08 Valerii Likhosherstov , Xingyou Song , Krzysztof Choromanski , Jared Davis , Adrian Weller

We design an algorithm which finds an $\epsilon$-approximate stationary point (with $\|\nabla F(x)\|\le \epsilon$) using $O(\epsilon^{-3})$ stochastic gradient and Hessian-vector products, matching guarantees that were previously available…

Machine Learning · Computer Science 2020-06-25 Yossi Arjevani , Yair Carmon , John C. Duchi , Dylan J. Foster , Ayush Sekhari , Karthik Sridharan

This paper considers the simple bilevel optimization (SBO) problem, which minimizes a composite convex function over the optimal solution set of another composite convex minimization problem. We first show that this bilevel problem is…

Optimization and Control · Mathematics 2025-07-11 Rujun Jiang , Xu Shi , Weizheng Song , Jiulin Wang

We present a method for solving general nonconvex-strongly-convex bilevel optimization problems. Our method -- the \emph{Restarted Accelerated HyperGradient Descent} (\texttt{RAHGD}) method -- finds an $\epsilon$-first-order stationary…

Optimization and Control · Mathematics 2023-07-04 Haikuo Yang , Luo Luo , Chris Junchi Li , Michael I. Jordan

A fully stochastic second-order adaptive-regularization method for unconstrained nonconvex optimization is presented which never computes the objective-function value, but yet achieves the optimal $\mathcal{O}(\epsilon^{-3/2})$ complexity…

Optimization and Control · Mathematics 2025-01-22 Serge Gratton , Sadok Jerad , Philippe L. Toint

Bilevel optimization is a hierarchical framework where an upper-level optimization problem is constrained by a lower-level problem, commonly used in machine learning applications such as hyperparameter optimization. Existing bilevel…

Optimization and Control · Mathematics 2026-03-03 Yuman Wu , Xiaochuan Gong , Jie Hao , Mingrui Liu

Algorithms for bilevel optimization often encounter Hessian computations, which are prohibitive in high dimensions. While recent works offer first-order methods for unconstrained bilevel problems, the constrained setting remains relatively…

Optimization and Control · Mathematics 2025-04-22 Guy Kornowski , Swati Padmanabhan , Kai Wang , Zhe Zhang , Suvrit Sra

Bilevel optimization is a popular two-level hierarchical optimization, which has been widely applied to many machine learning tasks such as hyperparameter learning, meta learning and continual learning. Although many bilevel optimization…

Optimization and Control · Mathematics 2023-11-21 Feihu Huang

Bilevel optimization has garnered significant attention in the machine learning community recently, particularly regarding the development of efficient numerical methods. While substantial progress has been made in developing efficient…

Optimization and Control · Mathematics 2026-02-04 Qichao Cao , Shangzhi Zeng , Jin Zhang

In this paper, we consider non-convex stochastic bilevel optimization (SBO) problems that have many applications in machine learning. Although numerous studies have proposed stochastic algorithms for solving these problems, they are limited…

Optimization and Control · Mathematics 2021-06-15 Zhishuai Guo , Quanqi Hu , Lijun Zhang , Tianbao Yang

In this work, we study nonconvex-strongly convex online bilevel optimization (OBO) using only first-order oracle. Existing OBO algorithms are mainly based on hypergradient descent, which requires access to a Hessian-vector product (HVP)…

Machine Learning · Computer Science 2026-05-12 Tingkai Jia , Cheng Chen

Bilevel optimization has found extensive applications in modern machine learning problems such as hyperparameter optimization, neural architecture search, meta-learning, etc. While bilevel problems with a unique inner minimal point (e.g.,…

Optimization and Control · Mathematics 2022-06-09 Daouda Sow , Kaiyi Ji , Ziwei Guan , Yingbin Liang

The popularity of bi-level optimization (BO) in deep learning has spurred a growing interest in studying gradient-based BO algorithms. However, existing algorithms involve two coupled learning rates that can be affected by approximation…

Machine Learning · Computer Science 2023-11-03 Chen Fan , Gaspard Choné-Ducasse , Mark Schmidt , Christos Thrampoulidis

We present an accelerated gradient method for non-convex optimization problems with Lipschitz continuous first and second derivatives. The method requires time $O(\epsilon^{-7/4} \log(1/ \epsilon) )$ to find an $\epsilon$-stationary point,…

Optimization and Control · Mathematics 2017-02-03 Yair Carmon , John C. Duchi , Oliver Hinder , Aaron Sidford

We present a novel adaptive optimization algorithm for large-scale machine learning problems. Equipped with a low-cost estimate of local curvature and Lipschitz smoothness, our method dynamically adapts the search direction and step-size.…

Machine Learning · Computer Science 2021-09-14 Majid Jahani , Sergey Rusakov , Zheng Shi , Peter Richtárik , Michael W. Mahoney , Martin Takáč

Functional bilevel optimization (FBO) provides a powerful framework for hierarchical learning in function spaces, yet current methods are limited to static offline settings and perform suboptimally in online, non-stationary scenarios. We…

Machine Learning · Statistics 2026-01-23 Jason Bohne , Ieva Petrulionyte , Michael Arbel , Julien Mairal , Paweł Polak

Adam has become one of the most popular optimizers for training modern deep neural networks, such as transformers. However, its applicability is largely restricted to single-level optimization problems. In this paper, we aim to extend…

Machine Learning · Computer Science 2025-03-07 Xiaochuan Gong , Jie Hao , Mingrui Liu