English
Related papers

Related papers: Bilevel Optimization for Machine Learning: Algorit…

200 papers

Bilevel optimization has been successfully applied to many important machine learning problems. Algorithms for solving bilevel optimization have been studied under various settings. In this paper, we study the nonconvex-strongly-convex…

Optimization and Control · Mathematics 2022-06-14 Xuxing Chen , Minhui Huang , Shiqian Ma

Bilevel optimization is a hierarchical framework where an upper-level optimization problem is constrained by a lower-level problem, commonly used in machine learning applications such as hyperparameter optimization. Existing bilevel…

Optimization and Control · Mathematics 2026-03-03 Yuman Wu , Xiaochuan Gong , Jie Hao , Mingrui Liu

Many problems in machine learning involve bilevel optimization (BLO), including hyperparameter optimization, meta-learning, and dataset distillation. Bilevel problems consist of two nested sub-problems, called the outer and inner problems,…

Machine Learning · Computer Science 2022-12-29 Paul Vicol , Jonathan Lorraine , Fabian Pedregosa , David Duvenaud , Roger Grosse

Although application examples of multilevel optimization have already been discussed since the 1990s, the development of solution methods was almost limited to bilevel cases due to the difficulty of the problem. In recent years, in machine…

Optimization and Control · Mathematics 2021-10-27 Ryo Sato , Mirai Tanaka , Akiko Takeda

(Stochastic) bilevel optimization is a frequently encountered problem in machine learning with a wide range of applications such as meta-learning, hyper-parameter optimization, and reinforcement learning. Most of the existing studies on…

Machine Learning · Computer Science 2023-03-16 Meng Ding , Mingxi Lei , Yunwen Lei , Di Wang , Jinhui Xu

Bilevel reinforcement learning (RL), which features intertwined two-level problems, has attracted growing interest recently. The inherent non-convexity of the lower-level RL problem is, however, to be an impediment to developing bilevel…

Optimization and Control · Mathematics 2025-02-28 Yan Yang , Bin Gao , Ya-xiang Yuan

Bilevel optimization, a well-established field for modeling hierarchical decision-making problems, has recently intersected with sustainability studies and practices, resulting in a series of works focusing on bilevel optimization problems…

Optimization and Control · Mathematics 2026-04-07 Giulia Caselli , Manuel Iori , Ivana Ljubić

Hyperparameter tuning is an active area of research in machine learning, where the aim is to identify the optimal hyperparameters that provide the best performance on the validation set. Hyperparameter tuning is often achieved using naive…

Machine Learning · Computer Science 2020-07-23 Ankur Sinha , Tanmay Khandait , Raja Mohanty

Bilevel optimization and bilevel minimax optimization have recently emerged as unifying frameworks for a range of machine-learning tasks, including hyperparameter optimization and reinforcement learning. The existing literature focuses on…

Machine Learning · Computer Science 2026-04-23 Xuelin Zhang , Peipei Yuan

Bilevel optimization is a powerful tool for many machine learning problems, such as hyperparameter optimization and meta-learning. Estimating hypergradients (also known as implicit gradients) is crucial for developing gradient-based methods…

Optimization and Control · Mathematics 2025-05-06 Youran Dong , Junfeng Yang , Wei Yao , Jin Zhang

In this paper, we study a class of bilevel optimization problems, also known as simple bilevel optimization, where we minimize a smooth objective function over the optimal solution set of another convex constrained optimization problem.…

Optimization and Control · Mathematics 2023-04-25 Ruichen Jiang , Nazanin Abolfazli , Aryan Mokhtari , Erfan Yazdandoost Hamedani

In this paper, we studied the federated bilevel optimization problem, which has widespread applications in machine learning. In particular, we developed two momentum-based algorithms for optimizing this kind of problem and established the…

Machine Learning · Computer Science 2022-12-22 Hongchang Gao

Bilevel optimization deals with nested problems in which a leader takes the first decision to minimize their objective function while accounting for a follower's best-response reaction. Constrained bilevel problems with integer variables…

Optimization and Control · Mathematics 2024-11-04 Justin Dumouchelle , Esther Julien , Jannis Kurtz , Elias B. Khalil

Bi-level optimization has achieved considerable success in contemporary machine learning applications, especially for given proper hyperparameters. However, due to the two-level optimization structure, commonly, researchers focus on two…

Machine Learning · Computer Science 2024-11-26 Congliang Chen , Li Shen , Zhiqiang Xu , Wei Liu , Zhi-Quan Luo , Peilin Zhao

In this work, we propose different formulations and gradient-based algorithms for deterministic and stochastic bilevel problems with conflicting objectives in the lower level. Such problems have received little attention in the…

Optimization and Control · Mathematics 2023-11-08 Tommaso Giovannelli , Griffin Dean Kent , Luis Nunes Vicente

Bilevel Optimization has experienced significant advancements recently with the introduction of new efficient algorithms. Mirroring the success in single-level optimization, stochastic gradient-based algorithms are widely used in bilevel…

Optimization and Control · Mathematics 2024-11-12 Junyi Li , Heng Huang

Bilevel optimization has arisen as a powerful tool for solving a variety of machine learning problems. Two current popular bilevel optimizers AID-BiO and ITD-BiO naturally involve solving one or two sub-problems, and consequently, whether…

Machine Learning · Computer Science 2022-06-02 Kaiyi Ji , Mingrui Liu , Yingbin Liang , Lei Ying

Bilevel optimization has gained significant attention in recent years due to its broad applications in machine learning. This paper focuses on bilevel optimization in decentralized networks and proposes a novel single-loop algorithm for…

Optimization and Control · Mathematics 2024-04-24 Youran Dong , Shiqian Ma , Junfeng Yang , Chao Yin

Estimating hyperparameters has been a long-standing problem in machine learning. We consider the case where the task at hand is modeled as the solution to an optimization problem. Here the exact gradient with respect to the hyperparameters…

Optimization and Control · Mathematics 2023-11-16 Matthias J. Ehrhardt , Lindon Roberts

Bilevel optimization has gained prominence in various applications. In this study, we introduce a framework for solving bilevel optimization problems, where the variables in both the lower and upper levels are constrained on Riemannian…

Optimization and Control · Mathematics 2024-11-05 Andi Han , Bamdev Mishra , Pratik Jawanpuria , Akiko Takeda