English
Related papers

Related papers: Understanding the Generalization of Bilevel Progra…

200 papers

Bilevel optimization has gained significant attention in recent years due to its broad applications in machine learning. This paper focuses on bilevel optimization in decentralized networks and proposes a novel single-loop algorithm for…

Optimization and Control · Mathematics 2024-04-24 Youran Dong , Shiqian Ma , Junfeng Yang , Chao Yin

Bilevel optimization (BO) is widely applicable to many machine learning problems. Scaling BO, however, requires repeatedly computing hypergradients, which involves solving inverse Hessian-vector products (IHVPs). In practice, these…

Machine Learning · Computer Science 2026-04-01 Disen Liao , Felix Dangel , Yaoliang Yu

Hyperparameter optimization (HPO) is critical for enhancing the performance of machine learning models, yet it often involves a computationally intensive search across a large parameter space. Traditional approaches such as Grid Search and…

Machine Learning · Computer Science 2024-12-24 Md. Tarek Hasan

One of the most critical issues in machine learning is the selection of appropriate hyper parameters for training models. Machine learning models may be able to reach the best training performance and may increase the ability to generalize…

Machine Learning · Computer Science 2023-02-23 Caner Erden , Halil Ibrahim Demir , Abdullah Hulusi Kökçam

Bilevel optimization has been widely applied in many important machine learning applications such as hyperparameter optimization and meta-learning. Recently, several momentum-based algorithms have been proposed to solve bilevel optimization…

Machine Learning · Computer Science 2021-12-17 Junjie Yang , Kaiyi Ji , Yingbin Liang

Bilevel programming has recently received attention in the literature due to its wide range of applications, including reinforcement learning and hyper-parameter optimization. However, it is widely assumed that the underlying bilevel…

Machine Learning · Computer Science 2024-10-11 Parvin Nazari , Ahmad Mousavi , Davoud Ataee Tarzanagh , George Michailidis

This paper consider solving a class of nonconvex-strongly-convex distributed stochastic bilevel optimization (DSBO) problems with personalized inner-level objectives. Most existing algorithms require computational loops for hypergradient…

Optimization and Control · Mathematics 2025-04-08 Youcheng Niu , Jinming Xu , Ying Sun , Yan Huang , Li Chai

We study reinforcement learning in hybrid discrete-continuous action spaces, such as settings where the discrete component selects a regime (or index) and the continuous component optimizes within it -- a structure common in robotics,…

Machine Learning · Computer Science 2026-05-15 Matias Alvo , Daniel Russo , Yash Kanoria

Hyperparameter optimization (HPO) is an important step in machine learning (ML) model development, but common practices are archaic -- primarily relying on manual or grid searches. This is partly because adopting advanced HPO algorithms…

Machine Learning · Computer Science 2024-02-08 Sungduk Yu , Mike Pritchard , Po-Lun Ma , Balwinder Singh , Sam Silva

Stochastic bilevel optimization tackles challenges involving nested optimization structures. Its fast-growing scale nowadays necessitates efficient distributed algorithms. In conventional distributed bilevel methods, each worker must…

Optimization and Control · Mathematics 2024-05-30 Yutong He , Jie Hu , Xinmeng Huang , Songtao Lu , Bin Wang , Kun Yuan

Bilevel optimization (BO) is useful for solving a variety of important machine learning problems including but not limited to hyperparameter optimization, meta-learning, continual learning, and reinforcement learning. Conventional BO…

Machine Learning · Computer Science 2022-09-20 Mao Ye , Bo Liu , Stephen Wright , Peter Stone , Qiang Liu

Zero-shot hyperparameter optimization (HPO) is a simple yet effective use of transfer learning for constructing a small list of hyperparameter (HP) configurations that complement each other. That is to say, for any given dataset, at least…

Machine Learning · Statistics 2020-07-28 Fela Winkelmolen , Nikita Ivkin , H. Furkan Bozkurt , Zohar Karnin

Practical optimization problems may contain different kinds of difficulties that are often not tractable if one relies on a particular optimization method. Different optimization approaches offer different strengths that are good at…

Neural and Evolutionary Computing · Computer Science 2024-07-08 Ankur Sinha , Dhaval Pujara , Hemant Kumar Singh

Bilevel optimization has become a powerful framework in various machine learning applications including meta-learning, hyperparameter optimization, and network architecture search. There are generally two classes of bilevel optimization…

Machine Learning · Computer Science 2021-08-03 Kaiyi Ji

Although application examples of multilevel optimization have already been discussed since the 1990s, the development of solution methods was almost limited to bilevel cases due to the difficulty of the problem. In recent years, in machine…

Optimization and Control · Mathematics 2021-10-27 Ryo Sato , Mirai Tanaka , Akiko Takeda

Programmatic hyperparameter optimization (HPO) methods, such as Bayesian optimization and evolutionary algorithms, are highly sample-efficient in identifying optimal hyperparameter configurations for machine learning (ML) models. However,…

Classical learning theory suggests that the optimal generalization performance of a machine learning model should occur at an intermediate model complexity, with simpler models exhibiting high bias and more complex models exhibiting high…

Machine Learning · Statistics 2020-11-09 Ben Adlam , Jeffrey Pennington

Stochastic bilevel optimization finds widespread applications in machine learning, including meta-learning, hyperparameter optimization, and neural architecture search. To extend stochastic bilevel optimization to distributed data, several…

Machine Learning · Computer Science 2026-05-26 Yihan Zhang , My T. Thai , Jie Wu , Hongchang Gao

This paper considers a class of distributed bilevel optimization (DBO) problems with a coupled inner-level subproblem. Existing approaches typically rely on hypergradient estimations involving computationally expensive Hessian evaluation.…

Optimization and Control · Mathematics 2026-02-27 Youcheng Niu , Jinming Xu , Ying Sun , Li Chai , Jiming Chen

Gradient-based optimization has been critical to the success of machine learning, updating a single set of parameters to minimize a single loss. A growing number of applications rely on a generalization of this, where we have a bilevel or…

Machine Learning · Computer Science 2024-07-02 Jonathan Lorraine