中文
相关论文

相关论文: Neur2BiLO: Neural Bilevel Optimization

200 篇论文

Multi-Objective Bi-Level Optimization (MOBLO) addresses nested multi-objective optimization problems common in a range of applications. However, its multi-objective and hierarchical bilevel nature makes it notably complex. Gradient-based…

最优化与控制 · 数学 2024-06-11 Xinmin Yang , Wei Yao , Haian Yin , Shangzhi Zeng , Jin Zhang

We study a class of bilevel convex optimization problems where the goal is to find the minimizer of an objective function in the upper level, among the set of all optimal solutions of an optimization problem in the lower level. A wide range…

最优化与控制 · 数学 2018-09-27 Mostafa Amini , Farzad Yousefian

Bilevel optimization problems are a class of challenging optimization problems, which contain two levels of optimization tasks. In these problems, the optimal solutions to the lower level problem become possible feasible candidates to the…

神经与进化计算 · 计算机科学 2013-10-08 Ankur Sinha , Pekka Malo , Kalyanmoy Deb

Bilevel learning has gained prominence in machine learning, inverse problems, and imaging applications, including hyperparameter optimization, learning data-adaptive regularizers, and optimizing forward operators. The large-scale nature of…

最优化与控制 · 数学 2025-05-20 Mohammad Sadegh Salehi , Subhadip Mukherjee , Lindon Roberts , Matthias J. Ehrhardt

Variational regularization techniques are dominant in the field of mathematical imaging. A drawback of these techniques is that they are dependent on a number of parameters which have to be set by the user. A by now common strategy to…

最优化与控制 · 数学 2020-12-10 Matthias J. Ehrhardt , Lindon Roberts

Bilevel optimization (BLO) offers a principled framework for hierarchical decision-making and has been widely applied in machine learning tasks such as hyperparameter optimization and meta-learning. While existing BLO methods are mostly…

最优化与控制 · 数学 2025-10-20 Zhuo Chen , Xinjian Xu , Shihui Ying , Tieyong Zeng

Bilevel optimization has arisen as a powerful tool for many machine learning problems such as meta-learning, hyperparameter optimization, and reinforcement learning. In this paper, we investigate the nonconvex-strongly-convex bilevel…

机器学习 · 计算机科学 2021-08-30 Kaiyi Ji , Junjie Yang , Yingbin Liang

With the development of large-scale models, traditional distributed bilevel optimization algorithms cannot be applied directly in low-resource clients. The key reason lies in the excessive computation involved in optimizing both the lower-…

分布式、并行与集群计算 · 计算机科学 2026-01-01 Mingyi Li , Xiao Zhang , Ruisheng Zheng , Hongjian Shi , Yuan Yuan , Xiuzhen Cheng , Dongxiao Yu

This paper introduces a novel double regularization scheme for bilevel optimization problems whose lower-level problem is composite and convex, but not necessarily strongly convex, in the lower-level variable. The analysis focuses on the…

最优化与控制 · 数学 2026-02-06 Mattia Solla , Johannes O. Royset

Simple bilevel problems are optimization problems in which we want to find an optimal solution to an inner problem that minimizes an outer objective function. Such problems appear in many machine learning and signal processing applications…

最优化与控制 · 数学 2022-12-21 Lior Doron , Shimrit Shtern

The goal of coreset selection in supervised learning is to produce a weighted subset of data, so that training only on the subset achieves similar performance as training on the entire dataset. Existing methods achieved promising results in…

机器学习 · 计算机科学 2023-01-25 Xiao Zhou , Renjie Pi , Weizhong Zhang , Yong Lin , Tong Zhang

Bilevel optimization provides a powerful framework for modelling hierarchical decision-making systems. This work presents a sensitivity-based algorithm that addresses the bilevel structure directly by treating the lower-level optimal…

最优化与控制 · 数学 2026-05-28 Eduardo Nolasco , Ross D. King , Vassilios S. Vassiliadis

Bilevel programs model sequential decision interactions between two sets of players and find wide applications in real-world complex systems. In this paper, we consider a bilevel mixed-integer linear program with binary tender, wherein the…

最优化与控制 · 数学 2025-09-03 Bo Zhou , Ruiwei Jiang , Siqian Shen

Bilevel optimization has gained significant attention in recent years due to its broad applications in machine learning. This paper focuses on bilevel optimization in decentralized networks and proposes a novel single-loop algorithm for…

最优化与控制 · 数学 2024-04-24 Youran Dong , Shiqian Ma , Junfeng Yang , Chao Yin

Combinatorial Optimization (CO) has been a long-standing challenging research topic featured by its NP-hard nature. Traditionally such problems are approximately solved with heuristic algorithms which are usually fast but may sacrifice the…

机器学习 · 计算机科学 2021-10-26 Runzhong Wang , Zhigang Hua , Gan Liu , Jiayi Zhang , Junchi Yan , Feng Qi , Shuang Yang , Jun Zhou , Xiaokang Yang

We propose a new approach to solving bilevel optimization problems, intermediate between solving full-system optimality conditions with a Newton-type approach, and treating the inner problem as an implicit function. The overall idea is to…

最优化与控制 · 数学 2024-05-08 Ensio Suonperä , Tuomo Valkonen

Bilevel optimization has been developed for many machine learning tasks with large-scale and high-dimensional data. This paper considers a constrained bilevel optimization problem, where the lower-level optimization problem is convex with…

机器学习 · 计算机科学 2023-08-22 Siyuan Xu , Minghui Zhu

Bilevel optimization is a powerful tool for many machine learning problems, such as hyperparameter optimization and meta-learning. Estimating hypergradients (also known as implicit gradients) is crucial for developing gradient-based methods…

最优化与控制 · 数学 2025-05-06 Youran Dong , Junfeng Yang , Wei Yao , Jin Zhang

Bilevel optimization is defined as a mathematical program, where an optimization problem contains another optimization problem as a constraint. These problems have received significant attention from the mathematical programming community.…

最优化与控制 · 数学 2020-12-08 Ankur Sinha , Pekka Malo , Kalyanmoy Deb

Bilevel programming can be used to formulate many problems in the field of power systems, such as strategic bidding. However, common reformulations of bilevel problems to mixed-integer linear programs make solving such problems hard, which…

最优化与控制 · 数学 2022-07-11 Eléa Prat , Spyros Chatzivasileiadis