English
Related papers

Related papers: BiLO-CPDP: Bi-Level Programming for Automated Mode…

200 papers

Conformal prediction (CP) is a promising uncertainty quantification framework which works as a wrapper around a black-box classifier to construct prediction sets (i.e., subset of candidate classes) with provable guarantees. However,…

Machine Learning · Computer Science 2025-06-10 Yuanjie Shi , Hooman Shahrokhi , Xuesong Jia , Xiongzhi Chen , Janardhan Rao Doppa , Yan Yan

Bilevel Optimization Programming is used to model complex and conflicting interactions between agents, for example in Robust AI or Privacy-preserving AI. Integrating bilevel mathematical programming within deep learning is thus an essential…

Machine Learning · Computer Science 2023-03-01 Francesco Alesiani

Collaborative learning is an important tool to train multiple clients more effectively by enabling communication among clients. Identifying helpful clients, however, presents challenging and often introduces significant overhead. In this…

Machine Learning · Computer Science 2024-09-10 Diba Hashemi , Lie He , Martin Jaggi

Bilevel optimization problems comprise an upper level optimization task that contains a lower level optimization task as a constraint. While there is a significant and growing literature devoted to solving bilevel problems with single…

Neural and Evolutionary Computing · Computer Science 2024-09-06 Bing Wang , Hemant K. Singh , Tapabrata Ray

Bilevel optimization has become a powerful framework in various machine learning applications including meta-learning, hyperparameter optimization, and network architecture search. There are generally two classes of bilevel optimization…

Machine Learning · Computer Science 2021-08-03 Kaiyi Ji

Just-In-Time defect prediction (JIT-DP) models can identify defect-inducing commits at check-in time. Even though previous studies have achieved a great progress, these studies still have the following limitations: 1) useful information…

Software Engineering · Computer Science 2022-04-12 Chao Ni , Kaiwen Yang , Xin Xia , David Lo , Xiang Chen , Xiaohu Yang

In online continual learning (CL), models trained on changing distributions easily forget previously learned knowledge and bias toward newly received tasks. To address this issue, we present Continual Bias Adaptor (CBA), a bi-level…

Machine Learning · Computer Science 2024-08-27 Quanziang Wang , Renzhen Wang , Yichen Wu , Xixi Jia , Minghao Zhou , Deyu Meng

Context: The effectiveness of data selection approaches in improving the performance of cross project defect prediction(CPDP) has been shown in multiple previous studies. Beside that, replication studies play an important role in the…

Software Engineering · Computer Science 2020-04-22 Seyedrebvar Hosseini , Burak Turhan

Bilevel learning refers to machine learning problems that can be formulated as bilevel optimization models, where decisions are organized in a hierarchical structure. This paradigm has recently gained considerable attention in machine…

Optimization and Control · Mathematics 2026-05-05 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo , Alain Zemkoho

We study a bi-level online provisioning and scheduling problem motivated by network resource allocation, where provisioning decisions are made at a slow time scale while queue-/state-dependent scheduling is performed at a fast time scale.…

Machine Learning · Computer Science 2026-02-24 Jialei Liu , C. Emre Koksal , Ming Shi

Pairwise difference learning (PDL) has recently been introduced as a new meta-learning technique for regression. Instead of learning a mapping from instances to outcomes in the standard way, the key idea is to learn a function that takes…

Machine Learning · Computer Science 2024-07-01 Mohamed Karim Belaid , Maximilian Rabus , Eyke Hüllermeier

Bilevel programs (BPs) find a wide range of applications in fields such as energy, transportation, and machine learning. As compared to BPs with continuous (linear/convex) optimization problems in both levels, the BPs with discrete decision…

Optimization and Control · Mathematics 2024-07-25 Bo Zhou , Ruiwei Jiang , Siqian Shen

Over the past fifty years, numerous software defect prediction (SDP) approaches have been proposed. However, the ability to explain why predictors make certain predictions remains limited. Explainable SDP has emerged as a promising solution…

Software Engineering · Computer Science 2025-08-29 Guifang Xu , Zhiling Zhu , Xingcheng Guo , Wei Wang

Decision Transformer (DT) shows promise for generative auto-bidding by capturing temporal dependencies, but suffers from two critical limitations: insufficient cross-correlation modeling among state, action, and return-to-go (RTG)…

Machine Learning · Computer Science 2026-01-30 Jinren Ding , Xuejian Xu , Shen Jiang , Zhitong Hao , Jinhui Yang , Peng Jiang

Cross-project defect prediction (CPDP) aims to predict defects of projects lacking training data by using prediction models trained on historical defect data from other projects. However, since the distribution differences between datasets…

Software Engineering · Computer Science 2019-01-25 Haonan Tong , Bin Liu , Shihai Wang , Qiuying Li

Bi-level optimization, especially the gradient-based category, has been widely used in the deep learning community including hyperparameter optimization and meta-knowledge extraction. Bi-level optimization embeds one problem within another…

Machine Learning · Computer Science 2023-07-11 Can Chen , Xi Chen , Chen Ma , Zixuan Liu , Xue Liu

Many problems in machine learning involve bilevel optimization (BLO), including hyperparameter optimization, meta-learning, and dataset distillation. Bilevel problems consist of two nested sub-problems, called the outer and inner problems,…

Machine Learning · Computer Science 2022-12-29 Paul Vicol , Jonathan Lorraine , Fabian Pedregosa , David Duvenaud , Roger Grosse

In recent years, a variety of gradient-based methods have been developed to solve Bi-Level Optimization (BLO) problems in machine learning and computer vision areas. However, the theoretical correctness and practical effectiveness of these…

Machine Learning · Computer Science 2022-01-04 Risheng Liu , Pan Mu , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

Uncertainty quantification in PDE inverse problems is essential in many applications. Scientific machine learning and AI enable data-driven learning of model components while preserving physical structure, and provide the scalability and…

Machine Learning · Computer Science 2026-01-12 Ray Zirui Zhang , Christopher E. Miles , Xiaohui Xie , John S. Lowengrub

In this paper, we propose a procedure for designing controlled test problems for single-objective bilevel optimization. The construction procedure is flexible and allows its user to control the different complexities that are to be included…

Mathematical Software · Computer Science 2016-08-17 Ankur Sinha , Pekka Malo , Kalyanmoy Deb