English
Related papers

Related papers: Optimized Deferral for Imbalanced Settings

200 papers

Learning-to-Defer routes each input to the expert that minimizes expected cost, but it assumes that the information available to every expert is fixed at decision time. Many modern systems violate this assumption: after selecting an expert,…

Machine Learning · Statistics 2026-05-29 Yannis Montreuil , Leïna Montreuil , Axel Carlier , Lai Xing Ng , Wei Tsang Ooi

Segmentation models based on deep neural networks demonstrate strong generalization for medical image segmentation. However, they often exhibit overconfidence or underconfidence, leading to unreliable confidence scores for segmentation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Qiuyu Tian , Haoliang Sun , Yunshan Wang , Yinghuan Shi , Yilong Yin

The Two-Stage Learning-to-Defer (L2D) framework has been extensively studied for classification and, more recently, regression tasks. However, many real-world applications require solving both tasks jointly in a multi-task setting. We…

Machine Learning · Statistics 2025-08-15 Yannis Montreuil , Shu Heng Yeo , Axel Carlier , Lai Xing Ng , Wei Tsang Ooi

Learning algorithms are often used in conjunction with expert decision makers in practical scenarios, however this fact is largely ignored when designing these algorithms. In this paper we explore how to learn predictors that can either…

Machine Learning · Computer Science 2021-01-26 Hussein Mozannar , David Sontag

Machine unlearning has been used to remove unwanted knowledge acquired by large language models (LLMs). In this paper, we examine machine unlearning from an optimization perspective, framing it as a regularized multi-task optimization…

Machine Learning · Computer Science 2025-05-07 Zhiqi Bu , Xiaomeng Jin , Bhanukiran Vinzamuri , Anil Ramakrishna , Kai-Wei Chang , Volkan Cevher , Mingyi Hong

In the last years decision-focused learning framework, also known as predict-and-optimize, have received increasing attention. In this setting, the predictions of a machine learning model are used as estimated cost coefficients in the…

Machine Learning · Computer Science 2022-06-20 Jayanta Mandi , Víctor Bucarey , Maxime Mulamba , Tias Guns

Semi-supervised learning (SSL), thanks to the significant reduction of data annotation costs, has been an active research topic for large-scale 3D scene understanding. However, the existing SSL-based methods suffer from severe training…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Mengtian Li , Shaohui Lin , Zihan Wang , Yunhang Shen , Baochang Zhang , Lizhuang Ma

The ubiquity of AI leads to situations where humans and AI work together, creating the need for learning-to-defer algorithms that determine how to partition tasks between AI and humans. We work to improve learning-to-defer algorithms when…

Machine Learning · Computer Science 2021-12-22 Naveen Raman , Michael Yee

Learning to Defer (L2D) enables a model to predict autonomously or defer to an expert, but prior work largely assumes flat label spaces. We study the first L2D setting with hierarchical multi-label decisions, motivated by medical-imaging…

Artificial Intelligence · Computer Science 2026-05-05 Joshua Strong , Pramit Saha , Emma Sun , Helen Higham , Alison Noble

Data imbalance between common and rare diseases during model training often causes intelligent diagnosis systems to have biased predictions towards common diseases. The state-of-the-art approaches apply a two-stage learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Chenghua Zeng , Huijuan Lu , Kanghao Chen , Ruixuan Wang , Wei-Shi Zheng

Large Language Models excel in generative tasks but exhibit inefficiencies in structured text selection, particularly in extractive question answering. This challenge is magnified in resource-constrained environments, where deploying…

Computation and Language · Computer Science 2026-05-29 Yannis Montreuil , Shu Heng Yeo , Axel Carlier , Lai Xing Ng , Wei Tsang Ooi

Despite the significant improvements achieved by large language models (LLMs) in English reasoning tasks, these models continue to struggle with multilingual reasoning. Recent studies leverage a full-parameter and two-stage training…

Computation and Language · Computer Science 2025-01-08 Yuchun Fan , Yongyu Mu , Yilin Wang , Lei Huang , Junhao Ruan , Bei Li , Tong Xiao , Shujian Huang , Xiaocheng Feng , Jingbo Zhu

Clinical text classification requires choosing between specialized fine-tuned models (BERT variants) and general-purpose large language models (LLMs), yet neither dominates across all instances. We introduce Learning to Defer for clinical…

Computation and Language · Computer Science 2026-04-16 Rishik Kondadadi , John E. Ortega

We consider distributed optimization under communication constraints for training deep learning models. We propose a new algorithm, whose parameter updates rely on two forces: a regular gradient step, and a corrective direction dictated by…

Machine Learning · Computer Science 2022-04-29 Yunfei Teng , Wenbo Gao , Francois Chalus , Anna Choromanska , Donald Goldfarb , Adrian Weller

Although large language models (LLMs) have demonstrated their effectiveness in a wide range of applications, they have also been observed to perpetuate unwanted biases present in the training data, potentially leading to harm for…

Computation and Language · Computer Science 2026-03-09 Schrasing Tong , Eliott Zemour , Jessica Lu , Rawisara Lohanimit , Lalana Kagal

Learn-to-Defer is a paradigm that enables learning algorithms to work not in isolation but as a team with human experts. In this paradigm, we permit the system to defer a subset of its tasks to the expert. Although there are currently…

Machine Learning · Computer Science 2024-07-18 Mohammad-Amin Charusaie , Samira Samadi

Deep neural networks may perform poorly when training datasets are heavily class-imbalanced. Recently, two-stage methods decouple representation learning and classifier learning to improve performance. But there is still the vital issue of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Zhisheng Zhong , Jiequan Cui , Shu Liu , Jiaya Jia

We introduce the first one-stage Top-$k$ Learning-to-Defer framework, which unifies prediction and deferral by learning a shared score-based model that selects the $k$ most cost-effective entities-labels or experts-per input. While existing…

Machine Learning · Statistics 2025-10-14 Yannis Montreuil , Axel Carlier , Lai Xing Ng , Wei Tsang Ooi

Bilevel optimization is a central tool in machine learning for high-dimensional hyperparameter tuning. Its applications are vast; for instance, in imaging it can be used for learning data-adaptive regularizers and optimizing forward…

Optimization and Control · Mathematics 2025-11-11 Mohammad Sadegh Salehi , Subhadip Mukherjee , Lindon Roberts , Matthias J. Ehrhardt

A major challenge in training large-scale machine learning models is configuring the training process to maximize model performance, i.e., finding the best training setup from a vast design space. In this work, we unlock a gradient-based…

Machine Learning · Statistics 2025-03-19 Logan Engstrom , Andrew Ilyas , Benjamin Chen , Axel Feldmann , William Moses , Aleksander Madry