English
Related papers

Related papers: Learning-to-defer for sequential medical decision-…

200 papers

The learning to defer (L2D) framework allows autonomous systems to be safe and robust by allocating difficult decisions to a human expert. All existing work on L2D assumes that each expert is well-identified, and if any expert were to…

Machine Learning · Computer Science 2024-05-14 Dharmesh Tailor , Aditya Patra , Rajeev Verma , Putra Manggala , Eric Nalisnick

Learning-to-defer (L2D) routes each decision to a system's own predictor or to an external expert. Streaming time-series settings break the offline-L2D assumptions: the data are non-stationary, expert availability shifts over time, and the…

Machine Learning · Computer Science 2026-05-21 Yannis Montreuil , Letian Yu , Axel Carlier , Lai Xing Ng , Wei Tsang Ooi

AI systems often struggle to provide reliable predictions across all inputs, motivating hybrid human-AI decision-making. Existing Learning to Defer (L2D) approaches address this by training models to selectively defer to human experts.…

Machine Learning · Computer Science 2026-03-31 Tim Bary , Benoît Macq , Louis Petit

In learning to defer, a predictor identifies risky decisions and defers them to a human expert. One key issue with this setup is that the expert may end up over-relying on the machine's decisions, due to anchoring bias. At the same time,…

Artificial Intelligence · Computer Science 2023-08-14 Debodeep Banerjee , Stefano Teso , Andrea Passerini

In the Learning to Defer (L2D) framework, a prediction model can either make a prediction or defer it to an expert, as determined by a rejector. Current L2D methods train the rejector to decide whether to reject the {\em entire prediction},…

Methodology · Statistics 2025-10-10 Sahana Rayan , Ambuj Tewari

Developing decision-support systems that complement human performance in classification tasks remains an open challenge. A popular approach, Learning to Defer (LtD), allows a Machine Learning (ML) model to pass difficult cases to a human…

Machine Learning · Computer Science 2025-10-10 Andrea Pugnana , Giovanni De Toni , Cesare Barbera , Roberto Pellungrini , Bruno Lepri , Andrea Passerini

Learning-to-Defer routes each input to the expert that minimizes expected cost, but it assumes that the information available to every expert is fixed at decision time. Many modern systems violate this assumption: after selecting an expert,…

Machine Learning · Statistics 2026-05-29 Yannis Montreuil , Leïna Montreuil , Axel Carlier , Lai Xing Ng , Wei Tsang Ooi

Existing Learning-to-Defer (L2D) frameworks are limited to single-expert deferral, forcing each query to rely on only one expert and preventing the use of collective expertise. We introduce the first framework for Top-$k$ Learning-to-Defer,…

Machine Learning · Computer Science 2026-05-29 Yannis Montreuil , Axel Carlier , Lai Xing Ng , Wei Tsang Ooi

Learning to Defer (L2D) improves AI reliability in decision-critical environments by training AI to either make its own prediction or defer the decision to a human expert. A key challenge is adapting to unseen experts at test time, whose…

Machine Learning · Computer Science 2026-03-03 Joshua Strong , Pramit Saha , Yasin Ibrahim , Cheng Ouyang , Alison Noble

Clinical diagnosis requires sequential evidence acquisition under uncertainty. However, most Large Language Model (LLM) based diagnostic systems assume fully observed patient information and therefore do not explicitly model how clinical…

Artificial Intelligence · Computer Science 2026-04-08 Xuyang Shen , Haoran Liu , Dongjin Song , Martin Renqiang Min

Designing efficient algorithms for combinatorial optimization appears ubiquitously in various scientific fields. Recently, deep reinforcement learning (DRL) frameworks have gained considerable attention as a new approach: they can automate…

Machine Learning · Computer Science 2020-06-30 Sungsoo Ahn , Younggyo Seo , Jinwoo Shin

Learning algorithms can be significantly improved by routing complex or uncertain inputs to specialized experts, balancing accuracy with computational cost. This approach, known as learning to defer, is essential in domains like natural…

Machine Learning · Computer Science 2026-05-01 Corinna Cortes , Anqi Mao , Mehryar Mohri , Yutao Zhong

Learning to defer (L2D) aims to improve human-AI collaboration systems by learning how to defer decisions to humans when they are more likely to be correct than an ML classifier. Existing research in L2D overlooks key real-world aspects…

Clinical text classification requires choosing between specialized fine-tuned models (BERT variants) and general-purpose large language models (LLMs), yet neither dominates across all instances. We introduce Learning to Defer for clinical…

Computation and Language · Computer Science 2026-04-16 Rishik Kondadadi , John E. Ortega

Concept Bottleneck Models (CBMs) are machine learning models that improve interpretability by grounding their predictions on human-understandable concepts, allowing for targeted interventions in their decision-making process. However, when…

Learn-to-Defer is a paradigm that enables learning algorithms to work not in isolation but as a team with human experts. In this paradigm, we permit the system to defer a subset of its tasks to the expert. Although there are currently…

Machine Learning · Computer Science 2024-07-18 Mohammad-Amin Charusaie , Samira Samadi

I propose a novel framework that integrates stochastic differential equations (SDEs) with deep generative models to improve uncertainty quantification in machine learning applications involving structured and temporal data. This approach,…

Machine Learning · Statistics 2026-01-09 James Rice

Recent research suggests that combining AI models with a human expert can exceed the performance of either alone. The combination of their capabilities is often realized by learning to defer algorithms that enable the AI to learn to decide…

Machine Learning · Computer Science 2023-04-18 Patrick Hemmer , Lukas Thede , Michael Vössing , Johannes Jakubik , Niklas Kühl

Learning-to-Defer (L2D) enables hybrid decision-making by routing inputs either to a predictor or to external experts. While promising, L2D is highly vulnerable to adversarial perturbations, which can not only flip predictions but also…

Machine Learning · Statistics 2026-05-29 Yannis Montreuil , Letian Yu , Axel Carlier , Lai Xing Ng , Wei Tsang Ooi

Learning to Defer (L2D) enables a model to predict autonomously or defer to an expert, but prior work largely assumes flat label spaces. We study the first L2D setting with hierarchical multi-label decisions, motivated by medical-imaging…

Artificial Intelligence · Computer Science 2026-05-05 Joshua Strong , Pramit Saha , Emma Sun , Helen Higham , Alison Noble
‹ Prev 1 2 3 10 Next ›