English
Related papers

Related papers: Predictor-Rejector Multi-Class Abstention: Theoret…

200 papers

Despite remarkable progress made in natural language processing, even the state-of-the-art models often make incorrect predictions. Such predictions hamper the reliability of systems and limit their widespread adoption in real-world…

Computation and Language · Computer Science 2023-05-04 Neeraj Varshney , Chitta Baral

This paper studies classification with an abstention option in the online setting. In this setting, examples arrive sequentially, the learner is given a hypothesis class $\mathcal H$, and the goal of the learner is to either predict a label…

Machine Learning · Computer Science 2016-09-29 Chicheng Zhang , Kamalika Chaudhuri

Abstaining classifiers have the option to refrain from providing a prediction for instances that are difficult to classify. The abstention mechanism is designed to trade off the classifier's performance on the accepted data while ensuring a…

Machine Learning · Computer Science 2025-04-15 Daphne Lenders , Andrea Pugnana , Roberto Pellungrini , Toon Calders , Dino Pedreschi , Fosca Giannotti

The Two-Stage Learning-to-Defer (L2D) framework has been extensively studied for classification and, more recently, regression tasks. However, many real-world applications require solving both tasks jointly in a multi-task setting. We…

Machine Learning · Statistics 2025-08-15 Yannis Montreuil , Shu Heng Yeo , Axel Carlier , Lai Xing Ng , Wei Tsang Ooi

Abstaining classifiers have the option to abstain from making predictions on inputs that they are unsure about. These classifiers are becoming increasingly popular in high-stakes decision-making problems, as they can withhold uncertain…

Machine Learning · Statistics 2023-11-10 Yo Joong Choe , Aditya Gangrade , Aaditya Ramdas

We study a sequential prediction problem in which an adversary is allowed to inject arbitrarily many adversarial instances in a stream of i.i.d. instances, but at each round, the learner may also abstain from making a prediction without…

Machine Learning · Computer Science 2026-03-19 Jialin Yu , Moïse Blanchard

A fundamental challenge in machine learning is the choice of a loss as it characterizes our learning task, is minimized in the training phase, and serves as an evaluation criterion for estimators. Proper losses are commonly chosen, ensuring…

Machine Learning · Statistics 2026-03-04 Han Bao , Asuka Takatsu

This paper proposes a classification framework with a rejection option to mitigate the performance deterioration caused by adversarial examples. While recent machine learning algorithms achieve high prediction performance, they are…

Machine Learning · Computer Science 2020-10-27 Masahiro Kato , Zhenghang Cui , Yoshihiro Fukuhara

Although neural networks (especially deep neural networks) have achieved \textit{better-than-human} performance in many fields, their real-world deployment is still questionable due to the lack of awareness about the limitation in their…

Machine Learning · Computer Science 2023-04-12 Mehedi Hasan , Moloud Abdar , Abbas Khosravi , Uwe Aickelin , Pietro Lio' , Ibrahim Hossain , Ashikur Rahman , Saeid Nahavandi

We investigate the problem of multiclass classification with rejection, where a classifier can choose not to make a prediction to avoid critical misclassification. First, we consider an approach based on simultaneous training of a…

Machine Learning · Statistics 2019-10-31 Chenri Ni , Nontawat Charoenphakdee , Junya Honda , Masashi Sugiyama

In this work, we consider a binary classification problem and cast it into a binary hypothesis testing framework, where the observations can be perturbed by an adversary. To improve the adversarial robustness of a classifier, we include an…

Machine Learning · Computer Science 2021-10-01 Abed AlRahman Al Makdah , Vaibhav Katewa , Fabio Pasqualetti

We construct and analyze active learning algorithms for the problem of binary classification with abstention. We consider three abstention settings: \emph{fixed-cost} and two variants of \emph{bounded-rate} abstention, and for each of them…

Machine Learning · Computer Science 2019-06-04 Shubhanshu Shekhar , Mohammad Ghavamzadeh , Tara Javidi

We provide novel theoretical insights on structured prediction in the context of efficient convex surrogate loss minimization with consistency guarantees. For any task loss, we construct a convex surrogate that can be optimized via…

Machine Learning · Computer Science 2018-01-30 Anton Osokin , Francis Bach , Simon Lacoste-Julien

The problem of learning to defer with multiple experts consists of optimally assigning input instances to experts, balancing the trade-off between their accuracy and computational cost. This is a critical challenge in natural language…

Machine Learning · Computer Science 2025-12-30 Anqi Mao , Mehryar Mohri , Yutao Zhong

Algorithmic decision making is increasingly prevalent, but often vulnerable to strategic manipulation by agents seeking a favorable outcome. Prior research has shown that classifier abstention (allowing a classifier to decline making a…

Machine Learning · Computer Science 2025-11-03 Lina Alkarmi , Ziyuan Huang , Mingyan Liu

This paper introduces a novel two-stage machine learning-based surrogate modeling framework to address inverse problems in scientific and engineering fields. In the first stage of the proposed framework, a machine learning model termed the…

Machine Learning · Computer Science 2024-01-05 Farhad Pourkamali-Anaraki , Jamal F. Husseini , Evan J. Pineda , Brett A. Bednarcyk , Scott E. Stapleton

In contrast to conventional (single-label) classification, the setting of multilabel classification (MLC) allows an instance to belong to several classes simultaneously. Thus, instead of selecting a single class label, predictions take the…

Machine Learning · Computer Science 2020-01-27 Vu-Linh Nguyen , Eyke Hüllermeier

Prediction with the possibility of abstention (or selective prediction) is an important problem for error-critical machine learning applications. While well-studied in the classification setup, selective approaches to regression are much…

Machine Learning · Statistics 2023-09-29 Fedor Noskov , Alexander Fishkov , Maxim Panov

Robustness towards adversarial attacks is a vital property for classifiers in several applications such as autonomous driving, medical diagnosis, etc. Also, in such scenarios, where the cost of misclassification is very high, knowing when…

Machine Learning · Computer Science 2024-10-15 Vrund Shah , Tejas Chaudhari , Naresh Manwani

Motivated by applications to resource-limited and safety-critical domains, we study selective classification in the online learning model, wherein a predictor may abstain from classifying an instance. For example, this may model an adaptive…

Machine Learning · Computer Science 2021-10-28 Aditya Gangrade , Anil Kag , Ashok Cutkosky , Venkatesh Saligrama