English
Related papers

Related papers: Double Ramp Loss Based Reject Option Classifier

200 papers

Despite the power of deep neural networks for a wide range of tasks, an overconfident prediction issue has limited their practical use in many safety-critical applications. Many recent works have been proposed to mitigate this issue, but…

Machine Learning · Computer Science 2020-08-14 Jooyoung Moon , Jihyo Kim , Younghak Shin , Sangheum Hwang

We investigate the problem of multiclass classification with rejection, where a classifier can choose not to make a prediction to avoid critical misclassification. First, we consider an approach based on simultaneous training of a…

Machine Learning · Statistics 2019-10-31 Chenri Ni , Nontawat Charoenphakdee , Junya Honda , Masashi Sugiyama

Generative classifiers are constructed on the basis of a joint probability distribution and are typically learned using closed-form procedures that rely on data statistics and maximize scores related to data fitting. However, these scores…

Machine Learning · Computer Science 2025-03-31 Aritz Pérez , Carlos Echegoyen , Guzmán Santafé

Machine learning (ML) models always make a prediction, even when they are likely to be wrong. This causes problems in practical applications, as we do not know if we should trust a prediction. ML with reject option addresses this issue by…

We study the problem of off-policy value evaluation in reinforcement learning (RL), where one aims to estimate the value of a new policy based on data collected by a different policy. This problem is often a critical step when applying RL…

Machine Learning · Computer Science 2016-05-27 Nan Jiang , Lihong Li

We study the problem of classification with a reject option for a fixed predictor, applicable in natural language processing. We introduce a new problem formulation for this scenario, and an algorithm minimizing a new surrogate loss…

Machine Learning · Computer Science 2023-02-01 Christopher Mohri , Daniel Andor , Eunsol Choi , Michael Collins

A graph-based classification method is proposed for semi-supervised learning in the case of Euclidean data and for classification in the case of graph data. Our manifold learning technique is based on a convex optimization problem involving…

Machine Learning · Computer Science 2019-01-29 Carlos M. Alaíz , Michaël Fanuel , Johan A. K. Suykens

We consider the problem of sequential decision making under uncertainty in which the loss caused by a decision depends on the following binary observation. In competitive on-line learning, the goal is to design decision algorithms that are…

Machine Learning · Computer Science 2007-05-23 Vladimir Vovk

We investigate the problem of regression where one is allowed to abstain from predicting. We refer to this framework as regression with reject option as an extension of classification with reject option. In this context, we focus on the…

Machine Learning · Statistics 2021-03-08 Christophe Denis , Mohamed Hebiri , Ahmed Zaoui

This paper proposes a classification framework with a rejection option to mitigate the performance deterioration caused by adversarial examples. While recent machine learning algorithms achieve high prediction performance, they are…

Machine Learning · Computer Science 2020-10-27 Masahiro Kato , Zhenghang Cui , Yoshihiro Fukuhara

In real-world applications, one often encounters ambiguously labeled data, where different annotators assign conflicting class labels. Partial-label learning allows training classifiers in this weakly supervised setting, where…

Machine Learning · Computer Science 2025-10-27 Tobias Fuchs , Florian Kalinke , Klemens Böhm

In this paper, we propose an optimal rejection method for rejecting ambiguous samples by a rejection function. This rejection function is trained together with a classification function under the framework of Learning-with-Rejection (LwR).…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Xiaotong Ji , Yuchen Zheng , Daiki Suehiro , Seiichi Uchida

We present an extensive analysis of relative deviation bounds, including detailed proofs of two-sided inequalities and their implications. We also give detailed proofs of two-sided generalization bounds that hold in the general case of…

Machine Learning · Computer Science 2016-04-06 Corinna Cortes , Spencer Greenberg , Mehryar Mohri

We develop two penalty based difference of convex (DC) algorithms for solving chance constrained programs. First, leveraging a rank-based DC decomposition of the chance constraint, we propose a proximal penalty based DC algorithm in the…

Optimization and Control · Mathematics 2026-03-16 Zhiping Li , Nan Jiang , Rujun Jiang

We consider the large sum of DC (Difference of Convex) functions minimization problem which appear in several different areas, especially in stochastic optimization and machine learning. Two DCA (DC Algorithm) based algorithms are proposed:…

Optimization and Control · Mathematics 2019-11-12 Hoai An Le Thi , Hoai Minh Le , Duy Nhat Phan , Bach Tran

Learning with rejection is an important framework that can refrain from making predictions to avoid critical mispredictions by balancing between prediction and rejection. Previous studies on cost-based rejection only focused on the…

Machine Learning · Computer Science 2023-11-09 Xin Cheng , Yuzhou Cao , Haobo Wang , Hongxin Wei , Bo An , Lei Feng

A rank estimator in robust regression is a minimizer of a function which depends (in addition to other factors) on the ordering of residuals but not on their values. Here we focus on the optimization aspects of rank estimators. We…

Optimization and Control · Mathematics 2019-10-15 Michal Cerny , Miroslav Rada , Jaromir Antoch , Milan Hladik

The empirical loss, commonly referred to as the average loss, is extensively utilized for training machine learning models. However, in order to address the diverse performance requirements of machine learning models, the use of the…

Optimization and Control · Mathematics 2024-01-04 Rufeng Xiao , Yuze Ge , Rujun Jiang , Yifan Yan

Robustness towards adversarial attacks is a vital property for classifiers in several applications such as autonomous driving, medical diagnosis, etc. Also, in such scenarios, where the cost of misclassification is very high, knowing when…

Machine Learning · Computer Science 2024-10-15 Vrund Shah , Tejas Chaudhari , Naresh Manwani

This paper illustrates the central role of loss functions in data-driven decision making, providing a comprehensive survey on their influence in cost-sensitive classification (CSC) and reinforcement learning (RL). We demonstrate how…

Machine Learning · Statistics 2025-04-07 Kaiwen Wang , Nathan Kallus , Wen Sun