English
Related papers

Related papers: Learning with Multiclass AUC: Theory and Algorithm…

200 papers

When minimizing the empirical risk in binary classification, it is a common practice to replace the zero-one loss with a surrogate loss to make the learning objective feasible to optimize. Examples of well-known surrogate losses for binary…

Machine Learning · Statistics 2023-06-07 Nontawat Charoenphakdee , Jongyeong Lee , Masashi Sugiyama

The area under the ROC curve (AUC) is one of the most widely used performance measures for classification models in machine learning. However, it summarizes the true positive rates (TPRs) over all false positive rates (FPRs) in the ROC…

Machine Learning · Computer Science 2022-10-28 Yao Yao , Qihang Lin , Tianbao Yang

Area Under the Receiver Operating Characteristic Curve (AUC-ROC) is a popular evaluation metric for binary classifiers. In this paper, we discuss techniques to segment the AUC-ROC along human-interpretable dimensions. AUC-ROC is not an…

Machine Learning · Computer Science 2022-05-25 Arya Tafvizi , Besim Avci , Mukund Sundararajan

Although binary classification is a well-studied problem in computer vision, training reliable classifiers under severe class imbalance remains a challenging problem. Recent work has proposed techniques that mitigate the effects of training…

Machine Learning · Computer Science 2024-06-06 Kelsey Lieberman , Shuai Yuan , Swarna Kamlam Ravindran , Carlo Tomasi

Learning to optimize the area under the receiver operating characteristics curve (AUC) performance for imbalanced data has attracted much attention in recent years. Although there have been several methods of AUC optimization, scaling up…

Machine Learning · Computer Science 2024-10-28 Chao Wang , Kai Wu , Jing Liu

Receiver operating characteristic (ROC) curve is an informative tool in binary classification and Area Under ROC Curve (AUC) is a popular metric for reporting performance of binary classifiers. In this paper, first we present a…

Machine Learning · Computer Science 2021-09-14 Khashayar Namdar , Masoom A. Haider , Farzad Khalvati

The Area Under the ROC Curve (AUC) is a key metric for classification, especially under class imbalance, with growing research focus on optimizing AUC over accuracy in applications like medical image analysis and deepfake detection. This…

Machine Learning · Computer Science 2025-05-27 Mingyang Wu , Li Lin , Wenbin Zhang , Xin Wang , Zhenhuan Yang , Shu Hu

The Area Under the ROC Curve (AUC) is a well-known metric for evaluating instance-level long-tail learning problems. In the past two decades, many AUC optimization methods have been proposed to improve model performance under long-tail…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Boyu Han , Qianqian Xu , Zhiyong Yang , Shilong Bao , Peisong Wen , Yangbangyan Jiang , Qingming Huang

Imbalanced datasets pose significant challenges in areas including neuroscience, cognitive science, and medical diagnostics, where accurately detecting minority classes is essential for robust model performance. This study addresses the…

Machine Learning · Computer Science 2025-06-12 Minheng Xiao

The predictive quality of machine learning models is typically measured in terms of their (approximate) expected prediction accuracy or the so-called Area Under the Curve (AUC). Minimizing the reciprocals of these measures are the goals of…

Machine Learning · Statistics 2019-03-04 Hiva Ghanbari , Minhan Li , Katya Scheinberg

Maximizing the area under the receiver operating characteristic curve (AUC) is a standard approach to imbalanced classification. So far, various supervised AUC optimization methods have been developed and they are also extended to…

Machine Learning · Statistics 2022-04-12 Tomoya Sakai , Gang Niu , Masashi Sugiyama

The Area Under the ROC Curve (AUC) is a widely used performance measure for imbalanced classification arising from many application domains where high-dimensional sparse data is abundant. In such cases, each $d$ dimensional sample has only…

Machine Learning · Computer Science 2020-09-24 Baojian Zhou , Yiming Ying , Steven Skiena

Many applications of AI involve scoring individuals using a learned function of their attributes. These predictive risk scores are then used to take decisions based on whether the score exceeds a certain threshold, which may vary depending…

Machine Learning · Statistics 2021-02-26 Robin Vogel , Aurélien Bellet , Stephan Clémençon

Medical events of interest, such as mortality, often happen at a low rate in electronic medical records, as most admitted patients survive. Training models with this imbalance rate (class density discrepancy) may lead to suboptimal…

Machine Learning · Computer Science 2022-08-02 Zepeng Huo , Xiaoning Qian , Shuai Huang , Zhangyang Wang , Bobak J. Mortazavi

We present a new active learning framework for multiclass classification based on surrogate risk minimization that operates beyond the standard realizability assumption. Existing surrogate-based active learning algorithms crucially rely on…

Machine Learning · Computer Science 2025-06-05 Atul Ganju , Shashaank Aiyer , Ved Sriraman , Karthik Sridharan

In this paper, we provide new theoretical results on the generalization properties of learning algorithms for multiclass classification problems. The originality of our work is that we propose to use the confusion matrix of a classifier as…

Machine Learning · Computer Science 2012-05-25 Pierre Machart , Liva Ralaivola

The ROC curve is the gold standard for measuring the performance of a test/scoring statistic regarding its capacity to discriminate between two statistical populations in a wide variety of applications, ranging from anomaly detection in…

Statistics Theory · Mathematics 2023-01-25 Stéphan Clémençon , Myrto Limnios , Nicolas Vayatis

Multiclass neural network classifiers are typically trained using cross-entropy loss but evaluated using metrics derived from the confusion matrix, such as Accuracy, $F_\beta$-Score, and Matthews Correlation Coefficient. This mismatch…

Machine Learning · Computer Science 2025-05-27 Deyuan Li , Taesoo Daniel Lee , Marynel Vázquez , Nathan Tsoi

We formulate the local ranking problem in the framework of bipartite ranking where the goal is to focus on the best instances. We propose a methodology based on the construction of real-valued scoring functions. We study empirical risk…

Statistics Theory · Mathematics 2016-08-16 Stéphan Clémençon , Nicolas Vayatis

We aim at developing and improving the imbalanced business risk modeling via jointly using proper evaluation criteria, resampling, cross-validation, classifier regularization, and ensembling techniques. Area Under the Receiver Operating…

Machine Learning · Statistics 2019-03-14 Yan Wang , Xuelei Sherry Ni