English
Related papers

Related papers: A Sparse Nonlinear Classifier Design Using AUC Opt…

200 papers

The Area Under the ROC Curve (AUC) is a widely used performance metric for binary classifiers. However, as a global ranking statistic, the AUC aggregates model behavior over the entire dataset, masking localized weaknesses in specific…

Applications · Statistics 2025-08-12 Agus Sudjianto , Alice J. Liu

As machine learning being used increasingly in making high-stakes decisions, an arising challenge is to avoid unfair AI systems that lead to discriminatory decisions for protected population. A direct approach for obtaining a fair…

Machine Learning · Computer Science 2023-02-24 Yao Yao , Qihang Lin , Tianbao Yang

The Area Under the ROC Curve (AUC) is a well-known metric for evaluating instance-level long-tail learning problems. In the past two decades, many AUC optimization methods have been proposed to improve model performance under long-tail…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Boyu Han , Qianqian Xu , Zhiyong Yang , Shilong Bao , Peisong Wen , Yangbangyan Jiang , Qingming Huang

Semi-supervised learning is pervasive in real-world applications, where only a few labeled data are available and large amounts of instances remain unlabeled. Since AUC is an important model evaluation metric in classification, directly…

Machine Learning · Computer Science 2019-07-30 Wanli Shi , Bin Gu , Xiang Li , Xiang Geng , Heng Huang

Area under the receiver operating characteristics curve (AUC) is an important metric for a wide range of signal processing and machine learning problems, and scalable methods for optimizing AUC have recently been proposed. However, handling…

Machine Learning · Computer Science 2018-06-01 San Gultekin , Avishek Saha , Adwait Ratnaparkhi , John Paisley

Learning to improve AUC performance is an important topic in machine learning. However, AUC maximization algorithms may decrease generalization performance due to the noisy data. Self-paced learning is an effective method for handling noisy…

Machine Learning · Computer Science 2022-07-11 Bin Gu , Chenkang Zhang , Huan Xiong , Heng Huang

Selective classification (or classification with a reject option) pairs a classifier with a selection function to determine whether or not a prediction should be accepted. This framework trades off coverage (probability of accepting a…

Machine Learning · Computer Science 2023-02-23 Andrea Pugnana , Salvatore Ruggieri

The Area Under the ROC Curve (AUC) is a widely employed metric in long-tailed classification scenarios. Nevertheless, most existing methods primarily assume that training and testing examples are drawn i.i.d. from the same distribution,…

Machine Learning · Computer Science 2023-11-07 Siran Dai , Qianqian Xu , Zhiyong Yang , Xiaochun Cao , Qingming Huang

Stochastic Gradient Descent has been widely studied with classification accuracy as a performance measure. However, these stochastic algorithms cannot be directly used when non-decomposable pairwise performance measures are used such as…

Machine Learning · Statistics 2020-12-07 Soham Dan , Dushyant Sahoo

The most popular classification algorithms are designed to maximize classification accuracy during training. However, this strategy may fail in the presence of class imbalance since it is possible to train models with high accuracy by…

Machine Learning · Computer Science 2024-01-26 Erhan Can Ozcan , Berk Görgülü , Mustafa G. Baydogan , Ioannis Ch. Paschalidis

In recommendation systems, one is interested in the ranking of the predicted items as opposed to other losses such as the mean squared error. Although a variety of ways to evaluate rankings exist in the literature, here we focus on the Area…

Machine Learning · Statistics 2015-08-26 Charanpal Dhanjal , Romaric Gaudel , Stephan Clemencon

In high-stakes risk prediction, quantifying uncertainty through interval-valued predictions is essential for reliable decision-making. However, standard evaluation tools like the receiver operating characteristic (ROC) curve and the area…

Machine Learning · Computer Science 2026-02-05 Yuqi Li , Matthew M. Engelhard

Areas under ROC (AUROC) and precision-recall curves (AUPRC) are common metrics for evaluating classification performance for imbalanced problems. Compared with AUROC, AUPRC is a more appropriate metric for highly imbalanced datasets. While…

Machine Learning · Computer Science 2023-04-14 Qi Qi , Youzhi Luo , Zhao Xu , Shuiwang Ji , Tianbao Yang

The Area Under the ROC Curve (AUC) is a key metric for classification, especially under class imbalance, with growing research focus on optimizing AUC over accuracy in applications like medical image analysis and deepfake detection. This…

Machine Learning · Computer Science 2025-05-27 Mingyang Wu , Li Lin , Wenbin Zhang , Xin Wang , Zhenhuan Yang , Shu Hu

Since acquiring perfect supervision is usually difficult, real-world machine learning tasks often confront inaccurate, incomplete, or inexact supervision, collectively referred to as weak supervision. In this work, we present WSAUC, a…

Machine Learning · Computer Science 2024-03-28 Zheng Xie , Yu Liu , Hao-Yuan He , Ming Li , Zhi-Hua Zhou

Multiple binary responses arise in many modern data-analytic problems. Although fitting separate logistic regressions for each response is computationally attractive, it ignores shared structure and can be statistically inefficient,…

Machine Learning · Statistics 2026-01-14 The Tien Mai

Area Under the Receiver Operating Characteristic Curve (AUC-ROC) is a popular evaluation metric for binary classifiers. In this paper, we discuss techniques to segment the AUC-ROC along human-interpretable dimensions. AUC-ROC is not an…

Machine Learning · Computer Science 2022-05-25 Arya Tafvizi , Besim Avci , Mukund Sundararajan

Learning to optimize the area under the receiver operating characteristics curve (AUC) performance for imbalanced data has attracted much attention in recent years. Although there have been several methods of AUC optimization, scaling up…

Machine Learning · Computer Science 2024-10-28 Chao Wang , Kai Wu , Jing Liu

The Area Under the ROC Curve (AUC) is a crucial metric for machine learning, which evaluates the average performance over all possible True Positive Rates (TPRs) and False Positive Rates (FPRs). Based on the knowledge that a skillful…

Machine Learning · Computer Science 2022-06-24 Zhiyong Yang , Qianqian Xu , Shilong Bao , Yuan He , Xiaochun Cao , Qingming Huang

Cost-sensitive learning relies on the availability of a known and fixed cost matrix. However, in some scenarios, the cost matrix is uncertain during training, and re-train a classifier after the cost matrix is specified would not be an…

Machine Learning · Computer Science 2012-09-11 Rui Wang , Ke Tang