English
Related papers

Related papers: Decomposing Global AUC into Cluster-Level Contribu…

200 papers

The Area Under the the Receiver Operating Characteristics (ROC) Curve, referred to as AUC, is a well-known performance measure in the supervised learning domain. Due to its compelling features, it has been employed in a number of studies to…

Machine Learning · Computer Science 2023-04-05 Pablo Andretta Jaskowiak , Ivan Gesteira Costa , Ricardo José Gabrielli Barreto Campello

Area Under the Receiver Operating Characteristic Curve (AUC-ROC) is a popular evaluation metric for binary classifiers. In this paper, we discuss techniques to segment the AUC-ROC along human-interpretable dimensions. AUC-ROC is not an…

Machine Learning · Computer Science 2022-05-25 Arya Tafvizi , Besim Avci , Mukund Sundararajan

Receiver operating characteristic (ROC) curve is an informative tool in binary classification and Area Under ROC Curve (AUC) is a popular metric for reporting performance of binary classifiers. In this paper, first we present a…

Machine Learning · Computer Science 2021-09-14 Khashayar Namdar , Masoom A. Haider , Farzad Khalvati

The Area Under the ROC Curve (AUC) is an important model metric for evaluating binary classifiers, and many algorithms have been proposed to optimize AUC approximately. It raises the question of whether the generally insignificant gains…

Computational Geometry · Computer Science 2023-06-05 Baojian Zhou , Steven Skiena

The area under the ROC curve (AUC) is a widely used performance measure in machine learning. Increasingly, however, in several applications, ranging from ranking to biometric screening to medicine, performance is measured not in terms of…

Machine Learning · Computer Science 2016-11-29 Harikrishna Narasimhan , Shivani Agarwal

Area under the ROC curve, a.k.a. AUC, is a measure of choice for assessing the performance of a classifier for imbalanced data. AUC maximization refers to a learning paradigm that learns a predictive model by directly maximizing its AUC…

Machine Learning · Computer Science 2022-08-04 Tianbao Yang , Yiming Ying

The Area Under the ROC Curve (AUC) is a widely employed metric in long-tailed classification scenarios. Nevertheless, most existing methods primarily assume that training and testing examples are drawn i.i.d. from the same distribution,…

Machine Learning · Computer Science 2023-11-07 Siran Dai , Qianqian Xu , Zhiyong Yang , Xiaochun Cao , Qingming Huang

Selective classification (or classification with a reject option) pairs a classifier with a selection function to determine whether or not a prediction should be accepted. This framework trades off coverage (probability of accepting a…

Machine Learning · Computer Science 2023-02-23 Andrea Pugnana , Salvatore Ruggieri

Area under ROC curve (AUC) is a widely used performance measure for classification models. We propose two new distributionally robust AUC maximization models (DR-AUC) that rely on the Kantorovich metric and approximate the AUC with the…

Optimization and Control · Mathematics 2020-05-28 Wenbo Ma , Miguel A. Lejeune

When determining which machine learning model best performs some high impact risk assessment task, practitioners commonly use the Area under the Curve (AUC) to defend and validate their model choices. In this paper, we argue that the…

Computers and Society · Computer Science 2023-05-30 Kweku Kwegyir-Aggrey , Marissa Gerchick , Malika Mohan , Aaron Horowitz , Suresh Venkatasubramanian

Background: Receiver Operating Characteristic (ROC) curves are widely used to evaluate the performance of Software Defect Prediction (SDP) models that estimate module fault-proneness, i.e., the probability that a module is faulty. A ROC…

Software Engineering · Computer Science 2026-04-23 Luigi Lavazza , Gabriele Rotoloni , Sandro Morasca

AUC (Area under the ROC curve) is an important performance measure for applications where the data is highly imbalanced. Learning to maximize AUC performance is thus an important research problem. Using a max-margin based surrogate loss…

Artificial Intelligence · Computer Science 2016-12-28 Vishal Kakkar , Shirish K. Shevade , S Sundararajan , Dinesh Garg

The area under the curve (AUC) of the receiver operating characteristics curve (ROC) evaluates the separation between patients and nonpatients or discrimination. For risk prediction models these risk distributions can be derived from the…

Quantitative Methods · Quantitative Biology 2021-02-23 Ralph H. Stern

The area under the ROC curve (AUC) is a measure of interest in various machine learning and data mining applications. It has been widely used to evaluate classification performance on heavily imbalanced data. The kernelized AUC maximization…

Machine Learning · Computer Science 2019-04-30 Majdi Khalid , Indrakshi Ray , Hamidreza Chitsaz

The Area Under the ROC Curve (AUC) is a well-known metric for evaluating instance-level long-tail learning problems. In the past two decades, many AUC optimization methods have been proposed to improve model performance under long-tail…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Boyu Han , Qianqian Xu , Zhiyong Yang , Shilong Bao , Peisong Wen , Yangbangyan Jiang , Qingming Huang

The Area Under the ROC Curve (AUC) is a crucial metric for machine learning, which evaluates the average performance over all possible True Positive Rates (TPRs) and False Positive Rates (FPRs). Based on the knowledge that a skillful…

Machine Learning · Computer Science 2022-06-24 Zhiyong Yang , Qianqian Xu , Shilong Bao , Yuan He , Xiaochun Cao , Qingming Huang

Recent work on privacy-preserving machine learning has considered how data-mining competitions such as Kaggle could potentially be "hacked", either intentionally or inadvertently, by using information from an oracle that reports a…

Machine Learning · Computer Science 2017-09-12 Jacob Whitehill

The Area under the ROC curve (AUC) is a well-known ranking metric for problems such as imbalanced learning and recommender systems. The vast majority of existing AUC-optimization-based machine learning methods only focus on binary-class…

Machine Learning · Computer Science 2021-07-29 Zhiyong Yang , Qianqian Xu , Shilong Bao , Xiaochun Cao , Qingming Huang

The area under the ROC curve (AUC) is the standard measure of a biomarker's discriminatory accuracy; however, naive AUC estimates can be misleading when validation cohorts differ from the intended target population. Such covariate shifts…

Methodology · Statistics 2025-11-20 Jiajun Liu , Guangcai Mao , Xiaofei Wang

Machine learning (ML) is increasingly employed in real-world applications like medicine or economics, thus, potentially affecting large populations. However, ML models often do not perform homogeneously, leading to underperformance or,…

Machine Learning · Computer Science 2025-08-28 Tom Siegl , Kutalmış Coşkun , Bjarne C. Hiller , Amin Mirzaei , Florian Lemmerich , Martin Becker
‹ Prev 1 2 3 10 Next ›