English
Related papers

Related papers: Partial VOROS: A Cost-aware Performance Metric for…

200 papers

AUC (Area under the ROC curve) is an important performance measure for applications where the data is highly imbalanced. Learning to maximize AUC performance is thus an important research problem. Using a max-margin based surrogate loss…

Artificial Intelligence · Computer Science 2016-12-28 Vishal Kakkar , Shirish K. Shevade , S Sundararajan , Dinesh Garg

Accurate diagnosis of disease is of fundamental importance in clinical practice and medical research. Before a medical diagnostic test is routinely used in practice, its ability to distinguish between diseased and nondiseased states must be…

Methodology · Statistics 2018-06-05 Vanda Inacio de Carvalho , Maria Xose Rodriguez-Alvarez

Computer-aided drug discovery is an essential component of modern drug development. Therein, deep learning has become an important tool for rapid screening of billions of molecules in silico for potential hits containing desired chemical…

The ROC curve is the major tool for assessing not only the performance but also the fairness properties of a similarity scoring function. In order to draw reliable conclusions based on empirical ROC analysis, accurately evaluating the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jean-Rémy Conti , Stéphan Clémençon

We propose a method for maximizing a partial area under a receiver operating characteristic (ROC) curve (pAUC) for binary classification tasks. In binary classification tasks, accuracy is the most commonly used as a measure of classifier…

Machine Learning · Statistics 2018-06-14 Naonori Ueda , Akinori Fujino

Noisy labels are a pervasive challenge in medical image classification, where annotation errors arise from inter-observer variability and diagnostic ambiguity. Although several noise-robust learning methods have been proposed, their…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Maycon R. S. Pereira , Filipe R. Cordeiro

The Receiver Operating Characteristic (ROC) curve stands as a cornerstone in assessing the efficacy of biomarkers for disease diagnosis. Beyond merely evaluating performance, it provides with an optimal cutoff for biomarker values, crucial…

Methodology · Statistics 2025-04-29 Soutik Ghosal

The Area Under the ROC Curve (AUC) is a crucial metric for machine learning, which evaluates the average performance over all possible True Positive Rates (TPRs) and False Positive Rates (FPRs). Based on the knowledge that a skillful…

Machine Learning · Computer Science 2022-06-24 Zhiyong Yang , Qianqian Xu , Shilong Bao , Yuan He , Xiaochun Cao , Qingming Huang

The optimal receiver operating characteristic (ROC) curve, giving the maximum probability of detection as a function of the probability of false alarm, is a key information-theoretic indicator of the difficulty of a binary hypothesis…

Information Theory · Computer Science 2025-06-10 Bruce Hajek , Xiaohan Kang

The Area Under the ROC Curve (AUC) is an important model metric for evaluating binary classifiers, and many algorithms have been proposed to optimize AUC approximately. It raises the question of whether the generally insignificant gains…

Computational Geometry · Computer Science 2023-06-05 Baojian Zhou , Steven Skiena

We present a novel analytical framework to characterize the distribution of the conditional receiver operating characteristic (ROC) in radar systems operating within a realization of a Poisson field of interferers and clutters. While…

Information Theory · Computer Science 2025-05-28 Gourab Ghatak

The Area Under the the Receiver Operating Characteristics (ROC) Curve, referred to as AUC, is a well-known performance measure in the supervised learning domain. Due to its compelling features, it has been employed in a number of studies to…

Machine Learning · Computer Science 2023-04-05 Pablo Andretta Jaskowiak , Ivan Gesteira Costa , Ricardo José Gabrielli Barreto Campello

A new semiparametric model of the ROC curve based on the resilience family or proportional reversed hazard family is proposed which is an alternative to the existing models. The resulting ROC curve and its summary indices (such as area…

Methodology · Statistics 2022-03-28 Ruhul Ali Khan

Graph classification in medical imaging and drug discovery requires accuracy and robust uncertainty quantification. To address this need, we introduce Conditional Prediction ROC (CP-ROC) bands, offering uncertainty quantification for ROC…

Machine Learning · Computer Science 2024-10-22 Yujia Wu , Bo Yang , Elynn Chen , Yuzhou Chen , Zheshi Zheng

Machine learning-based decision support systems are increasingly deployed in clinical settings, where probabilistic scoring functions are used to inform and prioritize patient management decisions. However, widely used scoring rules, such…

Machine Learning · Computer Science 2025-07-01 Gerardo A. Flores , Alyssa H. Smith , Julia A. Fukuyama , Ashia C. Wilson

Training classification models on imbalanced data tends to result in bias towards the majority class. In this paper, we demonstrate how variable discretization and cost-sensitive logistic regression help mitigate this bias on an imbalanced…

Applications · Statistics 2019-07-29 Lili Zhang , Herman Ray , Jennifer Priestley , Soon Tan

The area under the receiver operating characteristic curve (AUC) is often used to evaluate the performance of clinical prediction models. Recently, a more refined strategy has been proposed to examine a partial area under the curve (pAUC),…

Applications · Statistics 2016-06-22 Travis Gerke , Svitlana Tyekucheva , Lorelei Mucci , Giovanni Parmigiani

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

Machine Learning · Computer Science 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban

We study an optimal threshold functional arising in binary classification for continuous biomarkers. While the ROC curve summarizes discriminatory performance across all thresholds, practical threshold selection must also account for…

Methodology · Statistics 2026-05-11 Renato de Paula , Helena Mouriño , Tiago Dias Domingues

Free-response observer performance studies are of great importance for accuracy evaluation and comparison in tasks related to the detection and localization of multiple targets or signals. The free-response receiver operating characteristic…

Methodology · Statistics 2025-12-25 Jiarui Sun , Kaiyuan Liu , Xiao-Hua Zhou