English
Related papers

Related papers: Deep ROC Analysis and AUC as Balanced Average Accu…

200 papers

The area under the ROC curve (AUC) is one of the most widely used performance measures for classification models in machine learning. However, it summarizes the true positive rates (TPRs) over all false positive rates (FPRs) in the ROC…

Machine Learning · Computer Science 2022-10-28 Yao Yao , Qihang Lin , Tianbao Yang

In high-stakes risk prediction, quantifying uncertainty through interval-valued predictions is essential for reliable decision-making. However, standard evaluation tools like the receiver operating characteristic (ROC) curve and the area…

Machine Learning · Computer Science 2026-02-05 Yuqi Li , Matthew M. Engelhard

Area under the ROC curve, a.k.a. AUC, is a measure of choice for assessing the performance of a classifier for imbalanced data. AUC maximization refers to a learning paradigm that learns a predictive model by directly maximizing its AUC…

Machine Learning · Computer Science 2022-08-04 Tianbao Yang , Yiming Ying

The area under the ROC curve (AUC) is the standard measure of a biomarker's discriminatory accuracy; however, naive AUC estimates can be misleading when validation cohorts differ from the intended target population. Such covariate shifts…

Methodology · Statistics 2025-11-20 Jiajun Liu , Guangcai Mao , Xiaofei Wang

Areas under ROC (AUROC) and precision-recall curves (AUPRC) are common metrics for evaluating classification performance for imbalanced problems. Compared with AUROC, AUPRC is a more appropriate metric for highly imbalanced datasets. While…

Machine Learning · Computer Science 2023-04-14 Qi Qi , Youzhi Luo , Zhao Xu , Shuiwang Ji , Tianbao Yang

The Partial Area Under the ROC Curve (PAUC), typically including One-way Partial AUC (OPAUC) and Two-way Partial AUC (TPAUC), measures the average performance of a binary classifier within a specific false positive rate and/or true positive…

Machine Learning · Computer Science 2022-10-12 Huiyang Shao , Qianqian Xu , Zhiyong Yang , Shilong Bao , Qingming Huang

The Area Under the ROC Curve (AUC) is a widely used performance metric for binary classifiers. However, as a global ranking statistic, the AUC aggregates model behavior over the entire dataset, masking localized weaknesses in specific…

Applications · Statistics 2025-08-12 Agus Sudjianto , Alice J. Liu

The area under the curve (AUC) of the receiver operating characteristics curve (ROC) evaluates the separation between patients and nonpatients or discrimination. For risk prediction models these risk distributions can be derived from the…

Quantitative Methods · Quantitative Biology 2021-02-23 Ralph H. Stern

The Area Under the the Receiver Operating Characteristics (ROC) Curve, referred to as AUC, is a well-known performance measure in the supervised learning domain. Due to its compelling features, it has been employed in a number of studies to…

Machine Learning · Computer Science 2023-04-05 Pablo Andretta Jaskowiak , Ivan Gesteira Costa , Ricardo José Gabrielli Barreto Campello

Assessment of risk prediction models has primarily utilized measures of discrimination, the ROC curve AUC and C-statistic. These derive from the risk distributions of patients and nonpatients, which in turn are derived from a population…

Quantitative Methods · Quantitative Biology 2023-12-05 Ralph H. Stern

Receiver operating characteristic (ROC) curve is an informative tool in binary classification and Area Under ROC Curve (AUC) is a popular metric for reporting performance of binary classifiers. In this paper, first we present a…

Machine Learning · Computer Science 2021-09-14 Khashayar Namdar , Masoom A. Haider , Farzad Khalvati

The ROC curve is the gold standard for measuring the performance of a test/scoring statistic regarding its capacity to discriminate between two statistical populations in a wide variety of applications, ranging from anomaly detection in…

Statistics Theory · Mathematics 2023-01-25 Stéphan Clémençon , Myrto Limnios , Nicolas Vayatis

When evaluating medical tests or biomarkers for disease classification, the area under the receiver-operating characteristic (ROC) curve is a widely used performance metric that does not require us to commit to a specific decision…

Methodology · Statistics 2013-10-21 Wanhua Su , Yan Yuan , Mu Zhu

Estimating average human performance has been performed inconsistently in research in diagnostic medicine. This has been particularly apparent in the field of medical artificial intelligence, where humans are often compared against AI…

Methodology · Statistics 2020-09-28 Luke Oakden-Rayner , Lyle Palmer

Prior to clinical applications, it is critical that risk prediction models are evaluated in independent studies that did not contribute to model development. While prospective cohort studies provide a natural setting for model validation,…

Methodology · Statistics 2017-10-13 Parichoy Pal Choudhury , Anil K. Chaturvedi , Nilanjan Chatterjee

The Area Under the ROC Curve (AUC) is a crucial metric for machine learning, which evaluates the average performance over all possible True Positive Rates (TPRs) and False Positive Rates (FPRs). Based on the knowledge that a skillful…

Machine Learning · Computer Science 2022-06-24 Zhiyong Yang , Qianqian Xu , Shilong Bao , Yuan He , Xiaochun Cao , Qingming Huang

The area under the ROC curve (AUC) is a widely used performance measure in machine learning. Increasingly, however, in several applications, ranging from ranking to biometric screening to medicine, performance is measured not in terms of…

Machine Learning · Computer Science 2016-11-29 Harikrishna Narasimhan , Shivani Agarwal

Background: Receiver Operating Characteristic (ROC) curves are widely used to evaluate the performance of Software Defect Prediction (SDP) models that estimate module fault-proneness, i.e., the probability that a module is faulty. A ROC…

Software Engineering · Computer Science 2026-04-23 Luigi Lavazza , Gabriele Rotoloni , Sandro Morasca

Area Under the Receiver Operating Characteristic Curve (AUC-ROC) is a popular evaluation metric for binary classifiers. In this paper, we discuss techniques to segment the AUC-ROC along human-interpretable dimensions. AUC-ROC is not an…

Machine Learning · Computer Science 2022-05-25 Arya Tafvizi , Besim Avci , Mukund Sundararajan

The Receiver Operating Characteristic (ROC) curve and the Area Under the Curve (AUC) of the ROC curve are widely used to compare the performance of diagnostic and prognostic assays. The ROC curve has the advantage that it is independent of…

‹ Prev 1 2 3 10 Next ›