English
Related papers

Related papers: RatingScaleReduction package: stepwise rating scal…

200 papers

The Partial Area Under the ROC Curve (PAUC), typically including One-way Partial AUC (OPAUC) and Two-way Partial AUC (TPAUC), measures the average performance of a binary classifier within a specific false positive rate and/or true positive…

Machine Learning · Computer Science 2022-10-12 Huiyang Shao , Qianqian Xu , Zhiyong Yang , Shilong Bao , Qingming Huang

The area under the ROC curve (AUC) is a measure of interest in various machine learning and data mining applications. It has been widely used to evaluate classification performance on heavily imbalanced data. The kernelized AUC maximization…

Machine Learning · Computer Science 2019-04-30 Majdi Khalid , Indrakshi Ray , Hamidreza Chitsaz

The proper use of model evaluation metrics is important for model evaluation and model selection in binary classification tasks. This study investigates how consistent different metrics are at evaluating models across data of different…

Machine Learning · Statistics 2024-12-17 Jing Li

Selective Classification, wherein models can reject low-confidence predictions, promises reliable translation of machine-learning based classification systems to real-world scenarios such as clinical diagnostics. While current evaluation of…

Area under ROC (AUC) is an important metric for binary classification and bipartite ranking problems. However, it is difficult to directly optimizing AUC as a learning objective, so most existing algorithms are based on optimizing a…

Machine Learning · Computer Science 2018-05-28 Siwei Lyu , Yiming Ying

The area under the ROC curve (AUC) is the standard measure of a biomarker's discriminatory accuracy; however, naive AUC estimates can be misleading when validation cohorts differ from the intended target population. Such covariate shifts…

Methodology · Statistics 2025-11-20 Jiajun Liu , Guangcai Mao , Xiaofei Wang

Throughout science and technology, receiver operating characteristic (ROC) curves and associated area under the curve (AUC) measures constitute powerful tools for assessing the predictive abilities of features, markers and tests in binary…

Machine Learning · Statistics 2021-06-25 Tilmann Gneiting , Eva-Maria Walz

The Area Under the ROC Curve (AUC) is a widely used performance measure for imbalanced classification arising from many application domains where high-dimensional sparse data is abundant. In such cases, each $d$ dimensional sample has only…

Machine Learning · Computer Science 2020-09-24 Baojian Zhou , Yiming Ying , Steven Skiena

The Area Under the ROC Curve (AUC) is an important model metric for evaluating binary classifiers, and many algorithms have been proposed to optimize AUC approximately. It raises the question of whether the generally insignificant gains…

Computational Geometry · Computer Science 2023-06-05 Baojian Zhou , Steven Skiena

The receiver operating characteristic (ROC) curve is a very useful tool for analyzing the diagnostic/classification power of instruments/classification schemes as long as a binary-scale gold standard is available. When the gold standard is…

Methodology · Statistics 2011-05-10 Zhanfeng Wang , Yuan-chin Ivan Chang

We study piecewise affine policies for multi-stage adjustable robust optimization (ARO) problems with non-negative right-hand side uncertainty. First, we construct new dominating uncertainty sets and show how a multi-stage ARO problem can…

Optimization and Control · Mathematics 2024-02-06 Simon Thomä , Grit Walther , Maximilian Schiffer

Multiple binary responses arise in many modern data-analytic problems. Although fitting separate logistic regressions for each response is computationally attractive, it ignores shared structure and can be statistically inefficient,…

Machine Learning · Statistics 2026-01-14 The Tien Mai

The Area Under the ROC Curve (AUC) is a widely used performance metric for binary classifiers. However, as a global ranking statistic, the AUC aggregates model behavior over the entire dataset, masking localized weaknesses in specific…

Applications · Statistics 2025-08-12 Agus Sudjianto , Alice J. Liu

The receiver operating characteristic (ROC) curve is the most popular tool used to evaluate the discriminatory capability of diagnostic tests/biomarkers measured on a continuous scale when distinguishing between two alternative disease…

Methodology · Statistics 2021-03-22 Maria Xose Rodriguez-Alvarez , Vanda Inacio

Many typical applications of object detection operate within a prescribed false-positive range. In this situation the performance of a detector should be assessed on the basis of the area under the ROC curve over that range, rather than…

Computer Vision and Pattern Recognition · Computer Science 2015-06-30 Sakrapee Paisitkriangkrai , Chunhua Shen , Anton van den Hengel

In multiparameter quantum metrology, the ultimate precision of joint estimation is dictated by the Holevo Cram\'er-Rao bound. In this paper, we discuss and analyze in detail an alternative approach: the stepwise estimation strategy. In this…

Quantum Physics · Physics 2025-10-23 Gabriele Fazio , Jiayu He , Matteo G. A. Paris

The area under a receiver operating characteristic curve (AUC) is a useful tool to assess the performance of continuous-scale diagnostic tests on binary classification. In this article, we propose an empirical likelihood (EL) method to…

Methodology · Statistics 2022-05-05 Chul Moon , Xinlei Wang , Johan Lim

ROC curves and cost curves are two popular ways of visualising classifier performance, finding appropriate thresholds according to the operating condition, and deriving useful aggregated measures such as the area under the ROC curve (AUC)…

Artificial Intelligence · Computer Science 2011-08-01 José Hernández-Orallo , Peter Flach , Cèsar Ferri

Receiver operating characteristic (ROC) curves are widely used as a measure of accuracy of diagnostic tests and can be summarized using the area under the ROC curve (AUC). Often, it is useful to construct a confidence intervals for the AUC,…

Applications · Statistics 2018-04-18 Hunyong Cho , Gregory J. Matthews , Ofer Harel

The area under the curve (AUC) of the receiver operating characteristics curve (ROC) evaluates the separation between patients and nonpatients or discrimination. For risk prediction models these risk distributions can be derived from the…

Quantitative Methods · Quantitative Biology 2021-02-23 Ralph H. Stern