English
Related papers

Related papers: The Area Under the ROC Curve as a Measure of Clust…

200 papers

Area under the ROC curve (AUC) optimisation techniques developed for neural networks have recently demonstrated their capabilities in different audio and speech related tasks. However, due to its intrinsic nature, AUC optimisation has…

Sound · Computer Science 2021-10-28 Pablo Gimeno , Victoria Mingote , Alfonso Ortega , Antonio Miguel , Eduardo Lleida

Receiver Operating Characteristic (ROC) curves are plots of true positive rate versus false positive rate which are used to evaluate binary classification algorithms. Because the Area Under the Curve (AUC) is a constant function of the…

Machine Learning · Computer Science 2023-02-23 Kyle R. Rust , Toby D. Hocking

The Area Under the Curve (AUC) is an important performance metric for classification tasks, particularly in class-imbalanced scenarios. However, minimizing the AUC presents significant challenges due to the non-convex and discontinuous…

Machine Learning · Computer Science 2025-10-27 JunRu Luo , Difei Cheng , Bo Zhang

Adequate evaluation of an information retrieval system to estimate future performance is a crucial task. Area under the ROC curve (AUC) is widely used to evaluate the generalization of a retrieval system. However, the objective function…

Information Retrieval · Computer Science 2016-04-26 Sean J. Welleck

Maximizing the area under the receiver operating characteristic curve (AUC) is a standard approach to imbalanced classification. So far, various supervised AUC optimization methods have been developed and they are also extended to…

Machine Learning · Statistics 2022-04-12 Tomoya Sakai , Gang Niu , Masashi Sugiyama

Throughout science and technology, receiver operating characteristic (ROC) curves and associated area under the curve (AUC) measures constitute powerful tools for assessing the predictive abilities of features, markers and tests in binary…

Machine Learning · Statistics 2021-06-25 Tilmann Gneiting , Eva-Maria Walz

Cost-sensitive learning relies on the availability of a known and fixed cost matrix. However, in some scenarios, the cost matrix is uncertain during training, and re-train a classifier after the cost matrix is specified would not be an…

Machine Learning · Computer Science 2012-09-11 Rui Wang , Ke Tang

The Receiver Operating Characteristic (ROC) curve of a binary classifier has often been utilized to measure the performance of the classifier. The area beneath this curve is used in particular because of its quoted probabilistic…

Machine Learning · Computer Science 2026-05-05 Steven Redolfi

Scoring functions are used to evaluate and compare partially probabilistic forecasts. We investigate the use of rank-sum functions such as empirical Area Under the Curve (AUC), a widely-used measure of classification performance, as a…

Statistics Theory · Mathematics 2017-01-31 Simon Byrne

The Receiver Operating Characteristic (ROC) curve and the Area Under the Curve (AUC) of the ROC curve are widely used to compare the performance of diagnostic and prognostic assays. The ROC curve has the advantage that it is independent of…

Fair clustering has attracted remarkable attention from the research community. Many fairness measures for clustering have been proposed; however, they do not take into account the clustering quality w.r.t. the values of the protected…

Machine Learning · Computer Science 2025-07-02 Tai Le Quy , Long Le Thanh , Lan Luong Thi Hong , Frank Hopfgartner

Whilst the size and complexity of ML models have rapidly and significantly increased over the past decade, the methods for assessing their performance have not kept pace. In particular, among the many potential performance metrics, the ML…

Machine Learning · Computer Science 2023-12-29 Michael Roberts , Alon Hazan , Sören Dittmer , James H. F. Rudd , Carola-Bibiane Schönlieb

The area under receiver operating characteristics (AUC) is the standard measure for comparison of anomaly detectors. Its advantage is in providing a scalar number that allows a natural ordering and is independent on a threshold, which…

Machine Learning · Computer Science 2023-05-09 Vít Škvára , Tomáš Pevný , Václav Šmídl

Area Under the Curve (AUC) is arguably the most popular measure of classification accuracy. We use a semiparametric framework to introduce a latent scale-invariant $R^2$, a novel measure of variation explained for an observed binary outcome…

Methodology · Statistics 2019-11-01 Debangan Dey , Vadim Zipunnikov

The receiver operating characteristic (ROC) curve is a very useful tool for analyzing the diagnostic/classification power of instruments/classification schemes as long as a binary-scale gold standard is available. When the gold standard is…

Methodology · Statistics 2011-05-10 Zhanfeng Wang , Yuan-chin Ivan Chang

With the increasing importance of safety requirements associated with the use of black box models, evaluation of selective answering capability of models has been critical. Area under the curve (AUC) is used as a metric for this purpose. We…

Computation and Language · Computer Science 2022-10-11 Swaroop Mishra , Anjana Arunkumar , Chitta Baral

Weakly supervised learning aims to empower machine learning when the perfect supervision is unavailable, which has drawn great attention from researchers. Among various types of weak supervision, one of the most challenging cases is to…

Machine Learning · Computer Science 2023-09-18 Zheng Xie , Yu Liu , Ming Li

The Area Under the ROC Curve (AUC) is a well-known metric for evaluating instance-level long-tail learning problems. In the past two decades, many AUC optimization methods have been proposed to improve model performance under long-tail…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Boyu Han , Qianqian Xu , Zhiyong Yang , Shilong Bao , Peisong Wen , Yangbangyan Jiang , Qingming Huang

The area under the curve (AUC) of summary receiver operating characteristic (SROC) curve is a primary statistical outcome for meta-analysis of diagnostic test accuracy studies (DTA). However, its confidence interval has not been reported in…

Applications · Statistics 2022-08-02 Hisashi Noma , Yuki Matsushima , Ryota Ishii

The selective classifier (SC) has been proposed for rank based uncertainty thresholding, which could have applications in safety critical areas such as medical diagnostics, autonomous driving, and the justice system. The Area Under the…

Machine Learning · Statistics 2025-09-04 Han Zhou , Jordy Van Landeghem , Teodora Popordanoska , Matthew B. Blaschko