English
Related papers

Related papers: A Modified AUC for Training Convolutional Neural N…

200 papers

Accurate diagnosis of disease is of fundamental importance in clinical practice and medical research. Before a medical diagnostic test is routinely used in practice, its ability to distinguish between diseased and nondiseased states must be…

Methodology · Statistics 2018-06-05 Vanda Inacio de Carvalho , Maria Xose Rodriguez-Alvarez

Area under ROC (AUC) is an important metric for binary classification and bipartite ranking problems. However, it is difficult to directly optimizing AUC as a learning objective, so most existing algorithms are based on optimizing a…

Machine Learning · Computer Science 2018-05-28 Siwei Lyu , Yiming Ying

This article considers the receiver operating characteristic (ROC) curve analysis for medical data with non-ignorable missingness in the disease status. In the framework of the logistic regression models for both the disease status and the…

Methodology · Statistics 2024-11-27 Dingding Hu , Tao Yu , Pengfei Li

The area under the ROC curve (AUC) is one of the most widely used performance measures for classification models in machine learning. However, it summarizes the true positive rates (TPRs) over all false positive rates (FPRs) in the ROC…

Machine Learning · Computer Science 2022-10-28 Yao Yao , Qihang Lin , Tianbao Yang

Binary decisions are very common in artificial intelligence. Applying a threshold on the continuous score gives the human decider the power to control the operating point to separate the two classes. The classifier,s discriminating power is…

Artificial Intelligence · Computer Science 2016-06-03 Paulo J. L. Adeodato , Sílvio B. Melo

Area under the ROC curve (AUC) optimisation techniques developed for neural networks have recently demonstrated their capabilities in different audio and speech related tasks. However, due to its intrinsic nature, AUC optimisation has…

Sound · Computer Science 2021-10-28 Pablo Gimeno , Victoria Mingote , Alfonso Ortega , Antonio Miguel , Eduardo Lleida

Adequate evaluation of an information retrieval system to estimate future performance is a crucial task. Area under the ROC curve (AUC) is widely used to evaluate the generalization of a retrieval system. However, the objective function…

Information Retrieval · Computer Science 2016-04-26 Sean J. Welleck

The Area under the ROC curve (AUC) is a well-known ranking metric for problems such as imbalanced learning and recommender systems. The vast majority of existing AUC-optimization-based machine learning methods only focus on binary-class…

Machine Learning · Computer Science 2021-07-29 Zhiyong Yang , Qianqian Xu , Shilong Bao , Xiaochun Cao , Qingming Huang

Whilst the size and complexity of ML models have rapidly and significantly increased over the past decade, the methods for assessing their performance have not kept pace. In particular, among the many potential performance metrics, the ML…

Machine Learning · Computer Science 2023-12-29 Michael Roberts , Alon Hazan , Sören Dittmer , James H. F. Rudd , Carola-Bibiane Schönlieb

The Area Under the ROC Curve (AUC) is a crucial metric for machine learning, which evaluates the average performance over all possible True Positive Rates (TPRs) and False Positive Rates (FPRs). Based on the knowledge that a skillful…

Machine Learning · Computer Science 2022-06-24 Zhiyong Yang , Qianqian Xu , Shilong Bao , Yuan He , Xiaochun Cao , Qingming Huang

The receiver operating characteristic (ROC) curve is the most popular tool used to evaluate the discriminatory capability of diagnostic tests/biomarkers measured on a continuous scale when distinguishing between two alternative disease…

Methodology · Statistics 2021-03-22 Maria Xose Rodriguez-Alvarez , Vanda Inacio

Model evaluation is of crucial importance in modern statistics application. The construction of ROC and calculation of AUC have been widely used for binary classification evaluation. Recent research generalizing the ROC/AUC analysis to…

Machine Learning · Statistics 2024-04-23 Liang Wang , Luis Carvalho

Convolutional Neural Networks (CNNs) have been used for automated detection of prostate cancer where Area Under Receiver Operating Characteristic (ROC) curve (AUC) is usually used as the performance metric. Given that AUC is not…

Image and Video Processing · Electrical Eng. & Systems 2019-11-06 Khashayar Namdar , Isha Gujrathi , Masoom A. Haider , Farzad Khalvati

AUC (Area under the ROC curve) is an important performance measure for applications where the data is highly imbalanced. Learning to maximize AUC performance is thus an important research problem. Using a max-margin based surrogate loss…

Artificial Intelligence · Computer Science 2016-12-28 Vishal Kakkar , Shirish K. Shevade , S Sundararajan , Dinesh Garg

Binary classification is one of the oldest, most prevalent, and studied problems in machine learning. However, the metrics used to evaluate model performance have received comparatively little attention. The area under the receiver…

Machine Learning · Statistics 2025-12-12 Tiago Brogueira , Mário A. T. Figueiredo

Several efforts have been done to bring ROC analysis beyond (binary) classification, especially in regression. However, the mapping and possibilities of these proposals do not correspond to what we expect from the analysis of operating…

Statistics Theory · Mathematics 2013-10-17 Jose Hernandez-Orallo

Many typical applications of object detection operate within a prescribed false-positive range. In this situation the performance of a detector should be assessed on the basis of the area under the ROC curve over that range, rather than…

Computer Vision and Pattern Recognition · Computer Science 2013-10-04 Sakrapee Paisitkriangkrai , Chunhua Shen , Anton van den Hengel

In diagnostic studies, researchers frequently encounter imperfect reference standards with some misclassified labels. Treating these as gold standards can bias receiver operating characteristic (ROC) curve analysis. To address this issue,…

Methodology · Statistics 2025-02-13 Yifan Sun , Peijun Sang , Qinglong Tian , Pengfei Li

The ROC curve is the major tool for assessing not only the performance but also the fairness properties of a similarity scoring function. In order to draw reliable conclusions based on empirical ROC analysis, accurately evaluating the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jean-Rémy Conti , Stéphan Clémençon

Area under the receiver operating characteristics curve (AUC) is an important metric for a wide range of signal processing and machine learning problems, and scalable methods for optimizing AUC have recently been proposed. However, handling…

Machine Learning · Computer Science 2018-06-01 San Gultekin , Avishek Saha , Adwait Ratnaparkhi , John Paisley