English
Related papers

Related papers: The Area Under the ROC Curve as a Measure of Clust…

200 papers

The Area Under Curve measure (AUC) seems apt to evaluate and compare diverse models, possibly without calibration. An important example of AUC application is the evaluation and benchmarking of models that predict faithfulness of generated…

Computation and Language · Computer Science 2024-05-28 Juri Opitz

Area under ROC (AUC) is an important metric for binary classification and bipartite ranking problems. However, it is difficult to directly optimizing AUC as a learning objective, so most existing algorithms are based on optimizing a…

Machine Learning · Computer Science 2018-05-28 Siwei Lyu , Yiming Ying

The Area under the ROC curve (AUC) is a well-known ranking metric for problems such as imbalanced learning and recommender systems. The vast majority of existing AUC-optimization-based machine learning methods only focus on binary-class…

Machine Learning · Computer Science 2021-07-29 Zhiyong Yang , Qianqian Xu , Shilong Bao , Xiaochun Cao , Qingming Huang

The Partial Area Under the ROC Curve (PAUC), typically including One-way Partial AUC (OPAUC) and Two-way Partial AUC (TPAUC), measures the average performance of a binary classifier within a specific false positive rate and/or true positive…

Machine Learning · Computer Science 2022-10-12 Huiyang Shao , Qianqian Xu , Zhiyong Yang , Shilong Bao , Qingming Huang

The ROC curve is the gold standard for measuring the performance of a test/scoring statistic regarding its capacity to discriminate between two statistical populations in a wide variety of applications, ranging from anomaly detection in…

Statistics Theory · Mathematics 2023-01-25 Stéphan Clémençon , Myrto Limnios , Nicolas Vayatis

When determining which machine learning model best performs some high impact risk assessment task, practitioners commonly use the Area under the Curve (AUC) to defend and validate their model choices. In this paper, we argue that the…

Computers and Society · Computer Science 2023-05-30 Kweku Kwegyir-Aggrey , Marissa Gerchick , Malika Mohan , Aaron Horowitz , Suresh Venkatasubramanian

The use of machine learning models in consequential decision making often exacerbates societal inequity, in particular yielding disparate impact on members of marginalized groups defined by race and gender. The area under the ROC curve…

Machine Learning · Computer Science 2022-11-30 Zhenhuan Yang , Yan Lok Ko , Kush R. Varshney , Yiming Ying

Recent work on privacy-preserving machine learning has considered how data-mining competitions such as Kaggle could potentially be "hacked", either intentionally or inadvertently, by using information from an oracle that reports a…

Machine Learning · Computer Science 2017-09-12 Jacob Whitehill

The area under the receiver-operating characteristic curve (AUC) has become a popular index not only for measuring the overall prediction capacity of a marker but also the association strength between continuous and binary variables. In the…

The area under the ROC curve (AUC) is one of the most widely used performance measures for classification models in machine learning. However, it summarizes the true positive rates (TPRs) over all false positive rates (FPRs) in the ROC…

Machine Learning · Computer Science 2022-10-28 Yao Yao , Qihang Lin , Tianbao Yang

The Area Under the ROC Curve (AUC) is a crucial metric for machine learning, which evaluates the average performance over all possible True Positive Rates (TPRs) and False Positive Rates (FPRs). Based on the knowledge that a skillful…

Machine Learning · Computer Science 2022-06-24 Zhiyong Yang , Qianqian Xu , Shilong Bao , Yuan He , Xiaochun Cao , Qingming Huang

In recommendation systems, one is interested in the ranking of the predicted items as opposed to other losses such as the mean squared error. Although a variety of ways to evaluate rankings exist in the literature, here we focus on the Area…

Machine Learning · Statistics 2015-08-26 Charanpal Dhanjal , Romaric Gaudel , Stephan Clemencon

The Area Under the ROC Curve (AUC) is a widely used performance measure for imbalanced classification arising from many application domains where high-dimensional sparse data is abundant. In such cases, each $d$ dimensional sample has only…

Machine Learning · Computer Science 2020-09-24 Baojian Zhou , Yiming Ying , Steven Skiena

We propose a novel classifier accuracy metric: the Bayesian Area Under the Receiver Operating Characteristic Curve (CBAUC). The method estimates the area under the ROC curve and is related to the recently proposed Bayesian Error Estimator.…

Machine Learning · Computer Science 2019-08-26 Syeda Sakira Hassan , Heikki Huttunen , Jari Niemi , Jussi Tohka

The Area Under the ROC Curve (AUC) is a key metric for classification, especially under class imbalance, with growing research focus on optimizing AUC over accuracy in applications like medical image analysis and deepfake detection. This…

Machine Learning · Computer Science 2025-05-27 Mingyang Wu , Li Lin , Wenbin Zhang , Xin Wang , Zhenhuan Yang , Shu Hu

ROC curves and cost curves are two popular ways of visualising classifier performance, finding appropriate thresholds according to the operating condition, and deriving useful aggregated measures such as the area under the ROC curve (AUC)…

Artificial Intelligence · Computer Science 2011-08-01 José Hernández-Orallo , Peter Flach , Cèsar Ferri

Performance measurement is an essential task once a statistical model is created. The Area Under the receiving operating characteristics Curve (AUC) is the most popular measure for evaluating the quality of a binary classifier. In this…

Computation · Statistics 2021-05-24 Robin Van Oirbeek , Jolien Ponnet , Tim Verdonck

In analysis of binary outcomes, the receiver operator characteristic (ROC) curve is heavily used to show the performance of a model or algorithm. The ROC curve is informative about the performance over a series of thresholds and can be…

Computation · Statistics 2020-08-10 John Muschelli

Optimal performance is critical for decision-making tasks from medicine to autonomous driving, however common performance measures may be too general or too specific. For binary classifiers, diagnostic tests or prognosis at a timepoint,…

We study fairness in the context of classification where the performance is measured by the area under the curve (AUC) of the receiver operating characteristic. AUC is commonly used to measure the performance of prediction models. The same…

Machine Learning · Computer Science 2022-08-25 Hortense Fong , Vineet Kumar , Anay Mehrotra , Nisheeth K. Vishnoi