中文
相关论文

相关论文: Technical Note: Towards ROC Curves in Cost Space

200 篇论文

Receiver Operating Characteristic (ROC) curves are useful for evaluation in binary classification and changepoint detection, but difficult to use for learning since the Area Under the Curve (AUC) is piecewise constant (gradient zero almost…

机器学习 · 计算机科学 2024-10-14 Jadon Fowler , Toby Dylan Hocking

Receiver Operating Characteristic (ROC) curves have recently been used to evaluate the performance of models for spatial presence-absence or presence-only data. Applications include species distribution modelling and mineral prospectivity…

统计方法学 · 统计学 2025-06-05 Adrian Baddeley , Ege Rubak , Suman Rakshit , Gopalan Nair

Receiver Operating Characteristic (ROC) curves are plots of true positive rate versus false positive rate which are used to evaluate binary classification algorithms. Because the Area Under the Curve (AUC) is a constant function of the…

机器学习 · 计算机科学 2023-02-23 Kyle R. Rust , Toby D. Hocking

Risk stratification is most directly and informatively summarized as a risk distribution curve. From this curve the ROC curve, predictiveness curve, and other curves depicting risk stratification can be derived, demonstrating that they…

定量方法 · 定量生物学 2009-12-17 Ralph Stern

In analysis of binary outcomes, the receiver operator characteristic (ROC) curve is heavily used to show the performance of a model or algorithm. The ROC curve is informative about the performance over a series of thresholds and can be…

统计计算 · 统计学 2020-08-10 John Muschelli

Binary decisions are very common in artificial intelligence. Applying a threshold on the continuous score gives the human decider the power to control the operating point to separate the two classes. The classifier,s discriminating power is…

人工智能 · 计算机科学 2016-06-03 Paulo J. L. Adeodato , Sílvio B. Melo

Area under the ROC curve, a.k.a. AUC, is a measure of choice for assessing the performance of a classifier for imbalanced data. AUC maximization refers to a learning paradigm that learns a predictive model by directly maximizing its AUC…

机器学习 · 计算机科学 2022-08-04 Tianbao Yang , Yiming Ying

Receiver operating characteristic (ROC) curves are used ubiquitously to evaluate covariates, markers, or features as potential predictors in binary problems. We distinguish raw ROC diagnostics and ROC curves, elucidate the special role of…

统计方法学 · 统计学 2018-09-14 Tilmann Gneiting , Peter Vogel

The ROC (receiver operating characteristic) curve is a widely used device for assessing decision-making systems. It seems surprising, in view of its history dating back to World War Two, that the assignment of uncertainties to a ROC curve…

数据分析、统计与概率 · 物理学 2024-08-19 M. P. Fewell

In this paper we consider the problem of maximizing the Area under the ROC curve (AUC) which is a widely used performance metric in imbalanced classification and anomaly detection. Due to the pairwise nonlinearity of the objective function,…

机器学习 · 计算机科学 2019-06-17 Yunwen Lei , Yiming Ying

In high-stakes risk prediction, quantifying uncertainty through interval-valued predictions is essential for reliable decision-making. However, standard evaluation tools like the receiver operating characteristic (ROC) curve and the area…

机器学习 · 计算机科学 2026-02-05 Yuqi Li , Matthew M. Engelhard

When evaluating medical tests or biomarkers for disease classification, the area under the receiver-operating characteristic (ROC) curve is a widely used performance metric that does not require us to commit to a specific decision…

统计方法学 · 统计学 2013-10-21 Wanhua Su , Yan Yuan , Mu Zhu

The receiver operating characteristic (ROC) curve is an important graphic tool for evaluating a test in a wide range of disciplines. While useful, an ROC curve can cross the chance line, either by having an S-shape or a hook at the extreme…

统计方法学 · 统计学 2024-07-02 Soutik Ghosal , Zhen Chen

AUC (Area under the ROC curve) is an important performance measure for applications where the data is highly imbalanced. Learning to maximize AUC performance is thus an important research problem. Using a max-margin based surrogate loss…

人工智能 · 计算机科学 2016-12-28 Vishal Kakkar , Shirish K. Shevade , S Sundararajan , Dinesh Garg

Performance measurement is an essential task once a statistical model is created. The Area Under the receiving operating characteristics Curve (AUC) is the most popular measure for evaluating the quality of a binary classifier. In this…

统计计算 · 统计学 2021-05-24 Robin Van Oirbeek , Jolien Ponnet , Tim Verdonck

The ROC curve is the major tool for assessing not only the performance but also the fairness properties of a similarity scoring function. In order to draw reliable conclusions based on empirical ROC analysis, accurately evaluating the…

计算机视觉与模式识别 · 计算机科学 2024-02-22 Jean-Rémy Conti , Stéphan Clémençon

The predictive quality of machine learning models is typically measured in terms of their (approximate) expected prediction accuracy or the so-called Area Under the Curve (AUC). Minimizing the reciprocals of these measures are the goals of…

机器学习 · 统计学 2019-03-04 Hiva Ghanbari , Minhan Li , Katya Scheinberg

The area under the ROC curve (AUC) is the standard measure of a biomarker's discriminatory accuracy; however, naive AUC estimates can be misleading when validation cohorts differ from the intended target population. Such covariate shifts…

统计方法学 · 统计学 2025-11-20 Jiajun Liu , Guangcai Mao , Xiaofei Wang

Selective classification (or classification with a reject option) pairs a classifier with a selection function to determine whether or not a prediction should be accepted. This framework trades off coverage (probability of accepting a…

机器学习 · 计算机科学 2023-02-23 Andrea Pugnana , Salvatore Ruggieri

We provide a comprehensive theory of conducting in-sample statistical inference about receiver operating characteristic (ROC) curves that are based on predicted values from a first stage model with estimated parameters (such as a logit…

计量经济学 · 经济学 2021-12-06 Yu-Chin Hsu , Robert P. Lieli