中文
相关论文

相关论文: The VOROS: Lifting ROC curves to 3D

200 篇论文

Paired comparison models are used for analyzing data that involves pairwise comparisons among a set of objects. When the outcomes of the pairwise comparisons have no ties, the paired comparison models can be generalized as a class of binary…

统计方法学 · 统计学 2022-11-29 Ran Huo , Mark E. Glickman

We study the geometry of Receiver Operating Characteristic (ROC) and Precision-Recall (PR) curves in binary classification problems. The key finding is that many of the most commonly used binary classification metrics are merely functions…

机器学习 · 计算机科学 2026-04-15 Reza Sameni

Area Under the Receiver Operating Characteristic Curve (AUC-ROC) is a popular evaluation metric for binary classifiers. In this paper, we discuss techniques to segment the AUC-ROC along human-interpretable dimensions. AUC-ROC is not an…

机器学习 · 计算机科学 2022-05-25 Arya Tafvizi , Besim Avci , Mukund Sundararajan

Many fields use the ROC curve and the PR curve as standard evaluations of binary classification methods. Analysis of ROC and PR, however, often gives misleading and inflated performance evaluations, especially with an imbalanced ground…

机器学习 · 统计学 2020-06-23 Chang Cao , Davide Chicco , Michael M. Hoffman

Evaluation often aims to reduce the correctness or error characteristics of a system down to a single number, but that always involves trade-offs. Another way of dealing with this is to quote two numbers, such as Recall and Precision, or…

机器学习 · 计算机科学 2020-09-03 David M. W. Powers

In analysis of binary outcomes, the receiver operator characteristic (ROC) curve is heavily used to show the performance of a model or algorithm. The ROC curve is informative about the performance over a series of thresholds and can be…

统计计算 · 统计学 2020-08-10 John Muschelli

The Area Under the ROC Curve (AUC) is an important model metric for evaluating binary classifiers, and many algorithms have been proposed to optimize AUC approximately. It raises the question of whether the generally insignificant gains…

计算几何 · 计算机科学 2023-06-05 Baojian Zhou , Steven Skiena

The proper use of model evaluation metrics is important for model evaluation and model selection in binary classification tasks. This study investigates how consistent different metrics are at evaluating models across data of different…

机器学习 · 统计学 2024-12-17 Jing Li

Receiver operating characteristic (ROC) curve is an informative tool in binary classification and Area Under ROC Curve (AUC) is a popular metric for reporting performance of binary classifiers. In this paper, first we present a…

机器学习 · 计算机科学 2021-09-14 Khashayar Namdar , Masoom A. Haider , Farzad Khalvati

When evaluating medical tests or biomarkers for disease classification, the area under the receiver-operating characteristic (ROC) curve is a widely used performance metric that does not require us to commit to a specific decision…

统计方法学 · 统计学 2013-10-21 Wanhua Su , Yan Yuan , Mu Zhu

The Area under the ROC curve (AUC) is a well-known ranking metric for problems such as imbalanced learning and recommender systems. The vast majority of existing AUC-optimization-based machine learning methods only focus on binary-class…

机器学习 · 计算机科学 2021-07-29 Zhiyong Yang , Qianqian Xu , Shilong Bao , Xiaochun Cao , Qingming Huang

The receiver operating characteristic (ROC) curve is an important graphic tool for evaluating a test in a wide range of disciplines. While useful, an ROC curve can cross the chance line, either by having an S-shape or a hook at the extreme…

统计方法学 · 统计学 2024-07-02 Soutik Ghosal , Zhen Chen

Receiver Operating Characteristic (ROC) curves are plots of true positive rate versus false positive rate which are used to evaluate binary classification algorithms. Because the Area Under the Curve (AUC) is a constant function of the…

机器学习 · 计算机科学 2023-02-23 Kyle R. Rust , Toby D. Hocking

The Receiver Operating Characteristic (ROC) curve is a useful tool that measures the discriminating power of a continuous variable or the accuracy of a pharmaceutical or medical test to distinguish between two conditions or classes. In…

统计方法学 · 统计学 2022-07-26 Ana M. Bianco , Graciela Boente , Wenceslao Gonzalez-Manteiga

Algorithmic bias continues to be a key concern of learning analytics. We study the statistical properties of the Absolute Between-ROC Area (ABROCA) metric. This fairness measure quantifies group-level differences in classifier performance…

机器学习 · 统计学 2024-12-02 Conrad Borchers , Ryan S. Baker

The area under the ROC curve (AUC) is a widely used performance measure in machine learning. Increasingly, however, in several applications, ranging from ranking to biometric screening to medicine, performance is measured not in terms of…

机器学习 · 计算机科学 2016-11-29 Harikrishna Narasimhan , Shivani Agarwal

The performance of many machine learning techniques depends on the choice of an appropriate similarity or distance measure on the input space. Similarity learning (or metric learning) aims at building such a measure from training data so…

机器学习 · 统计学 2019-01-25 Robin Vogel , Aurélien Bellet , Stéphan Clémençon

The ROC curve is a statistical tool that analyses the accuracy of a diagnostic test in which a variable is used to decide whether an individual is healthy or not. Along with that diagnostic variable it is usual to have information of some…

Cost-sensitive learning relies on the availability of a known and fixed cost matrix. However, in some scenarios, the cost matrix is uncertain during training, and re-train a classifier after the cost matrix is specified would not be an…

机器学习 · 计算机科学 2012-09-11 Rui Wang , Ke Tang

The ROC curve is the gold standard for measuring the performance of a test/scoring statistic regarding its capacity to discriminate between two statistical populations in a wide variety of applications, ranging from anomaly detection in…

统计理论 · 数学 2023-01-25 Stéphan Clémençon , Myrto Limnios , Nicolas Vayatis