中文
相关论文

相关论文: Docs are ROCs: A simple off-the-shelf approach for…

200 篇论文

A semi-supervised model of peer review is introduced that is intended to overcome the bias and incompleteness of traditional peer review. Traditional approaches are reliant on human biases, while consensus decision-making is constrained by…

数字图书馆 · 计算机科学 2013-11-12 Bradly Alicea

The ROC curve is the gold standard for measuring the performance of a test/scoring statistic regarding its capacity to discriminate between two statistical populations in a wide variety of applications, ranging from anomaly detection in…

统计理论 · 数学 2023-01-25 Stéphan Clémençon , Myrto Limnios , Nicolas Vayatis

Multiple diagnostic tests are frequently used to determine the presence of a disease condition in patients. In this paper, we use bivariate copulas to examine the properties of receiver operating characteristic (ROC) curves formed when two…

The summary receiver operating characteristic (SROC) curve has been recommended as one important meta-analytical summary to represent the accuracy of a diagnostic test in the presence of heterogeneous cutoff values. However, selective…

统计方法学 · 统计学 2024-01-11 Yi Zhou , Ao Huang , Satoshi Hattori

The receiver operating characteristic curve is widely applied in measuring the performance of diagnostic tests. Many direct and indirect approaches have been proposed for modelling the ROC curve, and because of its tractability, the…

统计方法学 · 统计学 2017-10-09 Amay Cheam , Paul D. McNicholas

Despite the growing interest in human-AI decision making, experimental studies with domain experts remain rare, largely due to the complexity of working with domain experts and the challenges in setting up realistic experiments. In this…

The Receiver Operating Characteristic (ROC) curve of a binary classifier has often been utilized to measure the performance of the classifier. The area beneath this curve is used in particular because of its quoted probabilistic…

机器学习 · 计算机科学 2026-05-05 Steven Redolfi

Recent advances in data-centric medical AI have produced highly accurate diagnostic systems, but the emphasis on data curation and performance metrics has not translated into widespread clinical adoption. We conjecture that this limited…

The Abstraction and Reasoning Corpus (ARC) is a visual program synthesis benchmark designed to test challenging out-of-distribution generalization in humans and machines. Since 2019, limited progress has been observed on the challenge using…

人工智能 · 计算机科学 2024-09-04 Solim LeGris , Wai Keen Vong , Brenden M. Lake , Todd M. Gureckis

Receiver operating characteristic (ROC) analysis is one of the most popular approaches for evaluating and comparing the accuracy of medical diagnostic tests. Although various methodologies have been developed for estimating ROC curves and…

统计方法学 · 统计学 2022-08-16 Ainesh Sewak , Torsten Hothorn

Generative Artificial Intelligence (AI) can be used to automatically generate medical reports based on transcripts of medical consultations. The aim is to reduce the administrative burden that healthcare professionals face. The accuracy of…

计算与语言 · 计算机科学 2024-01-09 Wouter Faber , Renske Eline Bootsma , Tom Huibers , Sandra van Dulmen , Sjaak Brinkkemper

The Receiver Operating Characteristic (ROC) curve stands as a cornerstone in assessing the efficacy of biomarkers for disease diagnosis. Beyond merely evaluating performance, it provides with an optimal cutoff for biomarker values, crucial…

统计方法学 · 统计学 2025-04-29 Soutik Ghosal

Performance uncertainty quantification is essential for reliable validation and eventual clinical translation of medical imaging artificial intelligence (AI). Confidence intervals (CIs) play a central role in this process by indicating how…

With the increasing availability of AI-based decision support, there is an increasing need for their certification by both AI manufacturers and notified bodies, as well as the pragmatic (real-world) validation of these systems. Therefore,…

机器学习 · 计算机科学 2019-10-23 Federico Cabitza , Andrea Campagner

The receiver operating characteristic (ROC) curve and its summary measure, the Area Under the Curve (AUC), are well-established tools for evaluating the efficacy of biomarkers in biomedical studies. Compared to the traditional ROC curve,…

统计方法学 · 统计学 2025-10-20 Ziad Akram Ali Hammouri , Yating Zou , Rahul Ghosal , Juan C. Vidal , Marcos Matabuena

As AI-based clinical decision support (AI-CDS) is introduced in more and more aspects of healthcare services, HCI research plays an increasingly important role in designing for complementarity between AI and clinicians. However, current…

人机交互 · 计算机科学 2025-04-11 Venkatesh Sivaraman , Katelyn Morrison , Will Epperson , Adam Perer

In meta-analysis of diagnostic test accuracy, summary receiver operating characteristic (SROC) is a recommended method to summarize the discriminant capacity of a diagnostic test in the presence of study-specific cutoff values and the area…

统计方法学 · 统计学 2023-01-10 Yi Zhou , Ao Huang , Satoshi Hattori

Throughout science and technology, receiver operating characteristic (ROC) curves and associated area under the curve (AUC) measures constitute powerful tools for assessing the predictive abilities of features, markers and tests in binary…

机器学习 · 统计学 2021-06-25 Tilmann Gneiting , Eva-Maria Walz

The Receiver Operating Characteristic (ROC) curve is a representation of the statistical information discovered in binary classification problems and is a key concept in machine learning and data science. This paper studies the statistical…

统计方法学 · 统计学 2019-05-09 Kai Feng , Han Hong , Ke Tang , Jingyuan Wang

The receiver operating characteristic (ROC) curve is a powerful statistical tool and has been widely applied in medical research. In the ROC curve estimation, a commonly used assumption is that larger the biomarker value, greater severity…

统计方法学 · 统计学 2023-02-24 Dingding Hu , Meng Yuan , Tao Yu , Pengfei Li