English
Related papers

Related papers: Bayesian ROC surface estimation under verification…

200 papers

The ROC (receiver operating characteristic) curve is a widely used device for assessing decision-making systems. It seems surprising, in view of its history dating back to World War Two, that the assignment of uncertainties to a ROC curve…

Data Analysis, Statistics and Probability · Physics 2024-08-19 M. P. Fewell

Several efforts have been done to bring ROC analysis beyond (binary) classification, especially in regression. However, the mapping and possibilities of these proposals do not correspond to what we expect from the analysis of operating…

Statistics Theory · Mathematics 2013-10-17 Jose Hernandez-Orallo

To evaluate a classification algorithm, it is common practice to plot the ROC curve using test data. However, the inherent randomness in the test data can undermine our confidence in the conclusions drawn from the ROC curve, necessitating…

Methodology · Statistics 2024-05-22 Zheshi Zheng , Bo Yang , Peter Song

We have carried out a pilot study on a standard collection of electrocardiograms from patients who suffer from congestive heart failure, and subjects without cardiac pathology, using receiver-operating-characteristic (ROC) analysis. The…

chao-dyn · Physics 2007-05-23 Stefan Thurner , Markus C. Feurstein , Malvin C. Teich

We present a novel analytical framework to characterize the distribution of the conditional receiver operating characteristic (ROC) in radar systems operating within a realization of a Poisson field of interferers and clutters. While…

Information Theory · Computer Science 2025-05-28 Gourab Ghatak

Classification performance is often not uniform over the data. Some areas in the input space are easier to classify than others. Features that hold information about the "difficulty" of the data may be non-discriminative and are therefore…

Machine Learning · Computer Science 2016-05-24 Oran Richman , Shie Mannor

Objectives: This study provides an effective model selection method based on the empirical likelihood approach for constructing summary receiver operating characteristic (sROC) curves from meta-analyses of diagnostic studies. Methods: We…

Methodology · Statistics 2018-03-13 ShengLi Tzeng , Chun-Shu Chen , Yu-Fen Li , Jin-Hua Chen

The area under a receiver operating characteristic curve (AUC) is a useful tool to assess the performance of continuous-scale diagnostic tests on binary classification. In this article, we propose an empirical likelihood (EL) method to…

Methodology · Statistics 2022-05-05 Chul Moon , Xinlei Wang , Johan Lim

The receiver operating characteristic (ROC) curve and its summary measure, the Area Under the Curve (AUC), are well-established tools for evaluating the efficacy of biomarkers in biomedical studies. Compared to the traditional ROC curve,…

Methodology · Statistics 2025-10-20 Ziad Akram Ali Hammouri , Yating Zou , Rahul Ghosal , Juan C. Vidal , Marcos Matabuena

The Receiver Operating Characteristic (ROC) curve stands as a cornerstone in assessing the efficacy of biomarkers for disease diagnosis. Beyond merely evaluating performance, it provides with an optimal cutoff for biomarker values, crucial…

Methodology · Statistics 2025-04-29 Soutik Ghosal

A new semiparametric model of the ROC curve based on the resilience family or proportional reversed hazard family is proposed which is an alternative to the existing models. The resulting ROC curve and its summary indices (such as area…

Methodology · Statistics 2022-03-28 Ruhul Ali Khan

The ROC curve is the gold standard for measuring the performance of a test/scoring statistic regarding its capacity to discriminate between two statistical populations in a wide variety of applications, ranging from anomaly detection in…

Statistics Theory · Mathematics 2023-01-25 Stéphan Clémençon , Myrto Limnios , Nicolas Vayatis

Paired comparison models are used for analyzing data that involves pairwise comparisons among a set of objects. When the outcomes of the pairwise comparisons have no ties, the paired comparison models can be generalized as a class of binary…

Methodology · Statistics 2022-11-29 Ran Huo , Mark E. Glickman

The summary receiver operating characteristic (SROC) curve has been recommended as one important meta-analytical summary to represent the accuracy of a diagnostic test in the presence of heterogeneous cutoff values. However, selective…

Methodology · Statistics 2024-01-11 Yi Zhou , Ao Huang , Satoshi Hattori

Many applications of AI involve scoring individuals using a learned function of their attributes. These predictive risk scores are then used to take decisions based on whether the score exceeds a certain threshold, which may vary depending…

Machine Learning · Statistics 2021-02-26 Robin Vogel , Aurélien Bellet , Stephan Clémençon

Diagnostic tests are of critical importance in health care and medical research. Motivated by the impact that atypical and outlying test outcomes might have on the assessment of the discriminatory ability of a diagnostic test, we develop a…

Receiver Operating Characteristic (ROC) curves are plots of true positive rate versus false positive rate which are used to evaluate binary classification algorithms. Because the Area Under the Curve (AUC) is a constant function of the…

Machine Learning · Computer Science 2023-02-23 Kyle R. Rust , Toby D. Hocking

Everybody writes that ROC curves, a very common tool in binary classification problems, should be optimal, and in particular concave, non-decreasing and above the 45-degree line. Everybody uses ROC curves, theoretical and especially…

Methodology · Statistics 2019-08-01 Lidia Sacchetto , Mauro Gasparini

Receiver operating characteristic (ROC) analysis is widely used for evaluating diagnostic systems. Recent studies have shown that estimating an area under ROC curve (AUC) with standard cross-validation methods suffers from a large bias. The…

Machine Learning · Statistics 2024-01-25 Ileana Montoya Perez , Antti Airola , Peter J. Boström , Ivan Jambor , Tapio Pahikkala

The area under the ROC curve is widely used as a measure of performance of classification rules. However, it has recently been shown that the measure is fundamentally incoherent, in the sense that it treats the relative severities of…

Methodology · Statistics 2013-08-02 David J. Hand , Christoforos Anagnostopoulos