English
Related papers

Related papers: Modelling Receiver Operating Characteristic Curves…

200 papers

Whilst the size and complexity of ML models have rapidly and significantly increased over the past decade, the methods for assessing their performance have not kept pace. In particular, among the many potential performance metrics, the ML…

Machine Learning · Computer Science 2023-12-29 Michael Roberts , Alon Hazan , Sören Dittmer , James H. F. Rudd , Carola-Bibiane Schönlieb

The Receiver Operating Characteristic (ROC) surface is a generalization of ROC curve and is widely used for assessment of the accuracy of diagnostic tests on three categories. A complication called the verification bias, meaning that not…

Applications · Statistics 2018-03-20 Rui Zhu , Subhashis Ghosal

Receiver operating characteristic (ROC) curve is an informative tool in binary classification and Area Under ROC Curve (AUC) is a popular metric for reporting performance of binary classifiers. In this paper, first we present a…

Machine Learning · Computer Science 2021-09-14 Khashayar Namdar , Masoom A. Haider , Farzad Khalvati

In analysis of binary outcomes, the receiver operator characteristic (ROC) curve is heavily used to show the performance of a model or algorithm. The ROC curve is informative about the performance over a series of thresholds and can be…

Computation · Statistics 2020-08-10 John Muschelli

Accurate diagnosis of disease is of great importance in clinical practice and medical research. The receiver operating characteristic (ROC) surface is a popular tool for evaluating the discriminatory ability of continuous diagnostic test…

Methodology · Statistics 2018-05-22 Vanda Inacio de Carvalho , Miguel de Carvalho , Adam Branscum

Multiple diagnostic tests are frequently used to determine the presence of a disease condition in patients. In this paper, we use bivariate copulas to examine the properties of receiver operating characteristic (ROC) curves formed when two…

Diagnostic tests are of critical importance in health care and medical research. Motivated by the impact that atypical and outlying test outcomes might have on the assessment of the discriminatory ability of a diagnostic test, we develop a…

We propose a novel classifier accuracy metric: the Bayesian Area Under the Receiver Operating Characteristic Curve (CBAUC). The method estimates the area under the ROC curve and is related to the recently proposed Bayesian Error Estimator.…

Machine Learning · Computer Science 2019-08-26 Syeda Sakira Hassan , Heikki Huttunen , Jari Niemi , Jussi Tohka

We provide a comprehensive theory of conducting in-sample statistical inference about receiver operating characteristic (ROC) curves that are based on predicted values from a first stage model with estimated parameters (such as a logit…

Econometrics · Economics 2021-12-06 Yu-Chin Hsu , Robert P. Lieli

When evaluating medical tests or biomarkers for disease classification, the area under the receiver-operating characteristic (ROC) curve is a widely used performance metric that does not require us to commit to a specific decision…

Methodology · Statistics 2013-10-21 Wanhua Su , Yan Yuan , Mu Zhu

Verification bias is a well-known problem that may occur in the evaluation of predictive ability of diagnostic tests. When a binary disease status is considered, various solutions can be found in the literature to correct inference based on…

Methodology · Statistics 2023-04-10 Khanh To Duc , Monica Chiogna , Gianfranco Adimari

Receiver Operating Characteristic (ROC) curves have recently been used to evaluate the performance of models for spatial presence-absence or presence-only data. Applications include species distribution modelling and mineral prospectivity…

Methodology · Statistics 2025-06-05 Adrian Baddeley , Ege Rubak , Suman Rakshit , Gopalan Nair

Objectives: This study provides an effective model selection method based on the empirical likelihood approach for constructing summary receiver operating characteristic (sROC) curves from meta-analyses of diagnostic studies. Methods: We…

Methodology · Statistics 2018-03-13 ShengLi Tzeng , Chun-Shu Chen , Yu-Fen Li , Jin-Hua Chen

The area under the receiver-operating characteristic curve (AUC) has become a popular index not only for measuring the overall prediction capacity of a marker but also the association strength between continuous and binary variables. In the…

The summary receiver operating characteristic (SROC) curve has been recommended as one important meta-analytical summary to represent the accuracy of a diagnostic test in the presence of heterogeneous cutoff values. However, selective…

Methodology · Statistics 2024-01-11 Yi Zhou , Ao Huang , Satoshi Hattori

Throughout science and technology, receiver operating characteristic (ROC) curves and associated area under the curve (AUC) measures constitute powerful tools for assessing the predictive abilities of features, markers and tests in binary…

Machine Learning · Statistics 2021-06-25 Tilmann Gneiting , Eva-Maria Walz

In medical diagnostics, leveraging multiple biomarkers can significantly improve classification accuracy compared to using a single biomarker. While existing methods based on exponential tilting or density ratio models have shown promise,…

Methodology · Statistics 2026-01-08 Fangyong Zheng , Pengfei Li , Tao Yu

The area under the receiver operating characteristic curve (AUC) serves as a summary of a binary classifier's performance. Methods for estimating the AUC have been developed under a binormality assumption which restricts the distribution of…

Methodology · Statistics 2020-07-28 Zhe Wang , Ryan Martin

The Receiver Operating Characteristic (ROC) is a well-established representation of the tradeoff between detection and false alarm probabilities in binary hypothesis testing. In many practical contexts ROC's are generated by thresholding a…

Statistics Theory · Mathematics 2020-12-16 Catherine Medlock , Alan Oppenheim

Gaussian Mixture Models (GMM) do not adapt well to curved and strongly nonlinear data. However, we can use Gaussians in the curvilinear coordinate systems to solve this problem. Moreover, such a solution allows for the adaptation of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Krzysztof Byrski , Przemysław Spurek , Jacek Tabor