English
Related papers

Related papers: Time-dependent AUC with right-censored data: a sur…

200 papers

Recent work on privacy-preserving machine learning has considered how data-mining competitions such as Kaggle could potentially be "hacked", either intentionally or inadvertently, by using information from an oracle that reports a…

Machine Learning · Computer Science 2017-09-12 Jacob Whitehill

The receiver operating characteristic (ROC) curve is a very useful tool for analyzing the diagnostic/classification power of instruments/classification schemes as long as a binary-scale gold standard is available. When the gold standard is…

Methodology · Statistics 2011-05-10 Zhanfeng Wang , Yuan-chin Ivan Chang

Throughout science and technology, receiver operating characteristic (ROC) curves and associated area under the curve (AUC) measures constitute powerful tools for assessing the predictive abilities of features, markers and tests in binary…

Machine Learning · Statistics 2021-06-25 Tilmann Gneiting , Eva-Maria Walz

ROC curves and cost curves are two popular ways of visualising classifier performance, finding appropriate thresholds according to the operating condition, and deriving useful aggregated measures such as the area under the ROC curve (AUC)…

Artificial Intelligence · Computer Science 2011-08-01 José Hernández-Orallo , Peter Flach , Cèsar Ferri

This paper focuses on quantifying and estimating the predictive accuracy of prognostic models for time-to-event outcomes with competing events. We consider the time-dependent discrimination and calibration metrics, including the receiver…

Methodology · Statistics 2017-07-14 Cai Wu , Liang Li

Scoring functions are used to evaluate and compare partially probabilistic forecasts. We investigate the use of rank-sum functions such as empirical Area Under the Curve (AUC), a widely-used measure of classification performance, as a…

Statistics Theory · Mathematics 2017-01-31 Simon Byrne

The Receiver Operating Characteristic (ROC) curve and the Area Under the Curve (AUC) of the ROC curve are widely used to compare the performance of diagnostic and prognostic assays. The ROC curve has the advantage that it is independent of…

Predicting the timing and occurrence of events is a major focus of data science applications, especially in the context of biomedical research. Performance for models estimating these outcomes, often referred to as time-to-event or survival…

Methodology · Statistics 2024-06-07 Ying Jin , Andrew Leroux

This article considers the automatic selection problem of the relevant explanatory variables in a right-censored model on a massive database. We propose and study four aggregated censored adaptive LASSO estimators constructed by dividing…

Statistics Theory · Mathematics 2025-02-04 Gabriela Ciuperca

Evaluating the performance of a prediction model is a common task in medical statistics. Standard accuracy metrics require the observation of the true outcomes. This is typically not possible in the setting with time-to-event outcomes due…

Methodology · Statistics 2025-07-18 Zhenwei Yang , Dimitris Rizopoulos , Lisa F. Newcomb , Nicole S. Erler

The Area Under Curve measure (AUC) seems apt to evaluate and compare diverse models, possibly without calibration. An important example of AUC application is the evaluation and benchmarking of models that predict faithfulness of generated…

Computation and Language · Computer Science 2024-05-28 Juri Opitz

The Receiver Operating Characteristic (ROC) curve is a useful tool that measures the discriminating power of a continuous variable or the accuracy of a pharmaceutical or medical test to distinguish between two conditions or classes. In…

Methodology · Statistics 2022-07-26 Ana M. Bianco , Graciela Boente , Wenceslao Gonzalez-Manteiga

The ROC (receiver operating characteristic) curve is a widely used device for assessing decision-making systems. It seems surprising, in view of its history dating back to World War Two, that the assignment of uncertainties to a ROC curve…

Data Analysis, Statistics and Probability · Physics 2024-08-19 M. P. Fewell

In analysis of binary outcomes, the receiver operator characteristic (ROC) curve is heavily used to show the performance of a model or algorithm. The ROC curve is informative about the performance over a series of thresholds and can be…

Computation · Statistics 2020-08-10 John Muschelli

Performance measurement is an essential task once a statistical model is created. The Area Under the receiving operating characteristics Curve (AUC) is the most popular measure for evaluating the quality of a binary classifier. In this…

Computation · Statistics 2021-05-24 Robin Van Oirbeek , Jolien Ponnet , Tim Verdonck

The Area Under the ROC Curve (AUC) is an important model metric for evaluating binary classifiers, and many algorithms have been proposed to optimize AUC approximately. It raises the question of whether the generally insignificant gains…

Computational Geometry · Computer Science 2023-06-05 Baojian Zhou , Steven Skiena

In this paper we consider a time-to-event variable $T$ that is subject to random right censoring, and we assume that the censoring time $C$ is stochastically dependent on $T$ and that there is a positive probability of not observing the…

Methodology · Statistics 2024-03-14 Morine Delhelle , Ingrid Van Keilegom

In clinical trials, multiple outcomes of different priorities commonly occur as the patient's response may not be adequately characterized by a single outcome. Win statistics are appealing summary measures for between-group difference at…

Methodology · Statistics 2025-06-04 Ying Cui , Bo Huang , Gaohong Dong , Ryuji Uozumi , Lu Tian

Background: Receiver Operating Characteristic (ROC) curves are widely used to evaluate the performance of Software Defect Prediction (SDP) models that estimate module fault-proneness, i.e., the probability that a module is faulty. A ROC…

Software Engineering · Computer Science 2026-04-23 Luigi Lavazza , Gabriele Rotoloni , Sandro Morasca

This report examines the Pinned AUC metric introduced and highlights some of its limitations. Pinned AUC provides a threshold-agnostic measure of unintended bias in a classification model, inspired by the ROC-AUC metric. However, as we…

Machine Learning · Statistics 2019-03-07 Daniel Borkan , Lucas Dixon , John Li , Jeffrey Sorensen , Nithum Thain , Lucy Vasserman