English
Related papers

Related papers: Computational Efficient Approximations of the Conc…

200 papers

Area under ROC curve (AUC) is a widely used performance measure for classification models. We propose two new distributionally robust AUC maximization models (DR-AUC) that rely on the Kantorovich metric and approximate the AUC with the…

Optimization and Control · Mathematics 2020-05-28 Wenbo Ma , Miguel A. Lejeune

The area under the ROC curve (AUC) is a measure of interest in various machine learning and data mining applications. It has been widely used to evaluate classification performance on heavily imbalanced data. The kernelized AUC maximization…

Machine Learning · Computer Science 2019-04-30 Majdi Khalid , Indrakshi Ray , Hamidreza Chitsaz

The selective classifier (SC) has been proposed for rank based uncertainty thresholding, which could have applications in safety critical areas such as medical diagnostics, autonomous driving, and the justice system. The Area Under the…

Machine Learning · Statistics 2025-09-04 Han Zhou , Jordy Van Landeghem , Teodora Popordanoska , Matthew B. Blaschko

The area under the receiver operating characteristic curve (AUC) serves as a summary of a binary classifier's performance. Methods for estimating the AUC have been developed under a binormality assumption which restricts the distribution of…

Methodology · Statistics 2020-07-28 Zhe Wang , Ryan Martin

The area under the ROC curve (AUC) is the standard measure of a biomarker's discriminatory accuracy; however, naive AUC estimates can be misleading when validation cohorts differ from the intended target population. Such covariate shifts…

Methodology · Statistics 2025-11-20 Jiajun Liu , Guangcai Mao , Xiaofei Wang

Objective: Area under the receiving operator characteristic curve (AUC) is commonly reported alongside prediction models for binary outcomes. Recent articles have raised concerns that AUC might be a misleading measure of prediction…

Machine Learning · Statistics 2025-11-04 Emily Minus , R. Yates Coley , Susan M. Shortreed , Brian D. Williamson

Machine learning models deployed in real-world applications are often evaluated with precision-based metrics such as F1-score or AUC-PR (Area Under the Curve of Precision Recall). Heavily dependent on the class prior, such metrics make it…

Machine Learning · Computer Science 2020-04-29 Wissam Siblini , Jordan Fréry , Liyun He-Guelton , Frédéric Oblé , Yi-Qing Wang

The area under the ROC curve (AUC) is one of the most widely used performance measures for classification models in machine learning. However, it summarizes the true positive rates (TPRs) over all false positive rates (FPRs) in the ROC…

Machine Learning · Computer Science 2022-10-28 Yao Yao , Qihang Lin , Tianbao Yang

The predictive quality of machine learning models is typically measured in terms of their (approximate) expected prediction accuracy or the so-called Area Under the Curve (AUC). Minimizing the reciprocals of these measures are the goals of…

Machine Learning · Statistics 2019-03-04 Hiva Ghanbari , Minhan Li , Katya Scheinberg

Approximate Bayesian Computation (ABC) has become increasingly prominent as a method for conducting parameter inference in a range of challenging statistical problems, most notably those characterized by an intractable likelihood function.…

The area under the receiver-operating characteristic curve (AUC) has become a popular index not only for measuring the overall prediction capacity of a marker but also the association strength between continuous and binary variables. In the…

Receiver Operating Characteristic (ROC) curves are useful for evaluation in binary classification and changepoint detection, but difficult to use for learning since the Area Under the Curve (AUC) is piecewise constant (gradient zero almost…

Machine Learning · Computer Science 2024-10-14 Jadon Fowler , Toby Dylan Hocking

Approximate Bayesian computation (ABC) is a popular likelihood-free inference method for models with intractable likelihood functions. As ABC methods usually rely on comparing summary statistics of observed and simulated data, the choice of…

Machine Learning · Statistics 2022-06-22 Ayush Bharti , Louis Filstroff , Samuel Kaski

The Area Under the ROC Curve (AUC) is a widely used performance metric for binary classifiers. However, as a global ranking statistic, the AUC aggregates model behavior over the entire dataset, masking localized weaknesses in specific…

Applications · Statistics 2025-08-12 Agus Sudjianto , Alice J. Liu

As a variant of the Area Under the ROC Curve (AUC), the partial AUC (PAUC) focuses on a specific range of false positive rate (FPR) and/or true positive rate (TPR) in the ROC curve. It is a pivotal evaluation metric in real-world scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yangbangyan Jiang , Qianqian Xu , Huiyang Shao , Zhiyong Yang , Shilong Bao , Xiaochun Cao , Qingming Huang

AUC (Area under the ROC curve) is an important performance measure for applications where the data is highly imbalanced. Learning to maximize AUC performance is thus an important research problem. Using a max-margin based surrogate loss…

Artificial Intelligence · Computer Science 2016-12-28 Vishal Kakkar , Shirish K. Shevade , S Sundararajan , Dinesh Garg

Approximate Bayesian Computation (ABC) enables statistical inference in simulator-based models whose likelihoods are difficult to calculate but easy to simulate from. ABC constructs a kernel-type approximation to the posterior distribution…

Methodology · Statistics 2022-12-02 Yuexi Wang , Tetsuya Kaji , Veronika Ročková

Cost-sensitive learning relies on the availability of a known and fixed cost matrix. However, in some scenarios, the cost matrix is uncertain during training, and re-train a classifier after the cost matrix is specified would not be an…

Machine Learning · Computer Science 2012-09-11 Rui Wang , Ke Tang

We propose a method for maximizing a partial area under a receiver operating characteristic (ROC) curve (pAUC) for binary classification tasks. In binary classification tasks, accuracy is the most commonly used as a measure of classifier…

Machine Learning · Statistics 2018-06-14 Naonori Ueda , Akinori Fujino

The area under the ROC curve (AUC) is a widely used performance measure in machine learning. Increasingly, however, in several applications, ranging from ranking to biometric screening to medicine, performance is measured not in terms of…

Machine Learning · Computer Science 2016-11-29 Harikrishna Narasimhan , Shivani Agarwal