English
Related papers

Related papers: Scalable Nonlinear AUC Maximization Methods

200 papers

Receiver Operating Characteristic (ROC) curves are plots of true positive rate versus false positive rate which are used to evaluate binary classification algorithms. Because the Area Under the Curve (AUC) is a constant function of the…

Machine Learning · Computer Science 2023-02-23 Kyle R. Rust , Toby D. Hocking

The Area Under the ROC Curve (AUC) is a key metric for classification, especially under class imbalance, with growing research focus on optimizing AUC over accuracy in applications like medical image analysis and deepfake detection. This…

Machine Learning · Computer Science 2025-05-27 Mingyang Wu , Li Lin , Wenbin Zhang , Xin Wang , Zhenhuan Yang , Shu Hu

In this paper, we study distributed algorithms for large-scale AUC maximization with a deep neural network as a predictive model. Although distributed learning techniques have been investigated extensively in deep learning, they are not…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-12 Zhishuai Guo , Mingrui Liu , Zhuoning Yuan , Li Shen , Wei Liu , Tianbao Yang

Deep Convolutional Neural Networks (DCNN) has shown excellent performance in a variety of machine learning tasks. This manuscript presents Deep Convolutional Neural Fields (DeepCNF), a combination of DCNN with Conditional Random Field…

Machine Learning · Statistics 2015-11-23 Sheng Wang , Siqi Sun , Jinbo Xu

ROC curves and cost curves are two popular ways of visualising classifier performance, finding appropriate thresholds according to the operating condition, and deriving useful aggregated measures such as the area under the ROC curve (AUC)…

Artificial Intelligence · Computer Science 2011-08-01 José Hernández-Orallo , Peter Flach , Cèsar Ferri

As a variant of the Area Under the ROC Curve (AUC), the partial AUC (PAUC) focuses on a specific range of false positive rate (FPR) and/or true positive rate (TPR) in the ROC curve. It is a pivotal evaluation metric in real-world scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yangbangyan Jiang , Qianqian Xu , Huiyang Shao , Zhiyong Yang , Shilong Bao , Xiaochun Cao , Qingming Huang

The predictive quality of machine learning models is typically measured in terms of their (approximate) expected prediction accuracy or the so-called Area Under the Curve (AUC). Minimizing the reciprocals of these measures are the goals of…

Machine Learning · Statistics 2019-03-04 Hiva Ghanbari , Minhan Li , Katya Scheinberg

Stochastic Gradient Descent has been widely studied with classification accuracy as a performance measure. However, these stochastic algorithms cannot be directly used when non-decomposable pairwise performance measures are used such as…

Machine Learning · Statistics 2020-12-07 Soham Dan , Dushyant Sahoo

Stochastic AUC maximization has garnered an increasing interest due to better fit to imbalanced data classification. However, existing works are limited to stochastic AUC maximization with a linear predictive model, which restricts its…

Machine Learning · Computer Science 2020-07-01 Mingrui Liu , Zhuoning Yuan , Yiming Ying , Tianbao Yang

The predictive quality of machine learning models is typically measured in terms of their (approximate) expected prediction error or the so-called Area Under the Curve (AUC) for a particular data distribution. However, when the models are…

Machine Learning · Computer Science 2018-02-08 Hiva Ghanbari , Katya Scheinberg

Areas under ROC (AUROC) and precision-recall curves (AUPRC) are common metrics for evaluating classification performance for imbalanced problems. Compared with AUROC, AUPRC is a more appropriate metric for highly imbalanced datasets. While…

Machine Learning · Computer Science 2023-04-14 Qi Qi , Youzhi Luo , Zhao Xu , Shuiwang Ji , Tianbao Yang

Learning to optimize the area under the receiver operating characteristics curve (AUC) performance for imbalanced data has attracted much attention in recent years. Although there have been several methods of AUC optimization, scaling up…

Machine Learning · Computer Science 2024-10-28 Chao Wang , Kai Wu , Jing Liu

Optimal performance is critical for decision-making tasks from medicine to autonomous driving, however common performance measures may be too general or too specific. For binary classifiers, diagnostic tests or prognosis at a timepoint,…

Multiple binary responses arise in many modern data-analytic problems. Although fitting separate logistic regressions for each response is computationally attractive, it ignores shared structure and can be statistically inefficient,…

Machine Learning · Statistics 2026-01-14 The Tien Mai

Recent work on privacy-preserving machine learning has considered how data-mining competitions such as Kaggle could potentially be "hacked", either intentionally or inadvertently, by using information from an oracle that reports a…

Machine Learning · Computer Science 2017-09-12 Jacob Whitehill

Performance measurement is an essential task once a statistical model is created. The Area Under the receiving operating characteristics Curve (AUC) is the most popular measure for evaluating the quality of a binary classifier. In this…

Computation · Statistics 2021-05-24 Robin Van Oirbeek , Jolien Ponnet , Tim Verdonck

The most popular classification algorithms are designed to maximize classification accuracy during training. However, this strategy may fail in the presence of class imbalance since it is possible to train models with high accuracy by…

Machine Learning · Computer Science 2024-01-26 Erhan Can Ozcan , Berk Görgülü , Mustafa G. Baydogan , Ioannis Ch. Paschalidis

AUC is an important performance measure and many algorithms have been devoted to AUC optimization, mostly by minimizing a surrogate convex loss on a training data set. In this work, we focus on one-pass AUC optimization that requires only…

Machine Learning · Computer Science 2020-07-07 Wei Gao , Rong Jin , Shenghuo Zhu , Zhi-Hua Zhou

The area under the receiver operating characteristic curve (AUC) is often used to evaluate the performance of clinical prediction models. Recently, a more refined strategy has been proposed to examine a partial area under the curve (pAUC),…

Applications · Statistics 2016-06-22 Travis Gerke , Svitlana Tyekucheva , Lorelei Mucci , Giovanni Parmigiani

The Area Under Curve measure (AUC) seems apt to evaluate and compare diverse models, possibly without calibration. An important example of AUC application is the evaluation and benchmarking of models that predict faithfulness of generated…

Computation and Language · Computer Science 2024-05-28 Juri Opitz