中文
相关论文

相关论文: Learning with Multiclass AUC: Theory and Algorithm…

200 篇论文

When minimizing the empirical risk in binary classification, it is a common practice to replace the zero-one loss with a surrogate loss to make the learning objective feasible to optimize. Examples of well-known surrogate losses for binary…

机器学习 · 统计学 2023-06-07 Nontawat Charoenphakdee , Jongyeong Lee , Masashi Sugiyama

The area under the ROC curve (AUC) is one of the most widely used performance measures for classification models in machine learning. However, it summarizes the true positive rates (TPRs) over all false positive rates (FPRs) in the ROC…

机器学习 · 计算机科学 2022-10-28 Yao Yao , Qihang Lin , Tianbao Yang

Area Under the Receiver Operating Characteristic Curve (AUC-ROC) is a popular evaluation metric for binary classifiers. In this paper, we discuss techniques to segment the AUC-ROC along human-interpretable dimensions. AUC-ROC is not an…

机器学习 · 计算机科学 2022-05-25 Arya Tafvizi , Besim Avci , Mukund Sundararajan

Although binary classification is a well-studied problem in computer vision, training reliable classifiers under severe class imbalance remains a challenging problem. Recent work has proposed techniques that mitigate the effects of training…

机器学习 · 计算机科学 2024-06-06 Kelsey Lieberman , Shuai Yuan , Swarna Kamlam Ravindran , Carlo Tomasi

Learning to optimize the area under the receiver operating characteristics curve (AUC) performance for imbalanced data has attracted much attention in recent years. Although there have been several methods of AUC optimization, scaling up…

机器学习 · 计算机科学 2024-10-28 Chao Wang , Kai Wu , Jing Liu

Receiver operating characteristic (ROC) curve is an informative tool in binary classification and Area Under ROC Curve (AUC) is a popular metric for reporting performance of binary classifiers. In this paper, first we present a…

机器学习 · 计算机科学 2021-09-14 Khashayar Namdar , Masoom A. Haider , Farzad Khalvati

The Area Under the ROC Curve (AUC) is a key metric for classification, especially under class imbalance, with growing research focus on optimizing AUC over accuracy in applications like medical image analysis and deepfake detection. This…

机器学习 · 计算机科学 2025-05-27 Mingyang Wu , Li Lin , Wenbin Zhang , Xin Wang , Zhenhuan Yang , Shu Hu

The Area Under the ROC Curve (AUC) is a well-known metric for evaluating instance-level long-tail learning problems. In the past two decades, many AUC optimization methods have been proposed to improve model performance under long-tail…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Boyu Han , Qianqian Xu , Zhiyong Yang , Shilong Bao , Peisong Wen , Yangbangyan Jiang , Qingming Huang

Imbalanced datasets pose significant challenges in areas including neuroscience, cognitive science, and medical diagnostics, where accurately detecting minority classes is essential for robust model performance. This study addresses the…

机器学习 · 计算机科学 2025-06-12 Minheng Xiao

The predictive quality of machine learning models is typically measured in terms of their (approximate) expected prediction accuracy or the so-called Area Under the Curve (AUC). Minimizing the reciprocals of these measures are the goals of…

机器学习 · 统计学 2019-03-04 Hiva Ghanbari , Minhan Li , Katya Scheinberg

Maximizing the area under the receiver operating characteristic curve (AUC) is a standard approach to imbalanced classification. So far, various supervised AUC optimization methods have been developed and they are also extended to…

机器学习 · 统计学 2022-04-12 Tomoya Sakai , Gang Niu , Masashi Sugiyama

The Area Under the ROC Curve (AUC) is a widely used performance measure for imbalanced classification arising from many application domains where high-dimensional sparse data is abundant. In such cases, each $d$ dimensional sample has only…

机器学习 · 计算机科学 2020-09-24 Baojian Zhou , Yiming Ying , Steven Skiena

Many applications of AI involve scoring individuals using a learned function of their attributes. These predictive risk scores are then used to take decisions based on whether the score exceeds a certain threshold, which may vary depending…

机器学习 · 统计学 2021-02-26 Robin Vogel , Aurélien Bellet , Stephan Clémençon

Medical events of interest, such as mortality, often happen at a low rate in electronic medical records, as most admitted patients survive. Training models with this imbalance rate (class density discrepancy) may lead to suboptimal…

机器学习 · 计算机科学 2022-08-02 Zepeng Huo , Xiaoning Qian , Shuai Huang , Zhangyang Wang , Bobak J. Mortazavi

We present a new active learning framework for multiclass classification based on surrogate risk minimization that operates beyond the standard realizability assumption. Existing surrogate-based active learning algorithms crucially rely on…

机器学习 · 计算机科学 2025-06-05 Atul Ganju , Shashaank Aiyer , Ved Sriraman , Karthik Sridharan

In this paper, we provide new theoretical results on the generalization properties of learning algorithms for multiclass classification problems. The originality of our work is that we propose to use the confusion matrix of a classifier as…

机器学习 · 计算机科学 2012-05-25 Pierre Machart , Liva Ralaivola

The ROC curve is the gold standard for measuring the performance of a test/scoring statistic regarding its capacity to discriminate between two statistical populations in a wide variety of applications, ranging from anomaly detection in…

统计理论 · 数学 2023-01-25 Stéphan Clémençon , Myrto Limnios , Nicolas Vayatis

Multiclass neural network classifiers are typically trained using cross-entropy loss but evaluated using metrics derived from the confusion matrix, such as Accuracy, $F_\beta$-Score, and Matthews Correlation Coefficient. This mismatch…

机器学习 · 计算机科学 2025-05-27 Deyuan Li , Taesoo Daniel Lee , Marynel Vázquez , Nathan Tsoi

We formulate the local ranking problem in the framework of bipartite ranking where the goal is to focus on the best instances. We propose a methodology based on the construction of real-valued scoring functions. We study empirical risk…

统计理论 · 数学 2016-08-16 Stéphan Clémençon , Nicolas Vayatis

We aim at developing and improving the imbalanced business risk modeling via jointly using proper evaluation criteria, resampling, cross-validation, classifier regularization, and ensembling techniques. Area Under the Receiver Operating…

机器学习 · 统计学 2019-03-14 Yan Wang , Xuelei Sherry Ni