中文
相关论文

相关论文: The Area Under the ROC Curve as a Measure of Clust…

200 篇论文

The Area Under Curve measure (AUC) seems apt to evaluate and compare diverse models, possibly without calibration. An important example of AUC application is the evaluation and benchmarking of models that predict faithfulness of generated…

计算与语言 · 计算机科学 2024-05-28 Juri Opitz

Area under ROC (AUC) is an important metric for binary classification and bipartite ranking problems. However, it is difficult to directly optimizing AUC as a learning objective, so most existing algorithms are based on optimizing a…

机器学习 · 计算机科学 2018-05-28 Siwei Lyu , Yiming Ying

The Area under the ROC curve (AUC) is a well-known ranking metric for problems such as imbalanced learning and recommender systems. The vast majority of existing AUC-optimization-based machine learning methods only focus on binary-class…

机器学习 · 计算机科学 2021-07-29 Zhiyong Yang , Qianqian Xu , Shilong Bao , Xiaochun Cao , Qingming Huang

The Partial Area Under the ROC Curve (PAUC), typically including One-way Partial AUC (OPAUC) and Two-way Partial AUC (TPAUC), measures the average performance of a binary classifier within a specific false positive rate and/or true positive…

机器学习 · 计算机科学 2022-10-12 Huiyang Shao , Qianqian Xu , Zhiyong Yang , Shilong Bao , Qingming Huang

The ROC curve is the gold standard for measuring the performance of a test/scoring statistic regarding its capacity to discriminate between two statistical populations in a wide variety of applications, ranging from anomaly detection in…

统计理论 · 数学 2023-01-25 Stéphan Clémençon , Myrto Limnios , Nicolas Vayatis

When determining which machine learning model best performs some high impact risk assessment task, practitioners commonly use the Area under the Curve (AUC) to defend and validate their model choices. In this paper, we argue that the…

计算机与社会 · 计算机科学 2023-05-30 Kweku Kwegyir-Aggrey , Marissa Gerchick , Malika Mohan , Aaron Horowitz , Suresh Venkatasubramanian

The use of machine learning models in consequential decision making often exacerbates societal inequity, in particular yielding disparate impact on members of marginalized groups defined by race and gender. The area under the ROC curve…

机器学习 · 计算机科学 2022-11-30 Zhenhuan Yang , Yan Lok Ko , Kush R. Varshney , Yiming Ying

Recent work on privacy-preserving machine learning has considered how data-mining competitions such as Kaggle could potentially be "hacked", either intentionally or inadvertently, by using information from an oracle that reports a…

机器学习 · 计算机科学 2017-09-12 Jacob Whitehill

The area under the receiver-operating characteristic curve (AUC) has become a popular index not only for measuring the overall prediction capacity of a marker but also the association strength between continuous and binary variables. In the…

统计方法学 · 统计学 2023-10-12 Pablo Martinez-Camblor , Sonia Perez-Fernandez , Lucas L. Dwiel , Wilder T. Doucette

The area under the ROC curve (AUC) is one of the most widely used performance measures for classification models in machine learning. However, it summarizes the true positive rates (TPRs) over all false positive rates (FPRs) in the ROC…

机器学习 · 计算机科学 2022-10-28 Yao Yao , Qihang Lin , Tianbao Yang

The Area Under the ROC Curve (AUC) is a crucial metric for machine learning, which evaluates the average performance over all possible True Positive Rates (TPRs) and False Positive Rates (FPRs). Based on the knowledge that a skillful…

机器学习 · 计算机科学 2022-06-24 Zhiyong Yang , Qianqian Xu , Shilong Bao , Yuan He , Xiaochun Cao , Qingming Huang

In recommendation systems, one is interested in the ranking of the predicted items as opposed to other losses such as the mean squared error. Although a variety of ways to evaluate rankings exist in the literature, here we focus on the Area…

机器学习 · 统计学 2015-08-26 Charanpal Dhanjal , Romaric Gaudel , Stephan Clemencon

The Area Under the ROC Curve (AUC) is a widely used performance measure for imbalanced classification arising from many application domains where high-dimensional sparse data is abundant. In such cases, each $d$ dimensional sample has only…

机器学习 · 计算机科学 2020-09-24 Baojian Zhou , Yiming Ying , Steven Skiena

We propose a novel classifier accuracy metric: the Bayesian Area Under the Receiver Operating Characteristic Curve (CBAUC). The method estimates the area under the ROC curve and is related to the recently proposed Bayesian Error Estimator.…

机器学习 · 计算机科学 2019-08-26 Syeda Sakira Hassan , Heikki Huttunen , Jari Niemi , Jussi Tohka

The Area Under the ROC Curve (AUC) is a key metric for classification, especially under class imbalance, with growing research focus on optimizing AUC over accuracy in applications like medical image analysis and deepfake detection. This…

机器学习 · 计算机科学 2025-05-27 Mingyang Wu , Li Lin , Wenbin Zhang , Xin Wang , Zhenhuan Yang , Shu Hu

ROC curves and cost curves are two popular ways of visualising classifier performance, finding appropriate thresholds according to the operating condition, and deriving useful aggregated measures such as the area under the ROC curve (AUC)…

人工智能 · 计算机科学 2011-08-01 José Hernández-Orallo , Peter Flach , Cèsar Ferri

Performance measurement is an essential task once a statistical model is created. The Area Under the receiving operating characteristics Curve (AUC) is the most popular measure for evaluating the quality of a binary classifier. In this…

统计计算 · 统计学 2021-05-24 Robin Van Oirbeek , Jolien Ponnet , Tim Verdonck

In analysis of binary outcomes, the receiver operator characteristic (ROC) curve is heavily used to show the performance of a model or algorithm. The ROC curve is informative about the performance over a series of thresholds and can be…

统计计算 · 统计学 2020-08-10 John Muschelli

Optimal performance is critical for decision-making tasks from medicine to autonomous driving, however common performance measures may be too general or too specific. For binary classifiers, diagnostic tests or prognosis at a timepoint,…

We study fairness in the context of classification where the performance is measured by the area under the curve (AUC) of the receiver operating characteristic. AUC is commonly used to measure the performance of prediction models. The same…

机器学习 · 计算机科学 2022-08-25 Hortense Fong , Vineet Kumar , Anay Mehrotra , Nisheeth K. Vishnoi