English
Related papers

Related papers: AUCSeg: AUC-oriented Pixel-level Long-tail Semanti…

200 papers

Area under ROC (AUC) is an important metric for binary classification and bipartite ranking problems. However, it is difficult to directly optimizing AUC as a learning objective, so most existing algorithms are based on optimizing a…

Machine Learning · Computer Science 2018-05-28 Siwei Lyu , Yiming Ying

Receiver Operating Characteristic (ROC) curves are useful for evaluation in binary classification and changepoint detection, but difficult to use for learning since the Area Under the Curve (AUC) is piecewise constant (gradient zero almost…

Machine Learning · Computer Science 2024-10-14 Jadon Fowler , Toby Dylan Hocking

Adequate evaluation of an information retrieval system to estimate future performance is a crucial task. Area under the ROC curve (AUC) is widely used to evaluate the generalization of a retrieval system. However, the objective function…

Information Retrieval · Computer Science 2016-04-26 Sean J. Welleck

Semi-supervised learning (SSL) addresses the critical challenge of training accurate models when labeled data is scarce but unlabeled data is abundant. Graph-based SSL (GSSL) has emerged as a popular framework that captures data structure…

Machine Learning · Statistics 2026-02-10 Nadav Katz , Ariel Jaffe

Area under the receiver operating characteristics curve (AUC) is an important metric for a wide range of signal processing and machine learning problems, and scalable methods for optimizing AUC have recently been proposed. However, handling…

Machine Learning · Computer Science 2018-06-01 San Gultekin , Avishek Saha , Adwait Ratnaparkhi , John Paisley

Deep neural networks provide effective solutions to small-footprint keyword spotting (KWS). However, if training data is limited, it remains challenging to achieve robust and highly accurate KWS in real-world scenarios where unseen sounds…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-14 Menglong Xu , Shengqiang Li , Chengdong Liang , Xiao-Lei Zhang

In recommendation systems, one is interested in the ranking of the predicted items as opposed to other losses such as the mean squared error. Although a variety of ways to evaluate rankings exist in the literature, here we focus on the Area…

Machine Learning · Statistics 2015-08-26 Charanpal Dhanjal , Romaric Gaudel , Stephan Clemencon

Recently, self-supervised large-scale visual pre-training models have shown great promise in representing pixel-level semantic relationships, significantly promoting the development of unsupervised dense prediction tasks, e.g., unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Kehan Li , Zhennan Wang , Zesen Cheng , Runyi Yu , Yian Zhao , Guoli Song , Chang Liu , Li Yuan , Jie Chen

The Partial Area Under the ROC Curve (PAUC), typically including One-way Partial AUC (OPAUC) and Two-way Partial AUC (TPAUC), measures the average performance of a binary classifier within a specific false positive rate and/or true positive…

Machine Learning · Computer Science 2022-10-12 Huiyang Shao , Qianqian Xu , Zhiyong Yang , Shilong Bao , Qingming Huang

Learning to optimize the area under the receiver operating characteristics curve (AUC) performance for imbalanced data has attracted much attention in recent years. Although there have been several methods of AUC optimization, scaling up…

Machine Learning · Computer Science 2024-10-28 Chao Wang , Kai Wu , Jing Liu

Optimization metrics are crucial for building recommendation systems at scale. However, an effective and efficient metric for practical use remains elusive. While Top-K ranking metrics are the gold standard for optimization, they suffer…

Information Retrieval · Computer Science 2024-03-05 Wentao Shi , Chenxu Wang , Fuli Feng , Yang Zhang , Wenjie Wang , Junkang Wu , Xiangnan He

Receiver Operating Characteristic (ROC) curves are plots of true positive rate versus false positive rate which are useful for evaluating binary classification models, but difficult to use for learning since the Area Under the Curve (AUC)…

Machine Learning · Statistics 2021-07-06 Jonathan Hillman , Toby Dylan Hocking

Areas under ROC (AUROC) and precision-recall curves (AUPRC) are common metrics for evaluating classification performance for imbalanced problems. Compared with AUROC, AUPRC is a more appropriate metric for highly imbalanced datasets. While…

Machine Learning · Computer Science 2023-04-14 Qi Qi , Youzhi Luo , Zhao Xu , Shuiwang Ji , Tianbao Yang

Autonomous robotic systems applied to new domains require an abundance of expensive, pixel-level dense labels to train robust semantic segmentation models under full supervision. This study proposes a model-agnostic Depth Edge Alignment…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Patrick Schmidt , Vasileios Belagiannis , Lazaros Nalpantidis

Receiver operating characteristic (ROC) curve is an informative tool in binary classification and Area Under ROC Curve (AUC) is a popular metric for reporting performance of binary classifiers. In this paper, first we present a…

Machine Learning · Computer Science 2021-09-14 Khashayar Namdar , Masoom A. Haider , Farzad Khalvati

Cost-sensitive learning relies on the availability of a known and fixed cost matrix. However, in some scenarios, the cost matrix is uncertain during training, and re-train a classifier after the cost matrix is specified would not be an…

Machine Learning · Computer Science 2012-09-11 Rui Wang , Ke Tang

We introduce Retrieval Augmented Classification (RAC), a generic approach to augmenting standard image classification pipelines with an explicit retrieval module. RAC consists of a standard base image encoder fused with a parallel retrieval…

Computer Vision and Pattern Recognition · Computer Science 2022-02-24 Alexander Long , Wei Yin , Thalaiyasingam Ajanthan , Vu Nguyen , Pulak Purkait , Ravi Garg , Alan Blair , Chunhua Shen , Anton van den Hengel

We introduce a novel loss max-pooling concept for handling imbalanced training data distributions, applicable as alternative loss layer in the context of deep neural networks for semantic image segmentation. Most real-world semantic…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Samuel Rota Bulò , Gerhard Neuhold , Peter Kontschieder

The area under the ROC curve (AUC) is the standard measure of a biomarker's discriminatory accuracy; however, naive AUC estimates can be misleading when validation cohorts differ from the intended target population. Such covariate shifts…

Methodology · Statistics 2025-11-20 Jiajun Liu , Guangcai Mao , Xiaofei Wang

Medical image segmentation has played an important role in medical analysis and widely developed for many clinical applications. Deep learning-based approaches have achieved high performance in semantic segmentation but they are limited to…

Image and Video Processing · Electrical Eng. & Systems 2020-12-07 Ngan Le , Trung Le , Kashu Yamazaki , Toan Duc Bui , Khoa Luu , Marios Savides