English
Related papers

Related papers: AUC Optimisation and Collaborative Filtering

200 papers

The Partial Area Under the ROC Curve (PAUC), typically including One-way Partial AUC (OPAUC) and Two-way Partial AUC (TPAUC), measures the average performance of a binary classifier within a specific false positive rate and/or true positive…

Machine Learning · Computer Science 2022-10-12 Huiyang Shao , Qianqian Xu , Zhiyong Yang , Shilong Bao , Qingming Huang

Area under the ROC curve (AUC) optimisation techniques developed for neural networks have recently demonstrated their capabilities in different audio and speech related tasks. However, due to its intrinsic nature, AUC optimisation has…

Sound · Computer Science 2021-10-28 Pablo Gimeno , Victoria Mingote , Alfonso Ortega , Antonio Miguel , Eduardo Lleida

The Area Under the ROC Curve (AUC) is a crucial metric for machine learning, which evaluates the average performance over all possible True Positive Rates (TPRs) and False Positive Rates (FPRs). Based on the knowledge that a skillful…

Machine Learning · Computer Science 2022-06-24 Zhiyong Yang , Qianqian Xu , Shilong Bao , Yuan He , Xiaochun Cao , Qingming Huang

Receiver Operating Characteristic (ROC) curves are plots of true positive rate versus false positive rate which are useful for evaluating binary classification models, but difficult to use for learning since the Area Under the Curve (AUC)…

Machine Learning · Statistics 2021-07-06 Jonathan Hillman , Toby Dylan Hocking

Matrix factorization (MF) is extensively used to mine the user preference from explicit ratings in recommender systems. However, the reliability of explicit ratings is not always consistent, because many factors may affect the user's final…

Information Retrieval · Computer Science 2018-06-25 Zhipeng Wu , Hui Tian , Xuzhen Zhu , Shuo Wang

The predictive quality of machine learning models is typically measured in terms of their (approximate) expected prediction error or the so-called Area Under the Curve (AUC) for a particular data distribution. However, when the models are…

Machine Learning · Computer Science 2018-02-08 Hiva Ghanbari , Katya Scheinberg

The Area Under the ROC Curve (AUC) is a widely employed metric in long-tailed classification scenarios. Nevertheless, most existing methods primarily assume that training and testing examples are drawn i.i.d. from the same distribution,…

Machine Learning · Computer Science 2023-11-07 Siran Dai , Qianqian Xu , Zhiyong Yang , Xiaochun Cao , Qingming Huang

Top-k error has become a popular metric for large-scale classification benchmarks due to the inevitable semantic ambiguity among classes. Existing literature on top-k optimization generally focuses on the optimization method of the top-k…

Machine Learning · Computer Science 2024-07-11 Zitai Wang , Qianqian Xu , Zhiyong Yang , Yuan He , Xiaochun Cao , Qingming Huang

In the past decade, matrix factorization has been extensively researched and has become one of the most popular techniques for personalized recommendations. Nevertheless, the dot product adopted in matrix factorization based recommender…

Information Retrieval · Computer Science 2018-06-05 Shuai Zhang , Lina Yao , Yi Tay , Xiwei Xu , Xiang Zhang , Liming Zhu

The Area Under the ROC Curve (AUC) is a well-known metric for evaluating instance-level long-tail learning problems. In the past two decades, many AUC optimization methods have been proposed to improve model performance under long-tail…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Boyu Han , Qianqian Xu , Zhiyong Yang , Shilong Bao , Peisong Wen , Yangbangyan Jiang , Qingming Huang

The most popular classification algorithms are designed to maximize classification accuracy during training. However, this strategy may fail in the presence of class imbalance since it is possible to train models with high accuracy by…

Machine Learning · Computer Science 2024-01-26 Erhan Can Ozcan , Berk Görgülü , Mustafa G. Baydogan , Ioannis Ch. Paschalidis

Stochastic optimization of the Area Under the Precision-Recall Curve (AUPRC) is a crucial problem for machine learning. Although various algorithms have been extensively studied for AUPRC optimization, the generalization is only guaranteed…

Machine Learning · Computer Science 2022-09-28 Peisong Wen , Qianqian Xu , Zhiyong Yang , Yuan He , Qingming Huang

Receiver Operating Characteristic (ROC) curves are useful for evaluation in binary classification and changepoint detection, but difficult to use for learning since the Area Under the Curve (AUC) is piecewise constant (gradient zero almost…

Machine Learning · Computer Science 2024-10-14 Jadon Fowler , Toby Dylan Hocking

Course enrollment recommendation is a relevant task that helps university students decide what is the best combination of courses to enroll in the next term. In particular, recommender system techniques like matrix factorization and…

Computers and Society · Computer Science 2020-11-26 Nicolas Araque , Germano Rojas , Maria Vitali

AUC is an important performance measure and many algorithms have been devoted to AUC optimization, mostly by minimizing a surrogate convex loss on a training data set. In this work, we focus on one-pass AUC optimization that requires only…

Machine Learning · Computer Science 2020-07-07 Wei Gao , Rong Jin , Shenghuo Zhu , Zhi-Hua Zhou

AUC is a common metric for evaluating the performance of a classifier. However, most classifiers are trained with cross entropy, and it does not optimize the AUC metric directly, which leaves a gap between the training and evaluation stage.…

Machine Learning · Computer Science 2023-04-20 Xiao Sun , Bo Zhang , Chenrui Zhang , Han Ren , Mingchen Cai

Area under the receiver operating characteristics curve (AUC) is an important metric for a wide range of signal processing and machine learning problems, and scalable methods for optimizing AUC have recently been proposed. However, handling…

Machine Learning · Computer Science 2018-06-01 San Gultekin , Avishek Saha , Adwait Ratnaparkhi , John Paisley

Rating scales are used to elicit data about qualitative entities (e.g., research collaboration). This study presents an innovative method for reducing the number of rating scale items without the predictability loss. The "area under the…

We formulate the local ranking problem in the framework of bipartite ranking where the goal is to focus on the best instances. We propose a methodology based on the construction of real-valued scoring functions. We study empirical risk…

Statistics Theory · Mathematics 2016-08-16 Stéphan Clémençon , Nicolas Vayatis

The area under the receiver operating characteristic curve (AUC) is often used to evaluate the performance of clinical prediction models. Recently, a more refined strategy has been proposed to examine a partial area under the curve (pAUC),…

Applications · Statistics 2016-06-22 Travis Gerke , Svitlana Tyekucheva , Lorelei Mucci , Giovanni Parmigiani