English
Related papers

Related papers: A Multiclass ROC Curve

200 papers

In this paper, we draw attention to a promising yet slightly underestimated measure of variability - the Gini coefficient. We describe two new ways of defining and interpreting this parameter. Using our new representations, we compute the…

Statistics Theory · Mathematics 2022-10-13 Marta Milewska , Remco van der Hofstad , Bert Zwart

In the paper, we derive an analytic formula for the ROC curves of the LDA classifiers. We establish elementary properties of these curves (monotonicity and concavity), provide formula for the area under curve (AUC) and compute the Youden…

Statistics Theory · Mathematics 2025-08-26 Mateusz Krukowski

Receiver operating characteristic (ROC) analysis is one of the most popular approaches for evaluating and comparing the accuracy of medical diagnostic tests. Although various methodologies have been developed for estimating ROC curves and…

Methodology · Statistics 2022-08-16 Ainesh Sewak , Torsten Hothorn

The ROC curve is a statistical tool that analyses the accuracy of a diagnostic test in which a variable is used to decide whether an individual is healthy or not. Along with that diagnostic variable it is usual to have information of some…

The area under the ROC curve is widely used as a measure of performance of classification rules. However, it has recently been shown that the measure is fundamentally incoherent, in the sense that it treats the relative severities of…

Methodology · Statistics 2013-08-02 David J. Hand , Christoforos Anagnostopoulos

A plethora of research has been done in the past focusing on predicting student's performance in order to support their development. Many institutions are focused on improving the performance and the education quality; and this can be…

Computers and Society · Computer Science 2020-05-15 MohammadNoor Injadat , Abdallah Moubayed , Ali Bou Nassif , Abdallah Shami

Multi-dimensional classification (MDC) is the supervised learning problem where an instance is associated with multiple classes, rather than with a single class, as in traditional classification problems. Since these classes are often…

Machine Learning · Computer Science 2014-05-20 Jesse Read , Luca Martino , David Luengo

Fifth generation (5G) radio access technology (RAT) is expected to flexibly serve multiple services with extremely diverse requirements. One of the steps taken toward fulfilling this vision of the 5G-RAT is an introduction of the…

Signal Processing · Electrical Eng. & Systems 2019-05-31 Abuu B. Kihero , Muhammad Sohaib J. Solaija , Huseyin Arslan

The ROC curve is widely used to assess the quality of prediction/classification/ranking algorithms, and its properties have been extensively studied. The precision-recall (PR) curve has become the de facto replacement for the ROC curve in…

Machine Learning · Statistics 2018-10-23 Jacqueline M. Hughes-Oliver

Classification problems are essential statistical tasks that form the foundation of decision-making across various fields, including patient prognosis and treatment strategies for critical conditions. Consequently, evaluating the…

Methodology · Statistics 2025-03-11 Jun Tamura , Yuki Itaya , Kenichi Hayashi , Kouji Yamamoto

We propose an extension of the univariate Lorenz curve and of the Gini coefficient to the multivariate case, i.e., to simultaneously measure inequality in more than one variable. Our extensions are based on copulas and measure inequality…

Methodology · Statistics 2022-04-25 Oliver Grothe , Fabian Kächele , Friedrich Schmid

In classifier (or regression) fusion the aim is to combine the outputs of several algorithms to boost overall performance. Standard supervised fusion algorithms often require accurate and precise training labels. However, accurate labels…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Xiaoxiao Du , Alina Zare

Qini curves have emerged as an attractive and popular approach for evaluating the benefit of data-driven targeting rules for treatment allocation. We propose a generalization of the Qini curve to multiple costly treatment arms, that…

Methodology · Statistics 2025-09-22 Erik Sverdrup , Han Wu , Susan Athey , Stefan Wager

We propose a general formulation, called Multi-X, for multi-class multi-instance model fitting - the problem of interpreting the input data as a mixture of noisy observations originating from multiple instances of multiple classes. We…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Daniel Barath , Jiri Matas

Self-attention transformers have demonstrated accuracy for image classification with smaller data sets. However, a limitation is that tests to-date are based upon single class image detection with known representation of image populations.…

Machine Learning · Computer Science 2026-03-25 Veronica Wendt , Jacob Steiner , Byunggu Yu , Caleb Kelly , Justin Kim

Many applications of AI involve scoring individuals using a learned function of their attributes. These predictive risk scores are then used to take decisions based on whether the score exceeds a certain threshold, which may vary depending…

Machine Learning · Statistics 2021-02-26 Robin Vogel , Aurélien Bellet , Stephan Clémençon

Multiclass classification (MCC) is a fundamental machine learning problem of classifying each instance into one of a predefined set of classes. In the deep learning era, extensive efforts have been spent on developing more powerful neural…

Machine Learning · Computer Science 2022-12-22 Nan Wang , Zhen Qin , Le Yan , Honglei Zhuang , Xuanhui Wang , Michael Bendersky , Marc Najork

The empirical likelihood is a powerful nonparametric tool, that emulates its parametric counterpart -- the parametric likelihood -- preserving many of its large-sample properties. This article tackles the problem of assessing the…

Methodology · Statistics 2023-05-29 Duc-Khanh To , Gianfranco Adimari , Monica Chiogna

The Receiver Operating Characteristic (ROC) curve of a binary classifier has often been utilized to measure the performance of the classifier. The area beneath this curve is used in particular because of its quoted probabilistic…

Machine Learning · Computer Science 2026-05-05 Steven Redolfi

This paper tackles the challenge of performing multiple quantile regressions across different quantile levels and the associated problem of controlling the familywise error rate, an issue that is generally overlooked in practice. We propose…

Methodology · Statistics 2026-04-10 Riccardo De Santis , Anna Vesely , Angela Andreella