English
Related papers

Related papers: Bending the Curve: Improving the ROC Curve Through…

200 papers

Unsupervised models can provide supplementary soft constraints to help classify new, "target" data since similar instances in the target set are more likely to share the same class label. Such models can also help detect possible…

Machine Learning · Computer Science 2012-06-06 Ayan Acharya , Eduardo R. Hruschka , Joydeep Ghosh , Sreangsu Acharyya

Corrupted labels and class imbalance are commonly encountered in practically collected training data, which easily leads to over-fitting of deep neural networks (DNNs). Existing approaches alleviate these issues by adopting a sample…

Machine Learning · Computer Science 2022-01-05 Shenwang Jiang , Jianan Li , Ying Wang , Bo Huang , Zhang Zhang , Tingfa Xu

This paper presents a new approach to identifying and eliminating mislabeled training instances for supervised learning. The goal of this approach is to improve classification accuracies produced by learning algorithms by improving the…

Artificial Intelligence · Computer Science 2011-06-02 C. E. Brodley , M. A. Friedl

Machine learning actively impacts our everyday life in almost all endeavors and domains such as healthcare, finance, and energy. As our dependence on the machine learning increases, it is inevitable that these algorithms will be used to…

Machine Learning · Computer Science 2021-02-23 Ankit Kulshrestha , Ilya Safro

Imbalanced data pose challenges for deep learning based classification models. One of the most widely-used approaches for tackling imbalanced data is re-weighting, where training samples are associated with different weights in the loss…

Machine Learning · Computer Science 2022-08-08 Dandan Guo , Zhuo Li , Meixi Zheng , He Zhao , Mingyuan Zhou , Hongyuan Zha

It is becoming increasingly common in regression to train neural networks that model the entire distribution even if only the mean is required for prediction. This additional modeling often comes with performance gain and the reasons behind…

Machine Learning · Computer Science 2024-10-22 Ehsan Imani , Kai Luedemann , Sam Scholnick-Hughes , Esraa Elelimy , Martha White

A fundamental limitation of applying semi-supervised learning in real-world settings is the assumption that unlabeled test data contains only classes previously encountered in the labeled training data. However, this assumption rarely holds…

Machine Learning · Computer Science 2022-01-27 Kaidi Cao , Maria Brbic , Jure Leskovec

Following the wide-spread adoption of machine learning models in real-world applications, the phenomenon of performativity, i.e. model-dependent shifts in the test distribution, becomes increasingly prevalent. Unfortunately, since models…

Machine Learning · Statistics 2026-01-21 Ivan Kirev , Lyuben Baltadzhiev , Nikola Konstantinov

In imbalanced multi-class classification problems, the misclassification rate as an error measure may not be a relevant choice. Several methods have been developed where the performance measure retained richer information than the mere…

Machine Learning · Computer Science 2013-11-05 Sokol Koço , Cécile Capponi

The receiver operating characteristic (ROC) curve is a powerful statistical tool and has been widely applied in medical research. In the ROC curve estimation, a commonly used assumption is that larger the biomarker value, greater severity…

Methodology · Statistics 2023-02-24 Dingding Hu , Meng Yuan , Tao Yu , Pengfei Li

The classification of imbalanced data has presented a significant challenge for most well-known classification algorithms that were often designed for data with relatively balanced class distributions. Nevertheless skewed class distribution…

Machine Learning · Statistics 2023-04-21 Jiaju Miao , Wei Zhu

Clustering consists of grouping together samples giving their similar properties. The problem of modeling simultaneously groups of samples and features is known as Co-Clustering. This paper introduces ROCCO - a Robust Continuous…

Machine Learning · Computer Science 2018-02-15 Xiao He , Luis Moreira-Matias

The pervasive issue of bias in AI presents a significant challenge to painting classification, and is getting more serious as these systems become increasingly integrated into tasks like art curation and restoration. Biases, often arising…

Artificial Intelligence · Computer Science 2025-07-11 Mridula Vijendran , Shuang Chen , Jingjing Deng , Hubert P. H. Shum

In many large-scale classification problems, classes are organized in a known hierarchy, typically represented as a tree expressing the inclusion of classes in superclasses. We introduce a loss for this type of supervised hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Nicolas Urbani , Sylvain Rousseau , Yves Grandvalet , Leonardo Tanzi

Meta-reinforcement learning algorithms provide a data-driven way to acquire policies that quickly adapt to many tasks with varying rewards or dynamics functions. However, learned meta-policies are often effective only on the exact task…

Machine Learning · Computer Science 2023-07-13 Anurag Ajay , Abhishek Gupta , Dibya Ghosh , Sergey Levine , Pulkit Agrawal

As large language models have evolved, it has become crucial to distinguish between process supervision and outcome supervision -- two key reinforcement learning approaches to complex reasoning tasks. While process supervision offers…

Machine Learning · Computer Science 2025-03-28 Zeyu Jia , Alexander Rakhlin , Tengyang Xie

Learning to optimize - the idea that we can learn from data algorithms that optimize a numerical criterion - has recently been at the heart of a growing number of research efforts. One of the most challenging issues within this approach is…

Machine Learning · Computer Science 2018-02-21 Louis Faury , Flavian Vasile

A reliable deep learning system should be able to accurately express its confidence with respect to its predictions, a quality known as calibration. One of the most effective ways to produce reliable confidence estimates with a pre-trained…

Machine Learning · Computer Science 2024-10-10 Thomas P. Zollo , Zhun Deng , Jake C. Snell , Toniann Pitassi , Richard Zemel

The ROC curve is widely used to assess binary classifiers. Yet for some applications, such as alert systems for monitoring hospitalized patients, conventional ROC analysis cannot meet two key deployment needs: enforcing a constraint on…

Machine Learning · Computer Science 2026-04-03 Christopher Ratigan , Kyle Heuton , Carissa Wang , Lenore Cowen , Michael C. Hughes

The Receiver Operating Characteristic (ROC) is a well-established representation of the tradeoff between detection and false alarm probabilities in binary hypothesis testing. In many practical contexts ROC's are generated by thresholding a…

Statistics Theory · Mathematics 2020-12-16 Catherine Medlock , Alan Oppenheim