English
Related papers

Related papers: Evaluating Multi-label Classifiers with Noisy Labe…

200 papers

Falsely annotated samples, also known as noisy labels, can significantly harm the performance of deep learning models. Two main approaches for learning with noisy labels are global noise estimation and data filtering. Global noise…

Machine Learning · Computer Science 2025-07-31 Yuval Grinberg , Nimrod Harel , Jacob Goldberger , Ofir Lindenbaum

Competitive methods for multi-label classification typically invest in learning labels together. To do so in a beneficial way, analysis of label dependence is often seen as a fundamental step, separate and prior to constructing a…

Machine Learning · Statistics 2017-07-19 Jesse Read , Jaakko Hollmén

With the increasing availability of 2D and 3D data, significant advancements have been made in the field of cross-modal retrieval. Nevertheless, the existence of imperfect annotations presents considerable challenges, demanding robust…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Gui Zou , Chaofan Gan , Chern Hong Lim , Supavadee Aramvith , Weiyao Lin

Noisy training labels can hurt model performance. Most approaches that aim to address label noise assume label noise is independent from the input features. In practice, however, label noise is often feature or \textit{instance-dependent},…

Machine Learning · Computer Science 2023-07-12 Donna Tjandra , Jenna Wiens

Complementary-label learning (CLL) is a weakly-supervised learning paradigm that aims to train a multi-class classifier using only complementary labels, which indicate classes to which an instance does not belong. Despite numerous…

Machine Learning · Computer Science 2025-06-17 Hsiu-Hsuan Wang , Tan-Ha Mai , Nai-Xuan Ye , Wei-I Lin , Hsuan-Tien Lin

Meta-learning is an effective method to handle imbalanced and noisy-label learning, but it depends on a validation set containing randomly selected, manually labelled and balanced distributed samples. The random selection and manual…

Machine Learning · Computer Science 2025-10-09 Dung Anh Hoang , Cuong Nguyen , Belagiannis Vasileios , Thanh-Toan Do , Gustavo Carneiro

The monotonic ordinal classification has increased the interest of researchers and practitioners within machine learning community in the last years. In real applications, the problems with monotonicity constraints are very frequent. To…

Artificial Intelligence · Computer Science 2018-10-23 José-Ramón Cano , Julián Luengo , Salvador García

In many real-world classification problems, the labels of training examples are randomly corrupted. Most previous theoretical work on classification with label noise assumes that the two classes are separable, that the label noise is…

Machine Learning · Statistics 2016-08-08 Gilles Blanchard , Marek Flaska , Gregory Handy , Sara Pozzi , Clayton Scott

Deep learning has shown remarkable success in medical image analysis, but its reliance on large volumes of high-quality labeled data limits its applicability. While noisy labeled data are easier to obtain, directly incorporating them into…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Chengxuan Qian , Kai Han , Jianxia Ding , Chongwen Lyu , Zhenlong Yuan , Jun Chen , Zhe Liu

The field of Weakly Supervised Learning (WSL) has recently seen a surge of popularity, with numerous papers addressing different types of "supervision deficiencies", namely: poor quality, non adaptability, and insufficient quantity of…

Machine Learning · Computer Science 2021-09-28 Pierre Nodet , Vincent Lemaire , Alexis Bondu , Antoine Cornuéjols

Class imbalance is an inherent characteristic of multi-label data that hinders most multi-label learning methods. One efficient and flexible strategy to deal with this problem is to employ sampling techniques before training a multi-label…

Machine Learning · Computer Science 2020-05-20 Bin Liu , Konstantinos Blekas , Grigorios Tsoumakas

For high-resource languages like English, text classification is a well-studied task. The performance of modern NLP models easily achieves an accuracy of more than 90% in many standard datasets for text classification in English (Xie et…

Computation and Language · Computer Science 2022-06-06 Dawei Zhu , Michael A. Hedderich , Fangzhou Zhai , David Ifeoluwa Adelani , Dietrich Klakow

Label noise is increasingly prevalent in datasets acquired from noisy channels. Existing approaches that detect and remove label noise generally rely on some form of supervision, which is not scalable and error-prone. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Karishma Sharma , Pinar Donmez , Enming Luo , Yan Liu , I. Zeki Yalniz

Class imbalance and label noise are pervasive in large-scale datasets, yet much of machine learning research assumes well-labeled, balanced data, which rarely reflects real world conditions. Existing approaches typically address either…

Machine Learning · Computer Science 2025-01-16 John Brandon Graham-Knight , Jamil Fayyad , Nourhan Bayasi , Patricia Lasserre , Homayoun Najjaran

Multi-label classification (MLC) has recently received increasing interest from the machine learning community. Several studies provide reviews of methods and datasets for MLC and a few provide empirical comparisons of MLC methods. However,…

Machine Learning · Computer Science 2021-02-17 Jasmin Bogatinovski , Ljupčo Todorovski , Sašo Džeroski , Dragi Kocev

Deep neural networks need large amounts of labeled data to achieve good performance. In real-world applications, labels are usually collected from non-experts such as crowdsourcing to save cost and thus are noisy. In the past few years,…

Machine Learning · Computer Science 2021-06-18 Xian-Jin Gui , Wei Wang , Zhang-Hao Tian

We explore contemporary robust classification algorithms for overcoming class-dependant labelling noise: Forward, Importance Re-weighting and T-revision. The classifiers are trained and evaluated on class-conditional random label noise data…

Machine Learning · Computer Science 2021-06-02 Alex Díaz , Damian Steele

Training a deep neural network with noisy labels could reduce data annotation cost but may introduce noise into the learned model. In meta label correction approaches, an additional meta model besides the main model is trained with a small,…

Machine Learning · Computer Science 2026-05-19 Ba Hoang Anh Nguyen , Viet Cuong Ta

The success of current deep saliency detection methods heavily depends on the availability of large-scale supervision in the form of per-pixel labeling. Such supervision, while labor-intensive and not always possible, tends to hinder the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Jing Zhang , Tong Zhang , Yuchao Dai , Mehrtash Harandi , Richard Hartley

Learning against label noise is a vital topic to guarantee a reliable performance for deep neural networks. Recent research usually refers to dynamic noise modeling with model output probabilities and loss values, and then separates clean…

Machine Learning · Statistics 2022-07-13 Yingsong Huang , Bing Bai , Shengwei Zhao , Kun Bai , Fei Wang