English
Related papers

Related papers: Ghost Loss to Question the Reliability of Training…

200 papers

Because deep learning is vulnerable to noisy labels, sample selection techniques, which train networks with only clean labeled data, have attracted a great attention. However, if the labels are dominantly corrupted by few classes, these…

Machine Learning · Computer Science 2021-07-16 Kyeongbo Kong , Junggi Lee , Youngchul Kwak , Young-Rae Cho , Seong-Eun Kim , Woo-Jin Song

Noisy labels are ubiquitous in real-world datasets, especially in the large-scale ones derived from crowdsourcing and web searching. It is challenging to train deep neural networks with noisy datasets since the networks are prone to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Yangdi Lu , Wenbo He

Deep neural networks may easily memorize noisy labels present in real-world data, which degrades their ability to generalize. It is therefore important to track and evaluate the robustness of models against noisy label memorization. We…

Machine Learning · Computer Science 2022-12-09 Mahsa Forouzesh , Hanie Sedghi , Patrick Thiran

Noisy labels are ubiquitous in real-world datasets, which poses a challenge for robustly training deep neural networks (DNNs) as DNNs usually have the high capacity to memorize the noisy labels. In this paper, we find that the test accuracy…

Machine Learning · Computer Science 2019-05-14 Pengfei Chen , Benben Liao , Guangyong Chen , Shengyu Zhang

The enormous demand for annotated data brought forth by deep learning techniques has been accompanied by the problem of annotation noise. Although this issue has been widely discussed in machine learning literature, it has been relatively…

Machine Learning · Computer Science 2023-08-10 Soumadeep Saha , Utpal Garain , Arijit Ukil , Arpan Pal , Sundeep Khandelwal

Label noise, which refers to the mislabeling of instances in a dataset, can significantly impair classifier performance, increase model complexity, and affect feature selection. While most research has concentrated on deep neural networks…

Machine Learning · Computer Science 2025-01-07 Anita Eisenbürger , Daniel Otten , Anselm Hudde , Frank Hopfgartner

Semi-Supervised Learning (SSL) is important for reducing the annotation cost for medical image segmentation models. State-of-the-art SSL methods such as Mean Teacher, FixMatch and Cross Pseudo Supervision (CPS) are mainly based on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Weiren Zhao , Lanfeng Zhong , Xin Liao , Wenjun Liao , Sichuan Zhang , Shaoting Zhang , Guotai Wang

We propose a novel loss function that dynamically rescales the cross entropy based on prediction difficulty regarding a sample. Deep neural network architectures in image classification tasks struggle to disambiguate visually similar…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Serim Ryou , Seong-Gyun Jeong , Pietro Perona

In supervised machine learning, use of correct labels is extremely important to ensure high accuracy. Unfortunately, most datasets contain corrupted labels. Machine learning models trained on such datasets do not generalize well. Thus,…

Machine Learning · Computer Science 2023-09-14 Chang Yue , Niraj K. Jha

Training deep neural networks is challenging when large and annotated datasets are unavailable. Extensive manual annotation of data samples is time-consuming, expensive, and error-prone, notably when it needs to be done by experts. To…

Machine Learning · Computer Science 2021-09-08 Barbara C Benato , Alexandru C Telea , Alexandre X Falcão

The problem of fully supervised classification is that it requires a tremendous amount of annotated data, however, in many datasets a large portion of data is unlabeled. To alleviate this problem semi-supervised learning (SSL) leverages the…

Machine Learning · Computer Science 2022-07-26 Ehsan Kazemi

Robustness to label noise is a critical property for weakly-supervised classifiers trained on massive datasets. Robustness to label noise is a critical property for weakly-supervised classifiers trained on massive datasets. In this paper,…

Machine Learning · Computer Science 2020-07-14 Amirmasoud Ghiassi , Taraneh Younesian , Robert Birke , Lydia Y. Chen

In this work, we for the first time present a method for detecting label errors in image datasets with semantic segmentation, i.e., pixel-wise class labels. Annotation acquisition for semantic segmentation datasets is time-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Matthias Rottmann , Marco Reese

Recent years have seen increasing use of supervised learning methods for segmentation tasks. However, the predictive performance of these algorithms depends on the quality of labels. This problem is particularly pertinent in the medical…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Le Zhang , Ryutaro Tanno , Mou-Cheng Xu , Chen Jin , Joseph Jacob , Olga Ciccarelli , Frederik Barkhof , Daniel C. Alexander

Deep Neural Networks (DNNs) provide state-of-the-art solutions in several difficult machine perceptual tasks. However, their performance relies on the availability of a large set of labeled training data, which limits the breadth of their…

Machine Learning · Computer Science 2018-03-01 Randall Balestriero , Herve Glotin , Richard Baraniuk

We present a theoretically grounded approach to train deep neural networks, including recurrent networks, subject to class-dependent label noise. We propose two procedures for loss correction that are agnostic to both application domain and…

Machine Learning · Statistics 2017-03-23 Giorgio Patrini , Alessandro Rozza , Aditya Menon , Richard Nock , Lizhen Qu

Noisy labels are very common in deep supervised learning. Although many studies tend to improve the robustness of deep training for noisy labels, rare works focus on theoretically explaining the training behaviors of learning with noisily…

Machine Learning · Computer Science 2021-04-12 Yi Xu , Qi Qian , Hao Li , Rong Jin

Collecting large-scale datasets is crucial for training deep models, annotating the data, however, inevitably yields noisy labels, which poses challenges to deep learning algorithms. Previous efforts tend to mitigate this problem via…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Yuanpeng Tu , Boshen Zhang , Yuxi Li , Liang Liu , Jian Li , Jiangning Zhang , Yabiao Wang , Chengjie Wang , Cai Rong Zhao

Deep neural networks (DNNs) fail to learn effectively under label noise and have been shown to memorize random labels which affect their generalization performance. We consider learning in isolation, using one-hot encoded labels as the sole…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

Existing shadow detection datasets often contain missing or mislabeled shadows, which can hinder the performance of deep learning models trained directly on such data. To address this issue, we propose SILT, the Shadow-aware Iterative Label…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Han Yang , Tianyu Wang , Xiaowei Hu , Chi-Wing Fu