English
Related papers

Related papers: LongReMix: Robust Learning with High Confidence Sa…

200 papers

Modern deep networks can be better generalized when trained with noisy samples and regularization techniques. Mixup and CutMix have been proven to be effective for data augmentation to help avoid overfitting. Previous Mixup-based methods…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Shuyang Sun , Jie-Neng Chen , Ruifei He , Alan Yuille , Philip Torr , Song Bai

Label Ranking (LR) corresponds to the problem of learning a hypothesis that maps features to rankings over a finite set of labels. We adopt a nonparametric regression approach to LR and obtain theoretical performance guarantees for this…

Machine Learning · Computer Science 2022-02-11 Dimitris Fotakis , Alkis Kalavasis , Eleni Psaroudaki

Learning from noisy labels is a challenge that arises in many real-world applications where training data can contain incorrect or corrupted labels. When fine-tuning language models with noisy labels, models can easily overfit the label…

Computation and Language · Computer Science 2023-06-14 Yuchen Zhuang , Yue Yu , Lingkai Kong , Xiang Chen , Chao Zhang

Training neural network classifiers on datasets contaminated with noisy labels significantly increases the risk of overfitting. Thus, effectively implementing Early Stopping in noisy label environments is crucial. Under ideal circumstances,…

Machine Learning · Computer Science 2024-09-12 William Toner , Amos Storkey

Modern deep learning systems are data-hungry. Learning with web data is one of the feasible solutions, but will introduce label noise inevitably, which can hinder the performance of deep neural networks. Sample selection is an effective way…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Chao Liang , Linchao Zhu , Humphrey Shi , Yi Yang

Numerous researches have proved that deep neural networks (DNNs) can fit everything in the end even given data with noisy labels, and result in poor generalization performance. However, recent studies suggest that DNNs tend to gradually…

Machine Learning · Computer Science 2021-04-07 Hao Yang , Youzhi Jin , Ziyin Li , Deng-Bao Wang , Lei Miao , Xin Geng , Min-Ling Zhang

In deep learning (DL) systems, label noise in training datasets often degrades model performance, as models may learn incorrect patterns from mislabeled data. The area of Learning with Noisy Labels (LNL) has introduced methods to…

Machine Learning · Computer Science 2024-12-03 Gordon Lim , Stefan Larson , Kevin Leach

Computer vision systems recently made a big leap thanks to deep neural networks. However, these systems require correctly labeled large datasets in order to be trained properly, which is very difficult to obtain for medical applications.…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Görkem Algan , Ilkay Ulusoy , Şaban Gönül , Banu Turgut , Berker Bakbak

Noisy labels are inevitable in real-world scenarios. Due to the strong capacity of deep neural networks to memorize corrupted labels, these noisy labels can cause significant performance degradation. Existing research on mitigating the…

Machine Learning · Computer Science 2025-10-02 Xinlei Zhang , Fan Liu , Chuanyi Zhang , Fan Cheng , Yuhui Zheng

Federated learning with noisy labels (F-LNL) aims at seeking an optimal server model via collaborative distributed learning by aggregating multiple client models trained with local noisy or clean samples. On the basis of a federated…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Jichang Li , Guanbin Li , Hui Cheng , Zicheng Liao , Yizhou Yu

Label noise is common in large real-world datasets, and its presence harms the training process of deep neural networks. Although several works have focused on the training strategies to address this problem, there are few studies that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Emeson Santana , Gustavo Carneiro , Filipe R. Cordeiro

Robustness to label noise within data is a significant challenge in federated learning (FL). From the data-centric perspective, the data quality of distributed datasets can not be guaranteed since annotations of different clients contain…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Xuefeng Jiang , Jia Li , Nannan Wu , Zhiyuan Wu , Xujing Li , Sheng Sun , Gang Xu , Yuwei Wang , Qi Li , Min Liu

Parameter-efficient fine-tuning (PEFT) large language models (LLMs) have shown impressive performance in various downstream tasks. However, in many real-world scenarios, the collected training data inevitably contains noisy labels. To learn…

Computation and Language · Computer Science 2025-10-14 Bo Yuan , Yulin Chen , Yin Zhang

Deep learning models rely heavily on large volumes of labeled data to achieve high performance. However, real-world datasets often contain noisy labels due to human error, ambiguity, or resource constraints during the annotation process.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Gouranga Bala , Anuj Gupta , Subrat Kumar Behera , Amit Sethi

Sample selection is a prevalent method in learning with noisy labels, where small-loss data are typically considered as correctly labeled data. However, this method may not effectively identify clean hard examples with large losses, which…

Machine Learning · Computer Science 2023-08-29 Suqin Yuan , Lei Feng , Tongliang Liu

Noisy labels are very common in real-world training data, which lead to poor generalization on test data because of overfitting to the noisy labels. In this paper, we claim that such overfitting can be avoided by "early stopping" training a…

Machine Learning · Computer Science 2020-09-09 Hwanjun Song , Minseok Kim , Dongmin Park , Jae-Gil Lee

Continually learning in the real world must overcome many challenges, among which noisy labels are a common and inevitable issue. In this work, we present a repla-ybased continual learning framework that simultaneously addresses both…

Machine Learning · Computer Science 2021-10-18 Chris Dongjoo Kim , Jinseo Jeong , Sangwoo Moon , Gunhee Kim

In this paper, we address the problem of effectively self-training neural networks in a low-resource setting. Self-training is frequently used to automatically increase the amount of training data. However, in a low-resource scenario, it is…

Computation and Language · Computer Science 2019-04-03 Debjit Paul , Mittul Singh , Michael A. Hedderich , Dietrich Klakow

Noisy labels are a pervasive challenge in medical image classification, where annotation errors arise from inter-observer variability and diagnostic ambiguity. Although several noise-robust learning methods have been proposed, their…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Maycon R. S. Pereira , Filipe R. Cordeiro

Deep neural networks (DNNs) have achieved great success in a wide variety of medical image analysis tasks. However, these achievements indispensably rely on the accurately-annotated datasets. If with the noisy-labeled images, the training…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Cheng Xue , Qi Dou , Xueying Shi , Hao Chen , Pheng Ann Heng