中文
相关论文

相关论文: Deep Learning is Robust to Massive Label Noise

200 篇论文

Deep learning has achieved excellent performance in various computer vision tasks, but requires a lot of training examples with clean labels. It is easy to collect a dataset with noisy labels, but such noise makes networks overfit seriously…

计算机视觉与模式识别 · 计算机科学 2022-02-18 Kun Yi , Guo-Hua Wang , Jianxin Wu

Recent studies on the memorization effects of deep neural networks on noisy labels show that the networks first fit the correctly-labeled training samples before memorizing the mislabeled samples. Motivated by this early-learning…

机器学习 · 计算机科学 2021-09-07 Yangdi Lu , Yang Bo , Wenbo He

Large-scale datasets have driven the rapid development of deep neural networks for visual recognition. However, annotating a massive dataset is expensive and time-consuming. Web images and their labels are, in comparison, much easier to…

计算机视觉与模式识别 · 计算机科学 2016-12-01 Bohan Zhuang , Lingqiao Liu , Yao Li , Chunhua Shen , Ian Reid

Deep neural networks (DNNs) have achieved remarkable success across diverse domains, but their performance can be severely degraded by noisy or corrupted training data. Conventional noise mitigation methods often rely on explicit…

机器学习 · 计算机科学 2025-06-16 Deliang Jin , Gang Chen , Shuo Feng , Yufeng Ling , Haoran Zhu

Deep neural networks tend to memorize noisy labels, severely degrading their generalization performance. Although Mixup has demonstrated effectiveness in improving generalization and robustness, existing Mixup-based methods typically…

机器学习 · 计算机科学 2025-09-16 Qiuhao Liu , Ling Li , Yao Lu , Qi Xuan , Zhaowei Zhu , Jiaheng Wei

Given data with label noise (i.e., incorrect data), deep neural networks would gradually memorize the label noise and impair model performance. To relieve this issue, curriculum learning is proposed to improve model performance and…

机器学习 · 计算机科学 2022-08-23 Tingting Wu , Xiao Ding , Hao Zhang , Jinglong Gao , Li Du , Bing Qin , Ting Liu

Deep neural networks can memorize corrupted labels, making data quality critical for model performance, yet real-world datasets are frequently compromised by both label noise and input noise. This paper proposes a mutual information-based…

机器学习 · 计算机科学 2025-08-12 Jinghan Yang , Jiayu Weng

In supervised machine learning, use of correct labels is extremely important to ensure high accuracy. Unfortunately, most datasets contain corrupted labels. Machine learning models trained on such datasets do not generalize well. Thus,…

机器学习 · 计算机科学 2023-09-14 Chang Yue , Niraj K. Jha

Training deep neural network (DNN) with noisy labels is practically challenging since inaccurate labels severely degrade the generalization ability of DNN. Previous efforts tend to handle part or full data in a unified denoising flow via…

计算机视觉与模式识别 · 计算机科学 2022-08-24 Boshen Zhang , Yuxi Li , Yuanpeng Tu , Jinlong Peng , Yabiao Wang , Cunlin Wu , Yang Xiao , Cairong Zhao

Optimizing neural networks with noisy labels is a challenging task, especially if the label set contains real-world noise. Networks tend to generalize to reasonable patterns in the early training stages and overfit to specific details of…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Timo Kaiser , Lukas Ehmann , Christoph Reinders , Bodo Rosenhahn

We introduce a novel method to combat label noise when training deep neural networks for classification. We propose a loss function that permits abstention during training thereby allowing the DNN to abstain on confusing samples while…

Imperfect labels are ubiquitous in real-world datasets. Several recent successful methods for training deep neural networks (DNNs) robust to label noise have used two primary techniques: filtering samples based on loss during a warm-up…

计算机视觉与模式识别 · 计算机科学 2021-04-05 Kento Nishi , Yi Ding , Alex Rich , Tobias Höllerer

Large-scale datasets possessing clean label annotations are crucial for training Convolutional Neural Networks (CNNs). However, labeling large-scale data can be very costly and error-prone, and even high-quality datasets are likely to…

计算机视觉与模式识别 · 计算机科学 2018-04-03 Yisen Wang , Weiyang Liu , Xingjun Ma , James Bailey , Hongyuan Zha , Le Song , Shu-Tao Xia

There are inevitably many mislabeled data in real-world datasets. Because deep neural networks (DNNs) have an enormous capacity to memorize noisy labels, a robust training scheme is required to prevent labeling errors from degrading the…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Jun Ho Lee , Jae Soon Baik , Tae Hwan Hwang , Jun Won Choi

The major driving force behind the immense success of deep learning models is the availability of large datasets along with their clean labels. Unfortunately, this is very difficult to obtain, which has motivated research on the training of…

计算机视觉与模式识别 · 计算机科学 2020-01-03 Devraj Mandal , Shrisha Bharadwaj , Soma Biswas

It is crucial to distinguish mislabeled samples for dealing with noisy labels. Previous methods such as Coteaching and JoCoR introduce two different networks to select clean samples out of the noisy ones and only use these clean ones to…

计算机视觉与模式识别 · 计算机科学 2021-03-26 Rumeng Yi , Yaping Huang

The task of labeling data for training deep neural networks is daunting and tedious, requiring millions of labels to achieve the current state-of-the-art results. Such reliance on large amounts of labeled data can be relaxed by exploiting…

机器学习 · 计算机科学 2016-02-17 Aysegul Dundar , Jonghoon Jin , Eugenio Culurciello

Constructing fine-grained image datasets typically requires domain-specific expert knowledge, which is not always available for crowd-sourcing platform annotators. Accordingly, learning directly from web images becomes an alternative method…

计算机视觉与模式识别 · 计算机科学 2020-08-07 Chuanyi Zhang , Yazhou Yao , Xiangbo Shu , Zechao Li , Zhenmin Tang , Qi Wu

Class imbalance and noisy labels are the norm rather than the exception in many large-scale classification datasets. Nevertheless, most works in machine learning typically assume balanced and clean data. There have been some recent attempts…

计算机视觉与模式识别 · 计算机科学 2021-09-14 Shyamgopal Karthik , Jérome Revaud , Boris Chidlovskii

Training deep neural networks (DNNs) under weak supervision has attracted increasing research attention as it can significantly reduce the annotation cost. However, labels from weak supervision can be noisy, and the high capacity of DNNs…

计算与语言 · 计算机科学 2023-05-02 Dawei Zhu , Xiaoyu Shen , Michael A. Hedderich , Dietrich Klakow