English
Related papers

Related papers: Robust Feature Learning Against Noisy Labels

200 papers

In this paper, we introduced the novel concept of advisor network to address the problem of noisy labels in image classification. Deep neural networks (DNN) are prone to performance reduction and overfitting problems on training data with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Simone Ricci , Tiberio Uricchio , Alberto Del Bimbo

Imperfect labels are ubiquitous in real-world datasets and seriously harm the model performance. Several recent effective methods for handling noisy labels have two key steps: 1) dividing samples into cleanly labeled and wrongly labeled…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Wenkai Chen , Chuang Zhu , Yi Chen , Mengting Li , Tiejun Huang

The predictive performance of supervised learning algorithms depends on the quality of labels. In a typical label collection process, multiple annotators provide subjective noisy estimates of the "truth" under the influence of their varying…

Machine Learning · Computer Science 2019-06-18 Ryutaro Tanno , Ardavan Saeedi , Swami Sankaranarayanan , Daniel C. Alexander , Nathan Silberman

Improper or erroneous labelling can pose a hindrance to reliable generalization for supervised learning. This can have negative consequences, especially for critical fields such as healthcare. We propose an effective new approach for…

Machine Learning · Computer Science 2021-11-16 Konstantinos Nikolaidis , Thomas Plagemann , Stein Kristiansen , Vera Goebel , Mohan Kankanhalli

Training deep neural network (DNN) with noisy labels is practically challenging since inaccurate labels severely degrade the generalization ability of DNN. Previous efforts tend to handle part or full data in a unified denoising flow via…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Boshen Zhang , Yuxi Li , Yuanpeng Tu , Jinlong Peng , Yabiao Wang , Cunlin Wu , Yang Xiao , Cairong Zhao

This paper aims to provide understandings for the effect of an over-parameterized model, e.g. a deep neural network, memorizing instance-dependent noisy labels. We first quantify the harms caused by memorizing noisy instances, and show the…

Machine Learning · Computer Science 2021-07-14 Yang Liu

Deep learning with noisy labels is challenging as deep neural networks have the high capacity to memorize the noisy labels. In this paper, we propose a learning algorithm called Co-matching, which balances the consistency and divergence…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Yangdi Lu , Yang Bo , Wenbo He

In most practical problems of classifier learning, the training data suffers from the label noise. Hence, it is important to understand how robust is a learning algorithm to such label noise. This paper presents some theoretical analysis to…

Machine Learning · Computer Science 2016-08-29 Aritra Ghosh , Naresh Manwani , P. S. Sastry

Numerous researches have proved that deep neural networks (DNNs) can fit everything in the end even given data with noisy labels, and result in poor generalization performance. However, recent studies suggest that DNNs tend to gradually…

Machine Learning · Computer Science 2021-04-07 Hao Yang , Youzhi Jin , Ziyin Li , Deng-Bao Wang , Lei Miao , Xin Geng , Min-Ling Zhang

Deep neural networks have proven to be highly effective when large amounts of data with clean labels are available. However, their performance degrades when training data contains noisy labels, leading to poor generalization on the test…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Fahimeh Fooladgar , Minh Nguyen Nhat To , Parvin Mousavi , Purang Abolmaesumi

Recent deep neural networks (DNNs) can easily overfit to biased training data with noisy labels. Label correction strategy is commonly used to alleviate this issue by designing a method to identity suspected noisy labels and then correct…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yichen Wu , Jun Shu , Qi Xie , Qian Zhao , Deyu Meng

Continually learning in the real world must overcome many challenges, among which noisy labels are a common and inevitable issue. In this work, we present a repla-ybased continual learning framework that simultaneously addresses both…

Machine Learning · Computer Science 2021-10-18 Chris Dongjoo Kim , Jinseo Jeong , Sangwoo Moon , Gunhee Kim

Classical machine learning implicitly assumes that labels of the training data are sampled from a clean distribution, which can be too restrictive for real-world scenarios. However, statistical-learning-based methods may not train deep…

Machine Learning · Computer Science 2021-02-23 Bo Han , Quanming Yao , Tongliang Liu , Gang Niu , Ivor W. Tsang , James T. Kwok , Masashi Sugiyama

The performance of a model trained with noisy labels is often improved by simply \textit{retraining} the model with its \textit{own predicted hard labels} (i.e., 1/0 labels). Yet, a detailed theoretical characterization of this phenomenon…

Successful training of deep neural networks with noisy labels is an essential capability as most real-world datasets contain some amount of mislabeled data. Left unmitigated, label noise can sharply degrade typical supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Abel Brown , Benedikt Schifferer , Robert DiPietro

Numerous studies have shown that label noise can lead to poor generalization performance, negatively affecting classification accuracy. Therefore, understanding the effectiveness of classifiers trained using deep neural networks in the…

Machine Learning · Computer Science 2026-03-10 Haixia Liu , Boxiao Li , Can Yang , Yang Wang

The success of deep learning requires high-quality annotated and massive data. However, the size and the quality of a dataset are usually a trade-off in practice, as data collection and cleaning are expensive and time-consuming. In…

Computation and Language · Computer Science 2023-06-16 Ruibin Yuan , Hanzhi Yin , Yi Wang , Yifan He , Yushi Ye , Lei Zhang , Zhizheng Wu

Deep neural networks have been shown to be very powerful methods for many supervised learning tasks. However, they can also easily overfit to training set biases, i.e., label noise and class imbalance. While both learning with noisy labels…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Tong Wei , Jiang-Xin Shi , Yu-Feng Li , Min-Ling Zhang

Due to the existence of label noise in web images and the high memorization capacity of deep neural networks, training deep fine-grained (FG) models directly through web images tends to have an inferior recognition ability. In the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Zeren Sun , Xian-Sheng Hua , Yazhou Yao , Xiu-Shen Wei , Guosheng Hu , Jian Zhang

Distant supervision provides a means to create a large number of weakly labeled data at low cost for relation classification. However, the resulting labeled instances are very noisy, containing data with wrong labels. Many approaches have…

Computation and Language · Computer Science 2020-10-27 Zhenzhen Li , Jian-Yun Nie , Benyou Wang , Pan Du , Yuhan Zhang , Lixin Zou , Dongsheng Li