English
Related papers

Related papers: Learning from Noisy Labels with Distillation

200 papers

Large-scale datasets possessing clean label annotations are crucial for training Convolutional Neural Networks (CNNs). However, labeling large-scale data can be very costly and error-prone, and even high-quality datasets are likely to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Yisen Wang , Weiyang Liu , Xingjun Ma , James Bailey , Hongyuan Zha , Le Song , Shu-Tao Xia

Semantic noise in image classification datasets, where visually similar categories are frequently mislabeled, poses a significant challenge to conventional supervised learning approaches. In this paper, we explore the potential of using…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Yingxuan Li , Jiafeng Mao , Yusuke Matsui

Deep neural networks trained with standard cross-entropy loss are more prone to memorize noisy labels, which degrades their performance. Negative learning using complementary labels is more robust when noisy labels intervene but with an…

Machine Learning · Computer Science 2022-09-07 Chen-Chen Zong , Zheng-Tao Cao , Hong-Tao Guo , Yun Du , Ming-Kun Xie , Shao-Yuan Li , Sheng-Jun Huang

Unravelling hidden patterns in datasets is a classical problem with many potential applications. In this paper, we present a challenge whose objective is to discover nonlinear relationships in noisy cloud of points. If a set of point…

Machine Learning · Statistics 2018-05-31 Terry Lyons , Imanol Perez Arribas

Multi-label image classification has generated significant interest in recent years and the performance of such systems often suffers from the not so infrequent occurrence of incorrect or missing labels in the training data. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Zhuolin Jiang , Jan Silovsky , Man-Hung Siu , William Hartmann , Herbert Gish , Sancar Adali

Learning with noisy labels (LNL) aims at designing strategies to improve model performance and generalization by mitigating the effects of model overfitting to noisy labels. The key success of LNL lies in identifying as many clean samples…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Jichang Li , Guanbin Li , Feng Liu , Yizhou Yu

With the widespread use of machine learning for classification, it becomes increasingly important to be able to use weaker kinds of supervision for tasks in which it is hard to obtain standard labeled data. One such kind of supervision is…

Machine Learning · Computer Science 2020-02-05 Soham Dan , Han Bao , Masashi Sugiyama

Learning with noisy labels has aroused much research interest since data annotations, especially for large-scale datasets, may be inevitably imperfect. Recent approaches resort to a semi-supervised learning problem by dividing training…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Kai Wang , Xiangyu Peng , Shuo Yang , Jianfei Yang , Zheng Zhu , Xinchao Wang , Yang You

Either human annotation or rule based automatic labeling is an effective method to augment data for relation extraction. However, the inevitable wrong labeling problem for example by distant supervision may deteriorate the performance of…

Computation and Language · Computer Science 2020-04-30 Shanchan Wu , Kai Fan

Large datasets often have unreliable labels-such as those obtained from Amazon's Mechanical Turk or social media platforms-and classifiers trained on mislabeled datasets often exhibit poor performance. We present a simple, effective…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Ishan Jindal , Matthew Nokleby , Xuewen Chen

In real-world datasets, noisy labels are pervasive. The challenge of learning with noisy labels (LNL) is to train a classifier that discerns the actual classes from given instances. For this, the model must identify features indicative of…

Machine Learning · Computer Science 2023-08-15 Hui Kang , Sheng Liu , Huaxi Huang , Tongliang Liu

Deep convolutional neural networks (CNNs) learned on large-scale labeled samples have achieved remarkable progress in computer vision, such as image/video classification. The cheapest way to obtain a large body of labeled visual data is to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Zhenzhen Wang , Chunyan Xu , Yap-Peng Tan , Junsong Yuan

One-hot labels do not represent soft decision boundaries among concepts, and hence, models trained on them are prone to overfitting. Using soft labels as targets provide regularization, but different soft labels might be optimal at…

Machine Learning · Computer Science 2020-09-22 Nidhi Vyas , Shreyas Saxena , Thomas Voice

Training deep neural networks(DNN) with noisy labels is challenging since DNN can easily memorize inaccurate labels, leading to poor generalization ability. Recently, the meta-learning based label correction strategy is widely adopted to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Yuanpeng Tu , Boshen Zhang , Yuxi Li , Liang Liu , Jian Li , Yabiao Wang , Chengjie Wang , Cai Rong Zhao

Multi-label classification (MLC) is a generalization of standard classification where multiple labels may be assigned to a given sample. In the real world, it is more common to deal with noisy datasets than clean datasets, given how modern…

Machine Learning · Computer Science 2021-02-18 Wenting Zhao , Carla Gomes

Positive-unlabeled learning refers to the process of training a binary classifier using only positive and unlabeled data. Although unlabeled data can contain positive data, all unlabeled data are regarded as negative data in existing…

Machine Learning · Computer Science 2021-03-09 Daiki Tanaka , Daiki Ikami , Kiyoharu Aizawa

Label noise is ubiquitous in various machine learning scenarios such as self-labeling with model predictions and erroneous data annotation. Many existing approaches are based on heuristics such as sample losses, which might not be flexible…

Machine Learning · Computer Science 2022-12-29 Zhihao Wang , Zongyu Lin , Peiqi Liu , Guidong ZHeng , Junjie Wen , Xianxin Chen , Yujun Chen , Zhilin Yang

Real-world datasets commonly have noisy labels, which negatively affects the performance of deep neural networks (DNNs). In order to address this problem, we propose a label noise robust learning algorithm, in which the base classifier is…

Machine Learning · Computer Science 2022-07-13 Görkem Algan , Ilkay Ulusoy

Real-world datasets usually are class-imbalanced and corrupted by label noise. To solve the joint issue of long-tailed distribution and label noise, most previous works usually aim to design a noise detector to distinguish the noisy and…

Machine Learning · Computer Science 2024-04-11 Zhuo Li , He Zhao , Zhen Li , Tongliang Liu , Dandan Guo , Xiang Wan

Previous graph neural networks (GNNs) usually assume that the graph data is with clean labels for representation learning, but it is not true in real applications. In this paper, we propose a new multi-teacher distillation method based on…

Machine Learning · Computer Science 2024-05-09 Yujing Liu , Zongqian Wu , Zhengyu Lu , Ci Nie , Guoqiu Wen , Ping Hu , Xiaofeng Zhu