English
Related papers

Related papers: TrustNet: Learning from Trusted Data Against (A)sy…

200 papers

Deep neural networks have been shown to be very powerful methods for many supervised learning tasks. However, they can also easily overfit to training set biases, i.e., label noise and class imbalance. While both learning with noisy labels…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Tong Wei , Jiang-Xin Shi , Yu-Feng Li , Min-Ling Zhang

Performing controlled experiments on noisy data is essential in understanding deep learning across noise levels. Due to the lack of suitable datasets, previous research has only examined deep learning on controlled synthetic label noise,…

Machine Learning · Computer Science 2020-08-28 Lu Jiang , Di Huang , Mason Liu , Weilong Yang

Noisy labels can significantly impact medical image classification, particularly in deep learning, by corrupting learned features. Self-supervised pretraining, which doesn't rely on labeled data, can enhance robustness against noisy labels.…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Bidur Khanal , Binod Bhattarai , Bishesh Khanal , Cristian Linte

Deep learning with noisy labels is an interesting challenge in weakly supervised learning. Despite their significant learning capacity, CNNs have a tendency to overfit in the presence of samples with noisy labels. Alleviating this issue,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Yan Han , Soumava Kumar Roy , Mehrtash Harandi , Lars Petersson

Deep Neural Networks (DNNs) have been shown to be susceptible to memorization or overfitting in the presence of noisily-labelled data. For the problem of robust learning under such noisy data, several algorithms have been proposed. A…

Machine Learning · Computer Science 2022-12-06 Deep Patel , P. S. Sastry

While mislabeled or ambiguously-labeled samples in the training set could negatively affect the performance of deep models, diagnosing the dataset and identifying mislabeled samples helps to improve the generalization power. Training…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Qingrui Jia , Xuhong Li , Lei Yu , Jiang Bian , Penghao Zhao , Shupeng Li , Haoyi Xiong , Dejing Dou

Deep learning has made many remarkable achievements in many fields but suffers from noisy labels in datasets. The state-of-the-art learning with noisy label method Co-teaching and Co-teaching+ confronts the noisy label by mutual-information…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Jiarun Liu , Daguang Jiang , Yukun Yang , Ruirui Li

Safety-critical applications require machine learning models that output accurate and calibrated probabilities. While uncalibrated deep networks are known to make over-confident predictions, it is unclear how model confidence is impacted by…

Machine Learning · Computer Science 2020-02-25 Yuan Zhao , Jiasi Chen , Samet Oymak

Deep neural networks (DNNs) trained on large-scale datasets have exhibited significant performance in image classification. Many large-scale datasets are collected from websites, however they tend to contain inaccurate labels that are…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Daiki Tanaka , Daiki Ikami , Toshihiko Yamasaki , Kiyoharu Aizawa

In the presence of noisy or incorrect labels, neural networks have the undesirable tendency to memorize information about the noise. Standard regularization techniques such as dropout, weight decay or data augmentation sometimes help, but…

Machine Learning · Computer Science 2020-11-23 Hrayr Harutyunyan , Kyle Reing , Greg Ver Steeg , Aram Galstyan

Collecting labeled data to train deep neural networks is costly and even impractical for many tasks. Thus, research effort has been focused in automatically curated datasets or unsupervised and weakly supervised learning. The common problem…

Machine Learning · Computer Science 2019-01-03 Nam Le , Jean-Marc Odobez

In this paper we explore noise tolerant learning of classifiers. We formulate the problem as follows. We assume that there is an ${\bf unobservable}$ training set which is noise-free. The actual training set given to the learning algorithm…

Machine Learning · Computer Science 2013-11-27 Naresh Manwani , P. S. Sastry

Noisy labels are ubiquitous in real-world datasets, which poses a challenge for robustly training deep neural networks (DNNs) as DNNs usually have the high capacity to memorize the noisy labels. In this paper, we find that the test accuracy…

Machine Learning · Computer Science 2019-05-14 Pengfei Chen , Benben Liao , Guangyong Chen , Shengyu Zhang

Label noise may affect the generalization of classifiers, and the effective learning of main patterns from samples with noisy labels is an important challenge. Recent studies have shown that deep neural networks tend to prioritize the…

Machine Learning · Computer Science 2019-12-06 Yi Sun , Yan Tian , Yiping Xu , Jianxiang Li

Large datasets in NLP suffer from noisy labels, due to erroneous automatic and human annotation procedures. We study the problem of text classification with label noise, and aim to capture this noise through an auxiliary noise model over…

Computation and Language · Computer Science 2022-06-22 Siddhant Garg , Goutham Ramakrishnan , Varun Thumbe

For multi-class classification under class-conditional label noise, we prove that the accuracy metric itself can be robust. We concretize this finding's inspiration in two essential aspects: training and validation, with which we address…

Machine Learning · Computer Science 2020-12-09 Pengfei Chen , Junjie Ye , Guangyong Chen , Jingwei Zhao , Pheng-Ann Heng

Label-noise learning (LNL) aims to increase the model's generalization given training data with noisy labels. To facilitate practical LNL algorithms, researchers have proposed different label noise types, ranging from class-conditional to…

Machine Learning · Computer Science 2024-02-13 Jingfeng Zhang , Bo Song , Haohan Wang , Bo Han , Tongliang Liu , Lei Liu , Masashi Sugiyama

Often, the data used to train ranking models is subject to label noise. For example, in web-search, labels created from clickstream data are noisy due to issues such as insufficient information in item descriptions on the SERP, query…

Information Retrieval · Computer Science 2022-08-18 Dany Haddad

Deep neural networks may easily memorize noisy labels present in real-world data, which degrades their ability to generalize. It is therefore important to track and evaluate the robustness of models against noisy label memorization. We…

Machine Learning · Computer Science 2022-12-09 Mahsa Forouzesh , Hanie Sedghi , Patrick Thiran

Deep neural networks (DNNs) are powerful tools in computer vision tasks. However, in many realistic scenarios label noise is prevalent in the training images, and overfitting to these noisy labels can significantly harm the generalization…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Jan M. Köhler , Maximilian Autenrieth , William H. Beluch