English
Related papers

Related papers: An Embedding is Worth a Thousand Noisy Labels

200 papers

To collect large scale annotated data, it is inevitable to introduce label noise, i.e., incorrect class labels. To be robust against label noise, many successful methods rely on the noisy classifiers (i.e., models trained on the noisy…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Songzhu Zheng , Pengxiang Wu , Aman Goswami , Mayank Goswami , Dimitris Metaxas , Chao Chen

Graph Neural Networks (GNNs) are powerful at solving graph classification tasks, yet applied problems often contain noisy labels. In this work, we study GNN robustness to label noise, demonstrate GNN failure modes when models struggle to…

Training deep neural networks (DNNs) from noisy labels is an important and challenging task. However, most existing approaches focus on the corrupted labels and ignore the importance of inherent data structure. To bridge the gap between…

Machine Learning · Computer Science 2024-05-03 Zijia Wang , Wenbin Yang , Zhisong Liu , Zhen Jia

Data lies at the core of modern deep learning. The impressive performance of supervised learning is built upon a base of massive accurately labeled data. However, in some real-world applications, accurate labeling might not be viable;…

Fine-grained annotations---e.g. dense image labels, image segmentation and text tagging---are useful in many ML applications but they are labor-intensive to generate. Moreover there are often systematic, structured errors in these…

Machine Learning · Computer Science 2020-03-26 Abubakar Abid , James Zou

Performing controlled experiments on noisy data is essential in understanding deep learning across noise levels. Due to the lack of suitable datasets, previous research has only examined deep learning on controlled synthetic label noise,…

Machine Learning · Computer Science 2020-08-28 Lu Jiang , Di Huang , Mason Liu , Weilong Yang

Real-world machine learning applications often struggle with two major challenges: distribution shift and label noise. Models tend to overfit by focusing on redundant and uninformative features in the training data, which makes it hard for…

Computation and Language · Computer Science 2025-04-22 Zilin Dai , Lehong Wang , Fangzhou Lin , Yidong Wang , Zhigang Li , Kazunori D Yamada , Ziming Zhang , Wang Lu

Visual sentiment analysis has received increasing attention in recent years. However, the dataset's quality is a concern because the sentiment labels are crowd-sourcing, subjective, and prone to mistakes, and poses a severe threat to the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 Wei Zhu , Zihe Zheng , Haitian Zheng , Hanjia Lyu , Jiebo Luo

Training deep neural networks (DNNs) in the presence of noisy labels is an important and challenging task. Probabilistic modeling, which consists of a classifier and a transition matrix, depicts the transformation from true labels to noisy…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Xianbin Lv , Dongxian Wu , Shu-Tao Xia

Purpose: Deep neural networks (DNNs) have been widely applied in medical image classification, benefiting from its powerful mapping capability among medical images. However, these existing deep learning-based methods depend on an enormous…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Mengdi Gao , Ximeng Feng , Mufeng Geng , Zhe Jiang , Lei Zhu , Xiangxi Meng , Chuanqing Zhou , Qiushi Ren , Yanye Lu

Acoustic event detection for content analysis in most cases relies on lots of labeled data. However, manually annotating data is a time-consuming task, which thus makes few annotated resources available so far. Unlike audio event detection,…

Computer Vision and Pattern Recognition · Computer Science 2016-08-16 Yong Xu , Qiang Huang , Wenwu Wang , Philip J. B. Jackson , Mark D. Plumbley

Training deep neural networks (DNNs) under weak supervision has attracted increasing research attention as it can significantly reduce the annotation cost. However, labels from weak supervision can be noisy, and the high capacity of DNNs…

Computation and Language · Computer Science 2023-05-02 Dawei Zhu , Xiaoyu Shen , Michael A. Hedderich , Dietrich Klakow

Deep neural networks (DNNs) have a high capacity to completely memorize noisy labels given sufficient training time, and its memorization, unfortunately, leads to performance degradation. Recently, virtual adversarial training (VAT)…

Computation and Language · Computer Science 2022-06-24 Do-Myoung Lee , Yeachan Kim , Chang-gyun Seo

Deep learning has achieved excellent performance in various computer vision tasks, but requires a lot of training examples with clean labels. It is easy to collect a dataset with noisy labels, but such noise makes networks overfit seriously…

Computer Vision and Pattern Recognition · Computer Science 2019-03-20 Kun Yi , Jianxin Wu

For classification tasks, deep neural networks are prone to overfitting in the presence of label noise. Although existing methods are able to alleviate this problem at low noise levels, they encounter significant performance reduction at…

Machine Learning · Computer Science 2021-05-31 Jingyi Xu , Tony Q. S. Quek , Kai Fong Ernest Chong

Samples in large-scale datasets may be mislabeled due to various reasons, and Deep Neural Networks can easily over-fit to the noisy label data. To tackle this problem, the key point is to alleviate the harm of these noisy labels. Many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Xuefeng Liang , Longshan Yao , Xingyu Liu , Ying Zhou

Deep neural networks trained on large supervised datasets have led to impressive results in image classification and other tasks. However, well-annotated datasets can be time-consuming and expensive to collect, lending increased interest to…

Machine Learning · Computer Science 2018-02-27 David Rolnick , Andreas Veit , Serge Belongie , Nir Shavit

Supervised deep learning methods require a large repository of annotated data; hence, label noise is inevitable. Training with such noisy data negatively impacts the generalization performance of deep neural networks. To combat label noise,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Nazmul Karim , Mamshad Nayeem Rizve , Nazanin Rahnavard , Ajmal Mian , Mubarak Shah

Fixed Radius Near Neighbor (FRNN) search is an alternative to the widely used k Nearest Neighbors (kNN) search. Unlike kNN, FRNN determines a label or an estimate for a test sample based on all training samples within a predefined distance.…

Machine Learning · Computer Science 2026-04-20 Khang Le , Joaquín Torres-Sospedra , Philipp Müller

Learning from noisy labels (LNL) is crucial in deep learning, in which one of the approaches is to identify clean-label samples from poorly-annotated datasets. Such an identification is challenging because the conventional LNL problem,…

Machine Learning · Computer Science 2025-09-26 Cuong Nguyen , Thanh-Toan Do , Gustavo Carneiro