中文
相关论文

相关论文: Towards Understanding Deep Learning from Noisy Lab…

200 篇论文

Labelling of data for supervised learning can be costly and time-consuming and the risk of incorporating label noise in large data sets is imminent. When training a flexible discriminative model using a strictly proper loss, such noise will…

机器学习 · 统计学 2022-05-13 Amanda Olmin , Fredrik Lindsten

The recent success of deep learning is mostly due to the availability of big datasets with clean annotations. However, gathering a cleanly annotated dataset is not always feasible due to practical challenges. As a result, label noise is a…

计算机视觉与模式识别 · 计算机科学 2020-03-25 Görkem Algan , İlkay Ulusoy

Noisy labels are ubiquitous in real-world datasets, which poses a challenge for robustly training deep neural networks (DNNs) as DNNs usually have the high capacity to memorize the noisy labels. In this paper, we find that the test accuracy…

机器学习 · 计算机科学 2019-05-14 Pengfei Chen , Benben Liao , Guangyong Chen , Shengyu Zhang

Recently deep neural networks have been successfully used for various classification tasks, especially for problems with massive perfectly labeled training data. However, it is often costly to have large-scale credible labels in real-world…

机器学习 · 计算机科学 2019-01-15 Mingxiao An , Yongzhou Chen , Qi Liu , Chuanren Liu , Guangyi Lv , Fangzhao Wu , Jianhui Ma

Recent deep neural networks (DNNs) can easily overfit to biased training data with noisy labels. Label correction strategy is commonly used to alleviate this issue by designing a method to identity suspected noisy labels and then correct…

计算机视觉与模式识别 · 计算机科学 2021-09-03 Yichen Wu , Jun Shu , Qi Xie , Qian Zhao , Deyu Meng

Because large, human-annotated datasets suffer from labeling errors, it is crucial to be able to train deep neural networks in the presence of label noise. While training image classification models with label noise have received much…

机器学习 · 计算机科学 2019-03-19 Ishan Jindal , Daniel Pressel , Brian Lester , Matthew Nokleby

Visual sentiment analysis has received increasing attention in recent years. However, the dataset's quality is a concern because the sentiment labels are crowd-sourcing, subjective, and prone to mistakes, and poses a severe threat to the…

计算机视觉与模式识别 · 计算机科学 2022-01-28 Wei Zhu , Zihe Zheng , Haitian Zheng , Hanjia Lyu , Jiebo Luo

Modern deep neural networks (DNNs) become frail when the datasets contain noisy (incorrect) class labels. Robust techniques in the presence of noisy labels can be categorized into two folds: developing noise-robust functions or using…

机器学习 · 计算机科学 2021-10-28 Taehyeon Kim , Jongwoo Ko , Sangwook Cho , Jinhwan Choi , Se-Young Yun

The success of deep learning requires high-quality annotated and massive data. However, the size and the quality of a dataset are usually a trade-off in practice, as data collection and cleaning are expensive and time-consuming. In…

计算与语言 · 计算机科学 2023-06-16 Ruibin Yuan , Hanzhi Yin , Yi Wang , Yifan He , Yushi Ye , Lei Zhang , Zhizheng Wu

The availability of large labeled datasets has allowed Convolutional Network models to achieve impressive recognition results. However, in many settings manual annotation of the data is impractical; instead our data has noisy labels, i.e.…

计算机视觉与模式识别 · 计算机科学 2015-04-13 Sainbayar Sukhbaatar , Joan Bruna , Manohar Paluri , Lubomir Bourdev , Rob Fergus

Deep neural networks have incredible capacity and expressibility, and can seemingly memorize any training set. This introduces a problem when training in the presence of noisy labels, as the noisy examples cannot be distinguished from clean…

机器学习 · 计算机科学 2022-10-04 Daniel Shwartz , Uri Stern , Daphna Weinshall

Learning in the presence of label noise is a challenging yet important task: it is crucial to design models that are robust in the presence of mislabeled datasets. In this paper, we discover that a new class of loss functions called the…

机器学习 · 计算机科学 2020-02-18 Liu Ziyin , Blair Chen , Ru Wang , Paul Pu Liang , Ruslan Salakhutdinov , Louis-Philippe Morency , Masahito Ueda

We introduce a novel method for training machine learning models in the presence of noisy labels, which are prevalent in domains such as medical diagnosis and autonomous driving and have the potential to degrade a model's generalization…

机器学习 · 计算机科学 2024-06-26 Farooq Ahmad Wani , Maria Sofia Bucarelli , Fabrizio Silvestri

The deep learning models used for speaker verification rely heavily on large amounts of data and correct labeling. However, noisy (incorrect) labels often occur, which degrades the performance of the system. In this paper, we propose a…

声音 · 计算机科学 2026-04-29 Zhihua Fang , Liang He , Hanhan Ma , Xiaochen Guo , Lin Li

In this paper, we address the problem of effectively self-training neural networks in a low-resource setting. Self-training is frequently used to automatically increase the amount of training data. However, in a low-resource scenario, it is…

计算与语言 · 计算机科学 2019-04-03 Debjit Paul , Mittul Singh , Michael A. Hedderich , Dietrich Klakow

Noisy labels, which are common in real-world datasets, can significantly impair the training of deep learning models. However, recent adversarial noise-combating methods overlook the long-tailed distribution of real data, which can…

机器学习 · 计算机科学 2024-08-09 Mengting Li , Chuang Zhu

Samples in large-scale datasets may be mislabeled due to various reasons, and Deep Neural Networks can easily over-fit to the noisy label data. To tackle this problem, the key point is to alleviate the harm of these noisy labels. Many…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Xuefeng Liang , Longshan Yao , Xingyu Liu , Ying Zhou

Recent studies on the memorization effects of deep neural networks on noisy labels show that the networks first fit the correctly-labeled training samples before memorizing the mislabeled samples. Motivated by this early-learning…

机器学习 · 计算机科学 2021-09-07 Yangdi Lu , Yang Bo , Wenbo He

Supervised learning of deep neural networks heavily relies on large-scale datasets annotated by high-quality labels. In contrast, mislabeled samples can significantly degrade the generalization of models and result in memorizing samples,…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Tsung-Ming Tai , Yun-Jie Jhang , Wen-Jyi Hwang

Noisy labels are ubiquitous in real-world datasets, especially in the large-scale ones derived from crowdsourcing and web searching. It is challenging to train deep neural networks with noisy datasets since the networks are prone to…

计算机视觉与模式识别 · 计算机科学 2024-06-26 Yangdi Lu , Wenbo He