中文
相关论文

相关论文: Is BERT Robust to Label Noise? A Study on Learning…

200 篇论文

Label noise is emerging as a pressing issue in sound event classification. This arises as we move towards larger datasets that are difficult to annotate manually, but it is even more severe if datasets are collected automatically from…

声音 · 计算机科学 2019-10-29 Eduardo Fonseca , Frederic Font , Xavier Serra

The availability of large labeled datasets has allowed Convolutional Network models to achieve impressive recognition results. However, in many settings manual annotation of the data is impractical; instead our data has noisy labels, i.e.…

计算机视觉与模式识别 · 计算机科学 2015-04-13 Sainbayar Sukhbaatar , Joan Bruna , Manohar Paluri , Lubomir Bourdev , Rob Fergus

Noisy labels can impair the performance of deep neural networks. To tackle this problem, in this paper, we propose a new method for filtering label noise. Unlike most existing methods relying on the posterior probability of a noisy…

计算机视觉与模式识别 · 计算机科学 2022-01-31 Pengxiang Wu , Songzhu Zheng , Mayank Goswami , Dimitris Metaxas , Chao Chen

Manual labelling of training examples is common practice in supervised learning. When the labelling task is of non-trivial difficulty, the supplied labels may not be equal to the ground-truth labels, and label noise is introduced into the…

机器学习 · 统计学 2021-04-08 Daniel Ahfock , Geoffrey J. McLachlan

Large-scale datasets are essential for the success of deep learning in image retrieval. However, manual assessment errors and semi-supervised annotation techniques can lead to label noise even in popular datasets. As previous works…

计算机视觉与模式识别 · 计算机科学 2022-05-24 Stanislav Dereka , Ivan Karpukhin , Sergey Kolesnikov

The availability of a large quantity of labelled training data is crucial for the training of modern object detectors. Hand labelling training data is time consuming and expensive while automatic labelling methods inevitably add unwanted…

机器人学 · 计算机科学 2019-05-20 Simon Chadwick , Paul Newman

Deep Learning systems have shown tremendous accuracy in image classification, at the cost of big image datasets. Collecting such amounts of data can lead to labelling errors in the training set. Indexing multimedia content for retrieval,…

机器学习 · 计算机科学 2024-09-13 Guillaume Sanchez , Vincente Guis , Ricard Marxer , Frédéric Bouchara

Sequence labeling systems should perform reliably not only under ideal conditions but also with corrupted inputs - as these systems often process user-generated text or follow an error-prone upstream component. To this end, we formulate the…

计算与语言 · 计算机科学 2020-05-15 Marcin Namysl , Sven Behnke , Joachim Köhler

Recent deep neural networks (DNNs) can easily overfit to biased training data with noisy labels. Label correction strategy is commonly used to alleviate this issue by designing a method to identity suspected noisy labels and then correct…

计算机视觉与模式识别 · 计算机科学 2021-09-03 Yichen Wu , Jun Shu , Qi Xie , Qian Zhao , Deyu Meng

Supervised learning of deep neural networks heavily relies on large-scale datasets annotated by high-quality labels. In contrast, mislabeled samples can significantly degrade the generalization of models and result in memorizing samples,…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Tsung-Ming Tai , Yun-Jie Jhang , Wen-Jyi Hwang

Because large, human-annotated datasets suffer from labeling errors, it is crucial to be able to train deep neural networks in the presence of label noise. While training image classification models with label noise have received much…

机器学习 · 计算机科学 2019-03-19 Ishan Jindal , Daniel Pressel , Brian Lester , Matthew Nokleby

In most practical problems of classifier learning, the training data suffers from the label noise. Hence, it is important to understand how robust is a learning algorithm to such label noise. This paper presents some theoretical analysis to…

机器学习 · 计算机科学 2016-08-29 Aritra Ghosh , Naresh Manwani , P. S. Sastry

In this paper, we address the problem of effectively self-training neural networks in a low-resource setting. Self-training is frequently used to automatically increase the amount of training data. However, in a low-resource scenario, it is…

计算与语言 · 计算机科学 2019-04-03 Debjit Paul , Mittul Singh , Michael A. Hedderich , Dietrich Klakow

Label noise is frequently observed in real-world large-scale datasets. The noise is introduced due to a variety of reasons; it is heterogeneous and feature-dependent. Most existing approaches to handling noisy labels fall into two…

机器学习 · 计算机科学 2021-03-30 Yikai Zhang , Songzhu Zheng , Pengxiang Wu , Mayank Goswami , Chao Chen

Computer vision systems recently made a big leap thanks to deep neural networks. However, these systems require correctly labeled large datasets in order to be trained properly, which is very difficult to obtain for medical applications.…

计算机视觉与模式识别 · 计算机科学 2021-02-16 Görkem Algan , Ilkay Ulusoy , Şaban Gönül , Banu Turgut , Berker Bakbak

Neural Encoders are frequently used in the NLP domain to perform dense retrieval tasks, for instance, to generate the candidate documents for a given query in question-answering tasks. However, sparse annotation and label noise in the…

机器学习 · 计算机科学 2025-12-16 Arnab Sharma

The growing importance of massive datasets used for deep learning makes robustness to label noise a critical property for classifiers to have. Sources of label noise include automatic labeling, non-expert labeling, and label corruption by…

机器学习 · 计算机科学 2019-01-30 Dan Hendrycks , Mantas Mazeika , Duncan Wilson , Kevin Gimpel

Label noise poses an important challenge in machine learning, especially in deep learning, in which large models with high expressive power dominate the field. Models of that kind are prone to memorizing incorrect labels, thereby harming…

机器学习 · 计算机科学 2024-01-26 Julian Lienen , Eyke Hüllermeier

Machine learning models are routinely used to support decisions that affect individuals -- be it to screen a patient for a serious illness or to gauge their response to treatment. In these tasks, we are limited to learning models from…

机器学习 · 计算机科学 2025-06-10 Sujay Nagaraj , Yang Liu , Flavio P. Calmon , Berk Ustun

Learning in the presence of label noise is a challenging yet important task: it is crucial to design models that are robust in the presence of mislabeled datasets. In this paper, we discover that a new class of loss functions called the…

机器学习 · 计算机科学 2020-02-18 Liu Ziyin , Blair Chen , Ru Wang , Paul Pu Liang , Ruslan Salakhutdinov , Louis-Philippe Morency , Masahito Ueda