中文
相关论文

相关论文: Is BERT Robust to Label Noise? A Study on Learning…

200 篇论文

To discover intrinsic inter-class transition probabilities underlying data, learning with noise transition has become an important approach for robust deep learning on corrupted labels. Prior methods attempt to achieve such transition…

机器学习 · 计算机科学 2020-06-15 Jun Shu , Qian Zhao , Zongben Xu , Deyu Meng

Modern deep neural networks (DNNs) become frail when the datasets contain noisy (incorrect) class labels. Robust techniques in the presence of noisy labels can be categorized into two folds: developing noise-robust functions or using…

机器学习 · 计算机科学 2021-10-28 Taehyeon Kim , Jongwoo Ko , Sangwook Cho , Jinhwan Choi , Se-Young Yun

Experts classifying data are often imprecise. Recently, several models have been proposed to train classifiers using the noisy labels generated by these experts. How to choose between these models? In such situations, the true labels are…

统计方法学 · 统计学 2014-05-15 Rafael Izbicki , Rafael Bassi Stern

The problem of open-set noisy labels denotes that part of training data have a different label space that does not contain the true class. Lots of approaches, e.g., loss correction and label correction, cannot handle such open-set noisy…

机器学习 · 计算机科学 2021-06-02 Xiaobo Xia , Tongliang Liu , Bo Han , Mingming Gong , Jun Yu , Gang Niu , Masashi Sugiyama

In this paper, we investigate the problem of learning with noisy labels in real-world annotation scenarios, where noise can be categorized into two types: factual noise and ambiguity noise. To better distinguish these noise types and…

机器学习 · 计算机科学 2023-08-23 Renyu Zhu , Haoyu Liu , Runze Wu , Minmin Lin , Tangjie Lv , Changjie Fan , Haobo Wang

To achieve state-of-the-art performance, one still needs to train NER models on large-scale, high-quality annotated data, an asset that is both costly and time-intensive to accumulate. In contrast, real-world applications often resort to…

计算与语言 · 计算机科学 2023-10-26 Zhendong Chu , Ruiyi Zhang , Tong Yu , Rajiv Jain , Vlad I Morariu , Jiuxiang Gu , Ani Nenkova

This paper aims to provide understandings for the effect of an over-parameterized model, e.g. a deep neural network, memorizing instance-dependent noisy labels. We first quantify the harms caused by memorizing noisy instances, and show the…

机器学习 · 计算机科学 2021-07-14 Yang Liu

Collecting large training datasets, annotated with high-quality labels, is costly and time-consuming. This paper proposes a novel framework for training deep convolutional neural networks from noisy labeled datasets that can be obtained…

机器学习 · 计算机科学 2017-11-06 Arash Vahdat

Annotators exhibit disagreement during data labeling, which can be termed as annotator label uncertainty. Annotator label uncertainty manifests in variations of labeling quality. Training with a single low-quality annotation per sample…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Chen Zhou , Mohit Prabhushankar , Ghassan AlRegib

We explore contemporary robust classification algorithms for overcoming class-dependant labelling noise: Forward, Importance Re-weighting and T-revision. The classifiers are trained and evaluated on class-conditional random label noise data…

机器学习 · 计算机科学 2021-06-02 Alex Díaz , Damian Steele

Large datasets often have unreliable labels-such as those obtained from Amazon's Mechanical Turk or social media platforms-and classifiers trained on mislabeled datasets often exhibit poor performance. We present a simple, effective…

计算机视觉与模式识别 · 计算机科学 2017-05-10 Ishan Jindal , Matthew Nokleby , Xuewen Chen

Learning with Noisy Labels (LNL) has attracted significant attention from the research community. Many recent LNL methods rely on the assumption that clean samples tend to have "small loss". However, this assumption always fails to…

机器学习 · 计算机科学 2022-11-17 MingCai Chen , Yu Zhao , Bing He , Zongbo Han , Bingzhe Wu , Jianhua Yao

Label noise in datasets could significantly damage the performance and robustness of deep neural networks (DNNs) trained on these datasets. As the size of modern DNNs grows, there is a growing demand for automated tools for detecting such…

机器学习 · 计算机科学 2025-10-28 Dang Huu-Tien , Minh-Phuong Nguyen , Naoya Inoue

Training with noisy class labels impairs neural networks' generalization performance. In this context, mixup is a popular regularization technique to improve training robustness by making memorizing false class labels more difficult.…

机器学习 · 计算机科学 2024-05-07 Marek Herde , Lukas Lührs , Denis Huseljic , Bernhard Sick

Data lies at the core of modern deep learning. The impressive performance of supervised learning is built upon a base of massive accurately labeled data. However, in some real-world applications, accurate labeling might not be viable;…

Noisy labels are inevitable in large real-world datasets. In this work, we explore an area understudied by previous works -- how the network's architecture impacts its robustness to noisy labels. We provide a formal framework connecting the…

机器学习 · 计算机科学 2021-11-30 Jingling Li , Mozhi Zhang , Keyulu Xu , John P. Dickerson , Jimmy Ba

Correct labels are indispensable for training effective machine learning models. However, creating high-quality labels is expensive, and even professionally labeled data contains errors and ambiguities. Filtering and denoising can be…

Supervised classification algorithms are used to solve a growing number of real-life problems around the globe. Their performance is strictly connected with the quality of labels used in training. Unfortunately, acquiring good-quality…

机器学习 · 计算机科学 2024-07-08 Daniel Kałuża , Andrzej Janusz , Dominik Ślęzak

Deep neural networks (DNNs) trained on large-scale datasets have exhibited significant performance in image classification. Many large-scale datasets are collected from websites, however they tend to contain inaccurate labels that are…

计算机视觉与模式识别 · 计算机科学 2019-04-23 Daiki Tanaka , Daiki Ikami , Toshihiko Yamasaki , Kiyoharu Aizawa

Noisy labels are a pervasive challenge in medical image classification, where annotation errors arise from inter-observer variability and diagnostic ambiguity. Although several noise-robust learning methods have been proposed, their…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Maycon R. S. Pereira , Filipe R. Cordeiro