English
Related papers

Related papers: Improving a Named Entity Recognizer Trained on Noi…

200 papers

Datasets with significant proportions of noisy (incorrect) class labels present challenges for training accurate Deep Neural Networks (DNNs). We propose a new perspective for understanding DNN generalization for such datasets, by…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Xingjun Ma , Yisen Wang , Michael E. Houle , Shuo Zhou , Sarah M. Erfani , Shu-Tao Xia , Sudanthi Wijewickrema , James Bailey

Training a deep neural network heavily relies on a large amount of training data with accurate annotations. To alleviate this problem, various methods have been proposed to annotate the data automatically. However, automatically generating…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Yi Wei , Xue Mei , Xin Liu , Pengxiang Xu

Image classification problems are typically addressed by first collecting examples with candidate labels, second cleaning the candidate labels manually, and third training a deep neural network on the clean examples. The manual labeling…

Machine Learning · Computer Science 2020-02-27 Fatih Furkan Yilmaz , Reinhard Heckel

Named Entity Recognition (NER) frequently suffers from the problem of insufficient labeled data, particularly in fine-grained NER scenarios. Although $K$-shot learning techniques can be applied, their performance tends to saturate when the…

Computation and Language · Computer Science 2023-11-14 Su Ah Lee , Seokjin Oh , Woohwan Jung

In industry deep learning application, our manually labeled data has a certain number of noisy data. To solve this problem and achieve more than 90 score in dev dataset, we present a simple method to find the noisy data and re-label the…

Machine Learning · Computer Science 2025-03-20 Tong Guo

Visual sentiment analysis has received increasing attention in recent years. However, the dataset's quality is a concern because the sentiment labels are crowd-sourcing, subjective, and prone to mistakes, and poses a severe threat to the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 Wei Zhu , Zihe Zheng , Haitian Zheng , Hanjia Lyu , Jiebo Luo

Current approaches for fine-grained recognition do the following: First, recruit experts to annotate a dataset of images, optionally also collecting more structured data in the form of part annotations and bounding boxes. Second, train a…

Computer Vision and Pattern Recognition · Computer Science 2016-10-19 Jonathan Krause , Benjamin Sapp , Andrew Howard , Howard Zhou , Alexander Toshev , Tom Duerig , James Philbin , Li Fei-Fei

In this paper, we consider the instance segmentation task on a long-tailed dataset, which contains label noise, i.e., some of the annotations are incorrect. There are two main reasons making this case realistic. First, datasets collected…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Guanlin Li , Guowen Xu , Tianwei Zhang

Training with noisy class labels impairs neural networks' generalization performance. In this context, mixup is a popular regularization technique to improve training robustness by making memorizing false class labels more difficult.…

Machine Learning · Computer Science 2024-05-07 Marek Herde , Lukas Lührs , Denis Huseljic , Bernhard Sick

There are inevitably many mislabeled data in real-world datasets. Because deep neural networks (DNNs) have an enormous capacity to memorize noisy labels, a robust training scheme is required to prevent labeling errors from degrading the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jun Ho Lee , Jae Soon Baik , Tae Hwan Hwang , Jun Won Choi

Selecting an effective training signal for machine learning tasks is difficult: expert annotations are expensive, and crowd-sourced annotations may not be reliable. Recent work has demonstrated that learning from a distribution over labels…

Computation and Language · Computer Science 2025-04-23 Dustin Wright , Isabelle Augenstein

Cross-lingual named entity recognition (NER) aims to train an NER system that generalizes well to a target language by leveraging labeled data in a given source language. Previous work alleviates the data scarcity problem by translating…

Computation and Language · Computer Science 2023-05-25 Tingting Ma , Qianhui Wu , Huiqiang Jiang , Börje F. Karlsson , Tiejun Zhao , Chin-Yew Lin

Distant supervision for relation extraction provides uniform bag labels for each sentence inside the bag, while accurate sentence labels are important for downstream applications that need the exact relation type. Directly using bag labels…

Computation and Language · Computer Science 2021-06-23 Ruotian Ma , Tao Gui , Linyang Li , Qi Zhang , Yaqian Zhou , Xuanjing Huang

In this paper, we study the use of soft labels to train a system for sound event detection (SED). Soft labels can result from annotations which account for human uncertainty about categories, or emerge as a natural representation of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-01 Irene Martín-Morató , Manu Harju , Paul Ahokas , Annamaria Mesaros

In this paper, we study the problem of learning image classification models with label noise. Existing approaches depending on human supervision are generally not scalable as manually identifying correct or incorrect labels is…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Kuang-Huei Lee , Xiaodong He , Lei Zhang , Linjun Yang

It is crucial to distinguish mislabeled samples for dealing with noisy labels. Previous methods such as Coteaching and JoCoR introduce two different networks to select clean samples out of the noisy ones and only use these clean ones to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Rumeng Yi , Yaping Huang

Deep learning has achieved remarkable success in numerous domains with help from large amounts of big data. However, the quality of data labels is a concern because of the lack of high-quality labels in many real-world scenarios. As noisy…

Machine Learning · Computer Science 2022-03-11 Hwanjun Song , Minseok Kim , Dongmin Park , Yooju Shin , Jae-Gil Lee

Noisy labels can significantly affect the performance of deep neural networks (DNNs). In medical image segmentation tasks, annotations are error-prone due to the high demand in annotation time and in the annotators' expertise. Existing…

Image and Video Processing · Electrical Eng. & Systems 2023-08-08 Jiachen Yao , Yikai Zhang , Songzhu Zheng , Mayank Goswami , Prateek Prasanna , Chao Chen

An accurate and substantial dataset is essential for training a reliable and well-performing model. However, even manually annotated datasets contain label errors, not to mention automatically labeled ones. Previous methods for label…

Machine Learning · Computer Science 2024-01-05 Anastasiia Sedova , Lena Zellinger , Benjamin Roth

We consider the problem of training a model under the presence of label noise. Current approaches identify samples with potentially incorrect labels and reduce their influence on the learning process by either assigning lower weights to…

Machine Learning · Computer Science 2019-06-04 Duc Tam Nguyen , Thi-Phuong-Nhung Ngo , Zhongyu Lou , Michael Klar , Laura Beggel , Thomas Brox