English
Related papers

Related papers: Validating Label Consistency in NER Data Annotatio…

200 papers

Distant and weak supervision allow to obtain large amounts of labeled training data quickly and cheaply, but these automatic annotations tend to contain a high amount of errors. A popular technique to overcome the negative effects of these…

Machine Learning · Computer Science 2021-03-02 Michael A. Hedderich , Dawei Zhu , Dietrich Klakow

Since the behavior of a neural network model is adversely affected by a lack of diversity in training data, we present a method that identifies and explains such deficiencies. When a dataset is labeled, we note that annotations alone are…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Dhasarathy Parthasarathy , Anton Johansson

We propose a novel sample selection method for image classification in the presence of noisy labels. Existing methods typically consider small-loss samples as correctly labeled. However, some correctly labeled samples are inherently…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Weiran Pan , Wei Wei , Feida Zhu , Yong Deng

High-quality pixel-level annotations are essential for the semantic segmentation of remote sensing imagery. However, such labels are expensive to obtain and often affected by noise due to the labor-intensive and time-consuming nature of…

In learning tasks with label noise, improving model robustness against overfitting is a pivotal challenge because the model eventually memorizes labels, including the noisy ones. Identifying the samples with noisy labels and preventing the…

Machine Learning · Computer Science 2023-09-28 Reihaneh Torkzadehmahani , Reza Nasirigerdeh , Daniel Rueckert , Georgios Kaissis

Datasets labelled by human annotators are widely used in the training and testing of machine learning models. In recent years, researchers are increasingly paying attention to label quality. However, it is not always possible to objectively…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Luisa Schwirten , Jannes Scholz , Daniel Kondermann , Janis Keuper

To collect large scale annotated data, it is inevitable to introduce label noise, i.e., incorrect class labels. To be robust against label noise, many successful methods rely on the noisy classifiers (i.e., models trained on the noisy…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Songzhu Zheng , Pengxiang Wu , Aman Goswami , Mayank Goswami , Dimitris Metaxas , Chao Chen

State-of-the-art Named Entity Recognition(NER) models rely heavily on large amountsof fully annotated training data. However, ac-cessible data are often incompletely annotatedsince the annotators usually lack comprehen-sive knowledge in the…

Computation and Language · Computer Science 2022-06-10 Hongtao Ruan , Liying Zheng , Peixian Hu

Noisy Labels are commonly present in data sets automatically collected from the internet, mislabeled by non-specialist annotators, or even specialists in a challenging task, such as in the medical field. Although deep learning models have…

Machine Learning · Computer Science 2020-12-08 Filipe R. Cordeiro , Gustavo Carneiro

Partial multi-label learning aims to extract knowledge from incompletely annotated data, which includes known correct labels, known incorrect labels, and unknown labels. The core challenge lies in accurately identifying the ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xin Wu , Fei Teng , Yue Feng , Kaibo Shi , Zhuosheng Lin , Ji Zhang , James Wang

Zero-shot named entity recognition (NER) is the task of detecting named entities of specific types (such as 'Person' or 'Medicine') without any training examples. Current research increasingly relies on large synthetic datasets,…

Computation and Language · Computer Science 2025-03-10 Jonas Golde , Patrick Haller , Max Ploner , Fabio Barth , Nicolaas Jedema , Alan Akbik

It is crucial to distinguish mislabeled samples for dealing with noisy labels. Previous methods such as Coteaching and JoCoR introduce two different networks to select clean samples out of the noisy ones and only use these clean ones to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Rumeng Yi , Yaping Huang

Current state-of-the-art deep learning systems for visual object recognition and detection use purely supervised training with regularization such as dropout to avoid overfitting. The performance depends critically on the amount of labeled…

Computer Vision and Pattern Recognition · Computer Science 2015-04-16 Scott Reed , Honglak Lee , Dragomir Anguelov , Christian Szegedy , Dumitru Erhan , Andrew Rabinovich

Neural sequence labeling (NSL) aims at assigning labels for input language tokens, which covers a broad range of applications, such as named entity recognition (NER) and slot filling, etc. However, the satisfying results achieved by…

Computation and Language · Computer Science 2023-02-20 Jianing Wang , Chengyu Wang , Jun Huang , Ming Gao , Aoying Zhou

This study explores the robustness of label noise classifiers, aiming to enhance model resilience against noisy data in complex real-world scenarios. Label noise in supervised learning, characterized by erroneous or imprecise labels,…

Machine Learning · Computer Science 2023-12-13 Cheng Zeng , Yixuan Xu , Jiaqi Tian

Segmentation uncertainty models predict a distribution over plausible segmentations for a given input, which they learn from the annotator variation in the training set. However, in practice these annotations can differ systematically in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Kilian Zepf , Eike Petersen , Jes Frellsen , Aasa Feragen

Auto-annotation by ensemble of models is an efficient method of learning on unlabeled data. Wrong or inaccurate annotations generated by the ensemble may lead to performance degradation of the trained model. To deal with this problem we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Dror Simon , Miriam Farber , Roman Goldenberg

Annotating multi-class instances is a crucial task in the field of machine learning. Unfortunately, identifying the correct class label from a long sequence of candidate labels is time-consuming and laborious. To alleviate this problem, we…

Machine Learning · Computer Science 2025-12-05 Meng Wei , Zhongnian Li , Yong Zhou , Qiaoyu Guo , Xinzheng Xu

To better tackle the named entity recognition (NER) problem on languages with little/no labeled data, cross-lingual NER must effectively leverage knowledge learned from source languages with rich labeled data. Previous works on…

Computation and Language · Computer Science 2020-07-16 Qianhui Wu , Zijia Lin , Börje F. Karlsson , Jian-Guang Lou , Biqing Huang

Sequence labeling systems should perform reliably not only under ideal conditions but also with corrupted inputs - as these systems often process user-generated text or follow an error-prone upstream component. To this end, we formulate the…

Computation and Language · Computer Science 2020-05-15 Marcin Namysl , Sven Behnke , Joachim Köhler