English
Related papers

Related papers: Validating Label Consistency in NER Data Annotatio…

200 papers

Human variation in labeling is often considered noise. Annotation projects for machine learning (ML) aim at minimizing human label variation, with the assumption to maximize data quality and in turn optimize and maximize machine learning…

Computation and Language · Computer Science 2022-11-07 Barbara Plank

Label noise in datasets could significantly damage the performance and robustness of deep neural networks (DNNs) trained on these datasets. As the size of modern DNNs grows, there is a growing demand for automated tools for detecting such…

Machine Learning · Computer Science 2025-10-28 Dang Huu-Tien , Minh-Phuong Nguyen , Naoya Inoue

In supervised machine learning, use of correct labels is extremely important to ensure high accuracy. Unfortunately, most datasets contain corrupted labels. Machine learning models trained on such datasets do not generalize well. Thus,…

Machine Learning · Computer Science 2023-09-14 Chang Yue , Niraj K. Jha

Noisy labels are inevitable, even in well-annotated datasets. The detection of noisy labels is of significant importance to enhance the robustness of speaker recognition models. In this paper, we propose a novel noisy label detection…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Yao Shen , Yingying Gao , Yaqian Hao , Chenguang Hu , Fulin Zhang , Junlan Feng , Shilei Zhang

Human annotation cost and time remain significant bottlenecks in Natural Language Processing (NLP), with test data annotation being particularly expensive due to the stringent requirement for low-error and high-quality labels necessary for…

Computation and Language · Computer Science 2026-03-24 Antonio Purificato , Maria Sofia Bucarelli , Andrea Bacciu , Amin Mantrach , Fabrizio Silvestri

Multi-label learning (MLL) has gained attention for its ability to represent real-world data. Label Distribution Learning (LDL), an extension of MLL to learning from label distributions, faces challenges in collecting accurate label…

Machine Learning · Computer Science 2025-02-04 Zhiqiang Kou , Si Qin , Hailin Wang , Mingkun Xie , Shuo Chen , Yuheng Jia , Tongliang Liu , Masashi Sugiyama , Xin Geng

Named Entity Recognition (NER) or the extraction of concepts from clinical text is the task of identifying entities in text and slotting them into categories such as problems, treatments, tests, clinical departments, occurrences (such as…

Computation and Language · Computer Science 2022-08-31 Namrata Nath , Sang-Heon Lee , Ivan Lee

Sequence labeling is an important technique employed for many Natural Language Processing (NLP) tasks, such as Named Entity Recognition (NER), slot tagging for dialog systems and semantic parsing. Large-scale pre-trained language models…

Computation and Language · Computer Science 2020-12-14 Yaqing Wang , Subhabrata Mukherjee , Haoda Chu , Yuancheng Tu , Ming Wu , Jing Gao , Ahmed Hassan Awadallah

Cell detection in histopathology images is of great value in clinical practice. \textit{Convolutional neural networks} (CNNs) have been applied to cell detection to improve the detection accuracy, where cell annotations are required for…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Zipei Zhao , Fengqian Pang , Zhiwen Liu , Chuyang Ye

Sequence labeling is a fundamental framework for various natural language processing problems. Its performance is largely influenced by the annotation quality and quantity in supervised learning scenarios, and obtaining ground truth labels…

Computation and Language · Computer Science 2020-04-17 Ouyu Lan , Xiao Huang , Bill Yuchen Lin , He Jiang , Liyuan Liu , Xiang Ren

Due to the expensive costs of collecting labels in multi-label classification datasets, partially annotated multi-label classification has become an emerging field in computer vision. One baseline approach to this task is to assume…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Youngwook Kim , Jae Myung Kim , Jieun Jeong , Cordelia Schmid , Zeynep Akata , Jungwoo Lee

This paper proposes a novel training scheme for fast matching models in Search Ads, which is motivated by the real challenges in model training. The first challenge stems from the pursuit of high throughput, which prohibits the deployment…

Information Retrieval · Computer Science 2019-04-23 Xue Li , Zhipeng Luo , Hao Sun , Jianjin Zhang , Weihao Han , Xianqi Chu , Liangjie Zhang , Qi Zhang

Categorizing individual cells into one of many known cell type categories, also known as cell type annotation, is a critical step in the analysis of single-cell genomics data. The current process of annotation is time-intensive and…

Applications · Statistics 2021-11-25 Keshav Motwani , Rhonda Bacher , Aaron J. Molstad

Label noise is a critical factor that degrades the generalization performance of deep neural networks, thus leading to severe issues in real-world problems. Existing studies have employed strategies based on either loss or uncertainty to…

Machine Learning · Computer Science 2020-08-17 Wonyoung Shin , Jung-Woo Ha , Shengzhe Li , Yongwoo Cho , Hoyean Song , Sunyoung Kwon

Graph Neural Networks (GNNs) have been widely employed for semi-supervised node classification tasks on graphs. However, the performance of GNNs is significantly affected by label noise, that is, a small amount of incorrectly labeled nodes…

Machine Learning · Computer Science 2024-11-19 Rui Zhao , Bin Shi , Zhiming Liang , Jianfei Ruan , Bo Dong , Lu Lin

Large language models (LLMs) have advanced information extraction (IE) by enabling zero-shot and few-shot named entity recognition (NER), yet their generative outputs still show persistent and systematic errors. Despite progress through…

Computation and Language · Computer Science 2026-04-20 Siun Kim , Hyung-Jin Yoon

NLP datasets may still contain annotation errors, even when they are manually annotated. Researchers have attempted to develop methods to automatically reduce the adverse effect of errors in datasets. However, existing methods are…

Computation and Language · Computer Science 2025-02-04 Kohei Tsuji , Tatsuya Hiraoka , Yuchang Cheng , Tomoya Iwakura

Label noise is common in large real-world datasets, and its presence harms the training process of deep neural networks. Although several works have focused on the training strategies to address this problem, there are few studies that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Emeson Santana , Gustavo Carneiro , Filipe R. Cordeiro

Label learning is a fundamental task in machine learning that aims to construct intelligent models using labeled data, encompassing traditional single-label and multi-label classification models. Traditional methods typically rely on…

Machine Learning · Computer Science 2025-11-11 Chenxi Luoa , Zhuangzhuang Zhaoa , Zhaohong Denga , Te Zhangb

Named entity recognition is a fundamental task in natural language processing, identifying the span and category of entities in unstructured texts. The traditional sequence labeling methodology ignores the nested entities, i.e. entities…

Computation and Language · Computer Science 2022-10-24 Xueru Wen , Changjiang Zhou , Haotian Tang , Luguang Liang , Yu Jiang , Hong Qi