中文
相关论文

相关论文: Validating Label Consistency in NER Data Annotatio…

200 篇论文

Human variation in labeling is often considered noise. Annotation projects for machine learning (ML) aim at minimizing human label variation, with the assumption to maximize data quality and in turn optimize and maximize machine learning…

计算与语言 · 计算机科学 2022-11-07 Barbara Plank

Label noise in datasets could significantly damage the performance and robustness of deep neural networks (DNNs) trained on these datasets. As the size of modern DNNs grows, there is a growing demand for automated tools for detecting such…

机器学习 · 计算机科学 2025-10-28 Dang Huu-Tien , Minh-Phuong Nguyen , Naoya Inoue

In supervised machine learning, use of correct labels is extremely important to ensure high accuracy. Unfortunately, most datasets contain corrupted labels. Machine learning models trained on such datasets do not generalize well. Thus,…

机器学习 · 计算机科学 2023-09-14 Chang Yue , Niraj K. Jha

Noisy labels are inevitable, even in well-annotated datasets. The detection of noisy labels is of significant importance to enhance the robustness of speaker recognition models. In this paper, we propose a novel noisy label detection…

音频与语音处理 · 电气工程与系统科学 2024-06-21 Yao Shen , Yingying Gao , Yaqian Hao , Chenguang Hu , Fulin Zhang , Junlan Feng , Shilei Zhang

Human annotation cost and time remain significant bottlenecks in Natural Language Processing (NLP), with test data annotation being particularly expensive due to the stringent requirement for low-error and high-quality labels necessary for…

计算与语言 · 计算机科学 2026-03-24 Antonio Purificato , Maria Sofia Bucarelli , Andrea Bacciu , Amin Mantrach , Fabrizio Silvestri

Multi-label learning (MLL) has gained attention for its ability to represent real-world data. Label Distribution Learning (LDL), an extension of MLL to learning from label distributions, faces challenges in collecting accurate label…

机器学习 · 计算机科学 2025-02-04 Zhiqiang Kou , Si Qin , Hailin Wang , Mingkun Xie , Shuo Chen , Yuheng Jia , Tongliang Liu , Masashi Sugiyama , Xin Geng

Named Entity Recognition (NER) or the extraction of concepts from clinical text is the task of identifying entities in text and slotting them into categories such as problems, treatments, tests, clinical departments, occurrences (such as…

计算与语言 · 计算机科学 2022-08-31 Namrata Nath , Sang-Heon Lee , Ivan Lee

Sequence labeling is an important technique employed for many Natural Language Processing (NLP) tasks, such as Named Entity Recognition (NER), slot tagging for dialog systems and semantic parsing. Large-scale pre-trained language models…

计算与语言 · 计算机科学 2020-12-14 Yaqing Wang , Subhabrata Mukherjee , Haoda Chu , Yuancheng Tu , Ming Wu , Jing Gao , Ahmed Hassan Awadallah

Cell detection in histopathology images is of great value in clinical practice. \textit{Convolutional neural networks} (CNNs) have been applied to cell detection to improve the detection accuracy, where cell annotations are required for…

计算机视觉与模式识别 · 计算机科学 2021-07-01 Zipei Zhao , Fengqian Pang , Zhiwen Liu , Chuyang Ye

Sequence labeling is a fundamental framework for various natural language processing problems. Its performance is largely influenced by the annotation quality and quantity in supervised learning scenarios, and obtaining ground truth labels…

计算与语言 · 计算机科学 2020-04-17 Ouyu Lan , Xiao Huang , Bill Yuchen Lin , He Jiang , Liyuan Liu , Xiang Ren

Due to the expensive costs of collecting labels in multi-label classification datasets, partially annotated multi-label classification has become an emerging field in computer vision. One baseline approach to this task is to assume…

计算机视觉与模式识别 · 计算机科学 2023-04-05 Youngwook Kim , Jae Myung Kim , Jieun Jeong , Cordelia Schmid , Zeynep Akata , Jungwoo Lee

This paper proposes a novel training scheme for fast matching models in Search Ads, which is motivated by the real challenges in model training. The first challenge stems from the pursuit of high throughput, which prohibits the deployment…

信息检索 · 计算机科学 2019-04-23 Xue Li , Zhipeng Luo , Hao Sun , Jianjin Zhang , Weihao Han , Xianqi Chu , Liangjie Zhang , Qi Zhang

Categorizing individual cells into one of many known cell type categories, also known as cell type annotation, is a critical step in the analysis of single-cell genomics data. The current process of annotation is time-intensive and…

应用统计 · 统计学 2021-11-25 Keshav Motwani , Rhonda Bacher , Aaron J. Molstad

Label noise is a critical factor that degrades the generalization performance of deep neural networks, thus leading to severe issues in real-world problems. Existing studies have employed strategies based on either loss or uncertainty to…

机器学习 · 计算机科学 2020-08-17 Wonyoung Shin , Jung-Woo Ha , Shengzhe Li , Yongwoo Cho , Hoyean Song , Sunyoung Kwon

Graph Neural Networks (GNNs) have been widely employed for semi-supervised node classification tasks on graphs. However, the performance of GNNs is significantly affected by label noise, that is, a small amount of incorrectly labeled nodes…

机器学习 · 计算机科学 2024-11-19 Rui Zhao , Bin Shi , Zhiming Liang , Jianfei Ruan , Bo Dong , Lu Lin

Large language models (LLMs) have advanced information extraction (IE) by enabling zero-shot and few-shot named entity recognition (NER), yet their generative outputs still show persistent and systematic errors. Despite progress through…

计算与语言 · 计算机科学 2026-04-20 Siun Kim , Hyung-Jin Yoon

NLP datasets may still contain annotation errors, even when they are manually annotated. Researchers have attempted to develop methods to automatically reduce the adverse effect of errors in datasets. However, existing methods are…

计算与语言 · 计算机科学 2025-02-04 Kohei Tsuji , Tatsuya Hiraoka , Yuchang Cheng , Tomoya Iwakura

Label noise is common in large real-world datasets, and its presence harms the training process of deep neural networks. Although several works have focused on the training strategies to address this problem, there are few studies that…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Emeson Santana , Gustavo Carneiro , Filipe R. Cordeiro

Label learning is a fundamental task in machine learning that aims to construct intelligent models using labeled data, encompassing traditional single-label and multi-label classification models. Traditional methods typically rely on…

机器学习 · 计算机科学 2025-11-11 Chenxi Luoa , Zhuangzhuang Zhaoa , Zhaohong Denga , Te Zhangb

Named entity recognition is a fundamental task in natural language processing, identifying the span and category of entities in unstructured texts. The traditional sequence labeling methodology ignores the nested entities, i.e. entities…

计算与语言 · 计算机科学 2022-10-24 Xueru Wen , Changjiang Zhou , Haotian Tang , Luguang Liang , Yu Jiang , Hong Qi