中文
相关论文

相关论文: Preserving Empirical Probabilities in BERT for Sma…

200 篇论文

Named entity recognition (NER) is frequently addressed as a sequence classification task where each input consists of one sentence of text. It is nevertheless clear that useful information for the task can often be found outside of the…

计算与语言 · 计算机科学 2020-12-18 Jouni Luoma , Sampo Pyysalo

Masked Language Modeling (MLM) is widely used to pretrain language models. The standard random masking strategy in MLM causes the pre-trained language models (PLMs) to be biased toward high-frequency tokens. Representation learning of rare…

计算与语言 · 计算机科学 2023-05-25 Linhan Zhang , Qian Chen , Wen Wang , Chong Deng , Xin Cao , Kongzhang Hao , Yuxin Jiang , Wei Wang

Entity resolution (ER) is the process of identifying records that refer to the same entities within one or across multiple databases. Numerous techniques have been developed to tackle ER challenges over the years, with recent emphasis…

数据库 · 计算机科学 2023-11-14 George Papadakis , Nishadi Kirielle , Peter Christen , Themis Palpanas

Large pre-trained sentence encoders like BERT start a new chapter in natural language processing. A common practice to apply pre-trained BERT to sequence classification tasks (e.g., classification of sentences or sentence pairs) is by…

计算与语言 · 计算机科学 2020-02-26 Wenxuan Zhou , Junyi Du , Xiang Ren

Data augmentation is an effective solution to data scarcity in low-resource scenarios. However, when applied to token-level tasks such as NER, data augmentation methods often suffer from token-label misalignment, which leads to…

计算与语言 · 计算机科学 2022-03-21 Ran Zhou , Xin Li , Ruidan He , Lidong Bing , Erik Cambria , Luo Si , Chunyan Miao

Interest in solving table interpretation tasks has grown over the years, yet it still relies on existing datasets that may be overly simplified. This is potentially reducing the effectiveness of the dataset for thorough evaluation and…

人工智能 · 计算机科学 2025-05-05 Aneta Koleva , Martin Ringsquandl , Ahmed Hatem , Thomas Runkler , Volker Tresp

Continual Learning for Named Entity Recognition (CL-NER) aims to learn a growing number of entity types over time from a stream of data. However, simply learning Other-Class in the same way as new entity types amplifies the catastrophic…

计算与语言 · 计算机科学 2022-10-11 Junhao Zheng , Zhanxian Liang , Haibin Chen , Qianli Ma

Transductive graph-based semi-supervised learning methods usually build an undirected graph utilizing both labeled and unlabeled samples as vertices. Those methods propagate label information of labeled samples to neighbors through their…

机器学习 · 计算机科学 2013-12-25 Fengqi Li , Chuang Yu , Nanhai Yang , Feng Xia , Guangming Li , Fatemeh Kaveh-Yazdy

For languages with no annotated resources, transferring knowledge from rich-resource languages is an effective solution for named entity recognition (NER). While all existing methods directly transfer from source-learned model to a target…

计算与语言 · 计算机科学 2020-07-16 Qianhui Wu , Zijia Lin , Guoxin Wang , Hui Chen , Börje F. Karlsson , Biqing Huang , Chin-Yew Lin

Label errors are a common issue in machine learning datasets, particularly for tasks such as Named Entity Recognition. Such label errors might hurt model training, affect evaluation results, and lead to an inaccurate assessment of model…

计算与语言 · 计算机科学 2025-03-11 Mashael Al-Duwais , Hend Al-Khalifa , Abdulmalik Al-Salman

With increasing applications of semantic segmentation, numerous datasets have been proposed in the past few years. Yet labeling remains expensive, thus, it is desirable to jointly train models across aggregations of datasets to enhance data…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Dongwan Kim , Yi-Hsuan Tsai , Yumin Suh , Masoud Faraki , Sparsh Garg , Manmohan Chandraker , Bohyung Han

Traditional information retrieval treats named entity recognition as a pre-indexing corpus annotation task, allowing entity tags to be indexed and used during search. Named entity taggers themselves are typically trained on thousands or…

信息检索 · 计算机科学 2018-06-14 John Foley , Sheikh Muhammad Sarwar , James Allan

Biomedical entity linking (EL) consists of named entity recognition (NER) and named entity disambiguation (NED). EL models are trained on corpora labeled by a predefined KB. However, it is a common scenario that only entities within a…

计算与语言 · 计算机科学 2023-06-06 Hongyi Yuan , Keming Lu , Zheng Yuan

Named Entity Recognition (NER) is often the first step towards automated Knowledge Base (KB) generation from raw text. In this work, we assess the bias in various Named Entity Recognition (NER) systems for English across different…

计算与语言 · 计算机科学 2020-08-11 Shubhanshu Mishra , Sijun He , Luca Belli

Automated Machine Learning has grown very successful in automating the time-consuming, iterative tasks of machine learning model development. However, current methods struggle when the data is imbalanced. Since many real-world datasets are…

机器学习 · 计算机科学 2022-11-02 Prabhant Singh , Joaquin Vanschoren

In this study, we consider classification problems based on neural networks in data-imbalanced environment. Learning from an imbalanced data set is one of the most important and practical problems in the field of machine learning. A…

机器学习 · 统计学 2019-12-02 Muneki Yasuda , Seishirou Ueno

Named entity recognition is a key component of Information Extraction (IE), particularly in scientific domains such as biomedicine and chemistry, where large language models (LLMs), e.g., ChatGPT, fall short. We investigate the…

计算与语言 · 计算机科学 2024-04-02 Hongyi Liu , Qingyun Wang , Payam Karisani , Heng Ji

Biomedical Named Entity Recognition presents significant challenges due to the complexity of biomedical terminology and inconsistencies in annotation across datasets. This paper introduces SRU-NER (Slot-based Recurrent Unit NER), a novel…

计算与语言 · 计算机科学 2025-07-25 João Ruano , Gonçalo M. Correia , Leonor Barreiros , Afonso Mendes

Unsupervised pretraining is an integral part of many natural language processing systems, and transfer learning with language models has achieved remarkable results in many downstream tasks. In the clinical application of medical code…

计算与语言 · 计算机科学 2022-06-03 Shaoxiong Ji , Matti Hölttä , Pekka Marttinen

The aim of Active Learning is to select the most informative samples from an unlabelled set of data. This is useful in cases where the amount of data is large and labelling is expensive, such as in machine vision or medical imaging. Two…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Julien Combes , Alexandre Derville , Jean-François Coeurjolly