中文
相关论文

相关论文: Preserving Empirical Probabilities in BERT for Sma…

200 篇论文

Named Entity Recognition (NER) is a critical task that requires substantial annotated data, making it challenging in low-resource scenarios where label acquisition is expensive. While zero-shot and instruction-tuned approaches have made…

计算与语言 · 计算机科学 2025-10-21 Nanda Kumar Rengarajan , Jun Yan , Chun Wang

We study the effect of one type of imbalance often present in real-life multilingual classification datasets: an uneven distribution of labels across languages. We show evidence that fine-tuning a transformer-based Large Language Model…

计算与语言 · 计算机科学 2024-02-21 Vincent Jung , Lonneke van der Plas

This study evaluated the effect of BioBERT in medical text processing for the task of medical named entity recognition. Through comparative experiments with models such as BERT, ClinicalBERT, SciBERT, and BlueBERT, the results showed that…

计算与语言 · 计算机科学 2024-12-12 Jiacheng Hu , Runyuan Bao , Yang Lin , Hanchao Zhang , Yanlin Xiang

Labels noise refers to errors in training labels caused by cheap data annotation methods, such as web scraping or crowd-sourcing, which can be detrimental to the performance of supervised classifiers. Several methods have been proposed to…

计算与语言 · 计算机科学 2023-10-23 Maha Tufail Agro , Hanan Aldarmaki

Researchers must stay current in their fields by regularly reviewing academic literature, a task complicated by the daily publication of thousands of papers. Traditional multi-label text classification methods often ignore semantic…

计算与语言 · 计算机科学 2024-04-24 Darya Likhareva , Hamsini Sankaran , Sivakumar Thiyagarajan

Named Entity Recognition (NER) is a fundamental task in natural language processing. It remains a research hotspot due to its wide applicability across domains. Although recent advances in deep learning have significantly improved NER…

计算与语言 · 计算机科学 2025-08-12 Xiaobo Zhang , Congqing He , Ying He , Jian Peng , Dajie Fu , Tien-Ping Tan

Small and imbalanced datasets commonly seen in healthcare represent a challenge when training classifiers based on deep learning models. So motivated, we propose a novel framework based on BioBERT (Bidirectional Encoder Representations from…

计算与语言 · 计算机科学 2020-06-23 Shijing Si , Rui Wang , Jedrek Wosik , Hao Zhang , David Dov , Guoyin Wang , Ricardo Henao , Lawrence Carin

Learning invariant representations is an important requirement when training machine learning models that are driven by spurious correlations in the datasets. These spurious correlations, between input samples and the target labels, wrongly…

机器学习 · 计算机科学 2022-01-12 Vishnu Suresh Lokhande , Kihyuk Sohn , Jinsung Yoon , Madeleine Udell , Chen-Yu Lee , Tomas Pfister

Existing deep active learning algorithms achieve impressive sampling efficiency on natural language processing tasks. However, they exhibit several weaknesses in practice, including (a) inability to use uncertainty sampling with black-box…

计算与语言 · 计算机科学 2020-07-22 Haw-Shiuan Chang , Shankar Vembu , Sunil Mohan , Rheeya Uppaal , Andrew McCallum

The Biocreative VII Track-2 challenge consists of named entity recognition, entity-linking (or entity-normalization), and topic indexing tasks -- with entities and topics limited to chemicals for this challenge. Named entity recognition is…

计算与语言 · 计算机科学 2021-12-01 Virginia Adams , Hoo-Chang Shin , Carol Anderson , Bo Liu , Anas Abidin

Contrastive learning has become a popular solution for few-shot Name Entity Recognization (NER). The conventional configuration strives to reduce the distance between tokens with the same labels and increase the distance between tokens with…

计算与语言 · 计算机科学 2023-08-02 Mingchen Li , Yang Ye , Jeremy Yeung , Huixue Zhou , Huaiyuan Chu , Rui Zhang

We present a bi-encoder framework for named entity recognition (NER), which applies contrastive learning to map candidate text spans and entity types into the same vector representation space. Prior work predominantly approaches NER as…

计算与语言 · 计算机科学 2023-02-24 Sheng Zhang , Hao Cheng , Jianfeng Gao , Hoifung Poon

The state-of-the-art performance on entity resolution (ER) has been achieved by deep learning. However, deep models are usually trained on large quantities of accurately labeled training data, and can not be easily tuned towards a target…

机器学习 · 计算机科学 2022-04-12 Zhaoqiang Chen , Qun Chen , Youcef Nafa , Tianyi Duan , Wei Pan , Lijun Zhang , Zhanhuai Li

Named Entity Recognition (NER) in historical texts presents unique challenges due to non-standardized language, archaic orthography, and nested or overlapping entities. This study benchmarks a diverse set of NER approaches, ranging from…

计算与语言 · 计算机科学 2025-06-04 Ludovic Moncla , Hédi Zeghidi

In named entity recognition, we often don't have a large in-domain training corpus or a knowledge base with adequate coverage to train a model directly. In this paper, we propose a method where, given training data in a related domain with…

计算与语言 · 计算机科学 2016-11-01 Lizhen Qu , Gabriela Ferraro , Liyuan Zhou , Weiwei Hou , Timothy Baldwin

Named entity recognition (NER) systems that perform well require task-related and manually annotated datasets. However, they are expensive to develop, and are thus limited in size. As there already exists a large number of NER datasets that…

计算与语言 · 计算机科学 2019-04-23 Nargiza Nosirova , Mingbin Xu , Hui Jiang

The problem of named entity recognition in the medical/clinical domain has gained increasing attention do to its vital role in a wide range of clinical decision support applications. The identification of complete and correct term span is…

计算与语言 · 计算机科学 2013-10-03 Azad Dehghan

Multi-label text classification is a challenging task because it requires capturing label dependencies. It becomes even more challenging when class distribution is long-tailed. Resampling and re-weighting are common approaches used for…

计算与语言 · 计算机科学 2021-10-19 Yi Huang , Buse Giledereli , Abdullatif Köksal , Arzucan Özgür , Elif Ozkirimli

Specialized transformer-based models for encoding tabular data have gained interest in academia. Although tabular data is omnipresent in industry, applications of table transformers are still missing. In this paper, we study how these…

人工智能 · 计算机科学 2022-09-30 Aneta Koleva , Martin Ringsquandl , Mark Buckley , Rakebul Hasan , Volker Tresp

Sentiment classification in short text datasets faces significant challenges such as class imbalance, limited training samples, and the inherent subjectivity of sentiment labels -- issues that are further intensified by the limited context…

计算与语言 · 计算机科学 2025-09-08 Julius Neumann , Robert Lange , Yuni Susanti , Michael Färber