中文
相关论文

相关论文: Effective Use of Bidirectional Language Modeling f…

200 篇论文

Cross-lingual Named Entity Recognition (NER) leverages knowledge transfer between languages to identify and classify named entities, making it particularly useful for low-resource languages. We show that the data-based cross-lingual…

计算与语言 · 计算机科学 2025-02-03 Andrei Politov , Oleh Shkalikov , René Jäkel , Michael Färber

While large-scale training data is fundamental for developing capable large language models (LLMs), strategically selecting high-quality data has emerged as a critical approach to enhance training efficiency and reduce computational costs.…

机器学习 · 计算机科学 2025-07-23 Yang Yu , Kai Han , Hang Zhou , Yehui Tang , Kaiqi Huang , Yunhe Wang , Dacheng Tao

Recent multilingual pre-trained language models have achieved remarkable zero-shot performance, where the model is only finetuned on one source language and directly evaluated on target languages. In this work, we propose a self-learning…

计算与语言 · 计算机科学 2021-09-24 Liyan Xu , Xuchao Zhang , Xujiang Zhao , Haifeng Chen , Feng Chen , Jinho D. Choi

Data augmentation is an effective solution to data scarcity in low-resource scenarios. However, when applied to token-level tasks such as NER, data augmentation methods often suffer from token-label misalignment, which leads to…

计算与语言 · 计算机科学 2022-03-21 Ran Zhou , Xin Li , Ruidan He , Lidong Bing , Erik Cambria , Luo Si , Chunyan Miao

Named entity recognition (NER) is a fundamental task in natural language processing that involves identifying and classifying entities in sentences into pre-defined types. It plays a crucial role in various research fields, including entity…

计算与语言 · 计算机科学 2024-04-29 Dongsheng Wang , Xiaoqin Feng , Zeming Liu , Chuan Wang

Named Entity Recognition (NER) is a machine learning task that traditionally relies on supervised learning and annotated data. Acquiring such data is often a challenge, particularly in specialized fields like medical, legal, and financial…

Continual Named Entity Recognition (CNER) is a burgeoning area, which involves updating an existing model by incorporating new entity types sequentially. Nevertheless, continual learning approaches are often severely afflicted by…

计算与语言 · 计算机科学 2023-10-24 Duzhen Zhang , Wei Cong , Jiahua Dong , Yahan Yu , Xiuyi Chen , Yonggang Zhang , Zhen Fang

Despite the advances in digital healthcare systems offering curated structured knowledge, much of the critical information still lies in large volumes of unlabeled and unstructured clinical texts. These texts, which often contain protected…

Machine learning-based multi-label medical text classifications can be used to enhance the understanding of the human body and aid the need for patient care. We present a broad study on clinical natural language processing techniques to…

信息检索 · 计算机科学 2020-04-02 Vithya Yogarajan , Jacob Montiel , Tony Smith , Bernhard Pfahringer

Biomedical entity linking (BEL) is the task of grounding entity mentions to a knowledge base (KB). A popular approach to the task are name-based methods, i.e. those identifying the most appropriate name in the KB for a given mention, either…

计算与语言 · 计算机科学 2024-01-11 Samuele Garda , Ulf Leser

This paper presents a framework for Named Entity Recognition (NER) leveraging the Bidirectional Encoder Representations from Transformers (BERT) model in natural language processing (NLP). NER is a fundamental task in NLP with broad…

计算与语言 · 计算机科学 2025-05-06 Mo Sun , Siheng Xiong , Yuankai Cai , Bowen Zuo

We focus on named entity recognition (NER) for Chinese social media. With massive unlabeled text and quite limited labelled corpus, we propose a semi-supervised learning model based on B-LSTM neural network. To take advantage of traditional…

计算与语言 · 计算机科学 2017-04-12 Hangfeng He , Xu Sun

Deep learning has yielded state-of-the-art performance on many natural language processing tasks including named entity recognition (NER). However, this typically requires large amounts of labeled data. In this work, we demonstrate that the…

计算与语言 · 计算机科学 2018-02-06 Yanyao Shen , Hyokun Yun , Zachary C. Lipton , Yakov Kronrod , Animashree Anandkumar

This paper addresses the challenges posed by the unstructured nature and high-dimensional semantic complexity of electronic health record texts. A deep learning method based on attention mechanisms is proposed to achieve unified modeling…

计算与语言 · 计算机科学 2025-07-03 Ting Xu , Xiaoxiao Deng , Xiandong Meng , Haifeng Yang , Yan Wu

We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train deep bidirectional…

计算与语言 · 计算机科学 2019-05-28 Jacob Devlin , Ming-Wei Chang , Kenton Lee , Kristina Toutanova

This paper investigates the problem of Named Entity Recognition (NER) for extreme low-resource languages with only a few hundred tagged data samples. NER is a fundamental task in Natural Language Processing (NLP). A critical driver…

计算与语言 · 计算机科学 2022-12-20 Shashank Sonkar , Zichao Wang , Richard G. Baraniuk

Biomedical entity linking aims to map biomedical mentions, such as diseases and drugs, to standard entities in a given knowledge base. The specific challenge in this context is that the same biomedical entity can have a wide range of names,…

计算与语言 · 计算机科学 2021-05-25 Lihu Chen , Gaël Varoquaux , Fabian M. Suchanek

Electronic Health Records (EHRs) have become the primary form of medical data-keeping across the United States. Federal law restricts the sharing of any EHR data that contains protected health information (PHI). De-identification, the…

计算与语言 · 计算机科学 2021-03-26 Abdullah Ahmed , Adeel Abbasi , Carsten Eickhoff

With the fast development of Deep Learning techniques, Named Entity Recognition (NER) is becoming more and more important in the information extraction task. The greatest difficulty that the NER task faces is to keep the detectability even…

计算与语言 · 计算机科学 2024-01-23 Xin Chen , Qi Zhao , Xinyang Liu

Semantic role labeling is a crucial task in natural language processing, enabling better comprehension of natural language. However, the lack of annotated data in multiple languages has posed a challenge for researchers. To address this, a…

计算与语言 · 计算机科学 2024-08-29 Mohammad Ebrahimi , Behrouz Minaei Bidgoli , Nasim Khozouei