中文
相关论文

相关论文: Distilling Named Entity Recognition Models for End…

200 篇论文

Pre-trained Language Models (PLMs) have been successful for a wide range of natural language processing (NLP) tasks. The state-of-the-art of PLMs, however, are extremely large to be used on edge devices. As a result, the topic of model…

Fine-tuning pre-trained language models like BERT has become an effective way in NLP and yields state-of-the-art results on many downstream tasks. Recent studies on adapting BERT to new tasks mainly focus on modifying the model structure,…

计算与语言 · 计算机科学 2020-02-25 Yige Xu , Xipeng Qiu , Ligao Zhou , Xuanjing Huang

We present a statistical model for German medical natural language processing trained for named entity recognition (NER) as an open, publicly available model. The work serves as a refined successor to our first GERNERMED model which is…

计算与语言 · 计算机科学 2022-10-11 Johann Frei , Ludwig Frei-Stuber , Frank Kramer

Large language models (LLMs) have demonstrated dominating performance in many NLP tasks, especially on generative tasks. However, they often fall short in some information extraction tasks, particularly those requiring domain-specific…

计算与语言 · 计算机科学 2023-09-22 Junyi Bian , Jiaxuan Zheng , Yuyi Zhang , Shanfeng Zhu

Nowadays, many Natural Language Processing (NLP) tasks see the demand for incorporating knowledge external to the local information to further improve the performance. However, there is little related work on Named Entity Recognition (NER),…

计算与语言 · 计算机科学 2023-03-07 Chiao-Wei Hsu , Keh-Yih Su

How can large language models (LLMs) process and translate endangered languages? Many languages lack a large corpus to train a decent LLM; therefore existing LLMs rarely perform well in unseen, endangered languages. On the contrary, we…

计算与语言 · 计算机科学 2024-11-13 Kexun Zhang , Yee Man Choi , Zhenqiao Song , Taiqi He , William Yang Wang , Lei Li

Named Entity Recognition seeks to extract substrings within a text that name real-world objects and to determine their type (for example, whether they refer to persons or organizations). In this survey, we first present an overview of…

计算与语言 · 计算机科学 2024-12-23 Imed Keraghel , Stanislas Morbieu , Mohamed Nadif

This work presents our participation in the EvalLLM 2025 challenge on biomedical Named Entity Recognition (NER) and health event extraction in French (few-shot setting). For NER, we propose three approaches combining large language models…

The ability to handle various emotion labels without dedicated training is crucial for building adaptable Emotion Recognition (ER) systems. Conventional ER models rely on training using fixed label sets and struggle to generalize beyond…

计算与语言 · 计算机科学 2025-05-26 Minxue Niu , Emily Mower Provost

Deep language models such as BERT pre-trained on large corpus have given a huge performance boost to the state-of-the-art information retrieval ranking systems. Knowledge embedded in such models allows them to pick up complex matching…

信息检索 · 计算机科学 2020-07-23 Luyu Gao , Zhuyun Dai , Jamie Callan

Spoken named entity recognition (NER) aims to identify named entities from speech, playing an important role in speech processing. New named entities appear every day, however, annotating their Spoken NER data is costly. In this paper, we…

计算与语言 · 计算机科学 2024-12-30 Jiawei Yu , Xiang Geng , Yuang Li , Mengxin Ren , Wei Tang , Jiahuan Li , Zhibin Lan , Min Zhang , Hao Yang , Shujian Huang , Jinsong Su

Large language models (LLMs) have demonstrated remarkable generalizability, such as understanding arbitrary entities and relations. Instruction tuning has proven effective for distilling LLMs into more cost-efficient models such as Alpaca…

计算与语言 · 计算机科学 2024-01-22 Wenxuan Zhou , Sheng Zhang , Yu Gu , Muhao Chen , Hoifung Poon

The ability to transmit and receive complex information via language is unique to humans and is the basis of traditions, culture and versatile social interactions. Through the disruptive introduction of transformer based large language…

计算与语言 · 计算机科学 2024-05-06 Patrick Krauss , Jannik Hösch , Claus Metzner , Andreas Maier , Peter Uhrig , Achim Schilling

The exponential growth of data generated on the Internet in the current information age is a driving force for the digital economy. Extraction of information is the major value in an accumulated big data. Big data dependency on statistical…

As Transfer Learning from large-scale pre-trained models becomes more prevalent in Natural Language Processing (NLP), operating these large models in on-the-edge and/or under constrained computational training or inference budgets remains…

计算与语言 · 计算机科学 2020-03-03 Victor Sanh , Lysandre Debut , Julien Chaumond , Thomas Wolf

Despite the fact that large-scale Language Models (LLM) have achieved SOTA performances on a variety of NLP tasks, its performance on NER is still significantly below supervised baselines. This is due to the gap between the two tasks the…

计算与语言 · 计算机科学 2023-10-10 Shuhe Wang , Xiaofei Sun , Xiaoya Li , Rongbin Ouyang , Fei Wu , Tianwei Zhang , Jiwei Li , Guoyin Wang

As multiple crises threaten the sustainability of our societies and pose at risk the planetary boundaries, complex challenges require timely, updated, and usable information. Natural-language processing (NLP) tools enhance and expand data…

Named Entity Recognition(NER) for low-resource languages aims to produce robust systems for languages where there is limited labeled training data available, and has been an area of increasing interest within NLP. Data augmentation for…

计算与语言 · 计算机科学 2026-02-16 Gaurav Kamath , Sowmya Vajjala

We propose a new Named entity recognition (NER) method to effectively make use of the results of Part-of-speech (POS) tagging, Chinese word segmentation (CWS) and parsing while avoiding NER error caused by POS tagging error. This paper…

计算与语言 · 计算机科学 2021-01-28 Xiao Fu , Guijun Zhang

Large Language Models (LLMs), such as GPT-4 and Llama 2, show remarkable proficiency in a wide range of natural language processing (NLP) tasks. Despite their effectiveness, the high costs associated with their use pose a challenge. We…

计算与语言 · 计算机科学 2024-03-26 Bálint Csanády , Lajos Muzsai , Péter Vedres , Zoltán Nádasdy , András Lukács