English
Related papers

Related papers: NER-BERT: A Pre-trained Model for Low-Resource Ent…

200 papers

Fine-tuning pre-trained language models has recently become a common practice in building NLP models for various tasks, especially few-shot tasks. We argue that under the few-shot setting, formulating fine-tuning closer to the pre-training…

Computation and Language · Computer Science 2022-11-01 Zihan Wang , Kewen Zhao , Zilong Wang , Jingbo Shang

In many scenarios, named entity recognition (NER) models severely suffer from unlabeled entity problem, where the entities of a sentence may not be fully annotated. Through empirical studies performed on synthetic datasets, we find two…

Computation and Language · Computer Science 2021-03-19 Yangming Li , Lemao Liu , Shuming Shi

Named entity recognition (NER) is the task to identify mentions of rigid designators from text belonging to predefined semantic types such as person, location, organization etc. NER always serves as the foundation for many natural language…

Computation and Language · Computer Science 2023-04-26 Jing Li , Aixin Sun , Jianglei Han , Chenliang Li

Named entity recognition (NER) has been one of the essential preliminary steps in modern NLP applications. This report focuses on implementing the NER task on finetuning two pretrained models: (i) an encoder-only model (BERT) with a simple…

Computation and Language · Computer Science 2026-05-19 Mei Jia

Supervised machine learning assumes the availability of fully-labeled data, but in many cases, such as low-resource languages, the only data available is partially annotated. We study the problem of Named Entity Recognition (NER) with…

Computation and Language · Computer Science 2019-09-23 Stephen Mayhew , Snigdha Chaturvedi , Chen-Tse Tsai , Dan Roth

Lately, instruction-based techniques have made significant strides in improving performance in few-shot learning scenarios. They achieve this by bridging the gap between pre-trained language models and fine-tuning for specific downstream…

Information Retrieval · Computer Science 2024-01-25 Hiranmai Sri Adibhatla , Pavan Baswani , Manish Shrivastava

Existing models for cross-domain named entity recognition (NER) rely on numerous unlabeled corpus or labeled NER training data in target domains. However, collecting data for low-resource target domains is not only expensive but also…

Computation and Language · Computer Science 2020-05-20 Zihan Liu , Genta Indra Winata , Pascale Fung

Most state-of-the-art models for named entity recognition (NER) rely on the availability of large amounts of labeled data, making them challenging to extend to new, lower-resourced languages. However, there are now several proposed…

Computation and Language · Computer Science 2019-08-27 Aditi Chaudhary , Jiateng Xie , Zaid Sheikh , Graham Neubig , Jaime G. Carbonell

This paper evaluates Few-Shot Prompting with Large Language Models for Named Entity Recognition (NER). Traditional NER systems rely on extensive labeled datasets, which are costly and time-consuming to obtain. Few-Shot Prompting or…

Information Retrieval · Computer Science 2024-09-05 Hédi Zeghidi , Ludovic Moncla

Recently, the development of pre-trained language models has brought natural language processing (NLP) tasks to the new state-of-the-art. In this paper we explore the efficiency of various pre-trained language models. We pre-train a list of…

Computation and Language · Computer Science 2023-07-27 Tong Guo

In recent years, the fine-tuned generative models have been proven more powerful than the previous tagging-based or span-based models on named entity recognition (NER) task. It has also been found that the information related to entities,…

Computation and Language · Computer Science 2024-06-12 Guochao Jiang , Ziqin Luo , Yuchen Shi , Dixuan Wang , Jiaqing Liang , Deqing Yang

State of the art Named Entity Recognition (NER) models have achieved an impressive ability to extract common phrases from text that belong to labels such as location, organization, time, and person. However, typical NER systems that rely on…

Computation and Language · Computer Science 2024-01-24 Alexandra Loessberg-Zahl

Supervised models trained to predict properties from representations have been achieving high accuracy on a variety of tasks. For instance, the BERT family seems to work exceptionally well on the downstream task from NER tagging to the…

Computation and Language · Computer Science 2020-12-22 Tejas Vaidhya , Ayush Kaushal

The amount of archaeological literature is growing rapidly. Until recently, these data were only accessible through metadata search. We implemented a text retrieval engine for a large archaeological text collection ($\sim 658$ Million…

Information Retrieval · Computer Science 2021-06-16 Alex Brandsen , Suzan Verberne , Karsten Lambers , Milco Wansleeben

Building named entity recognition (NER) models for languages that do not have much training data is a challenging task. While recent work has shown promising results on cross-lingual transfer from high-resource languages to low-resource…

Computation and Language · Computer Science 2019-09-10 Xiaolei Huang , Jonathan May , Nanyun Peng

Pre-trained language models such as BERT have been a key ingredient to achieve state-of-the-art results on a variety of tasks in natural language processing and, more recently, also in information retrieval.Recent research even claims that…

Information Retrieval · Computer Science 2022-05-03 Emma J. Gerritse , Faegheh Hasibi , Arjen P. de Vries

Named Entity Recognition (NER) is a fundamental task in the fields of natural language processing and information extraction. NER has been widely used as a standalone tool or an essential component in a variety of applications such as…

Computation and Language · Computer Science 2020-11-25 Vladislav Mikhailov , Tatiana Shavrina

Named entity recognition (NER) is an important research problem in natural language processing. There are three types of NER tasks, including flat, nested and discontinuous entity recognition. Most previous sequential labeling models are…

Computation and Language · Computer Science 2023-03-21 Ying Mo , Hongyin Tang , Jiahao Liu , Qifan Wang , Zenglin Xu , Jingang Wang , Wei Wu , Zhoujun Li

Recognizing entities in texts is a central need in many information-seeking scenarios, and indeed, Named Entity Recognition (NER) is arguably one of the most successful examples of a widely adopted NLP task and corresponding NLP technology.…

Computation and Language · Computer Science 2023-10-24 Uri Katz , Matan Vetzler , Amir DN Cohen , Yoav Goldberg

Named entity recognition (NER) is a vital task in spoken language understanding, which aims to identify mentions of named entities in text e.g., from transcribed speech. Existing neural models for NER rely mostly on dedicated word-level…

Computation and Language · Computer Science 2019-09-24 Abdalghani Abujabal , Judith Gaspers