English
Related papers

Related papers: Cross-Lingual Named Entity Recognition Using Paral…

200 papers

Prior works in cross-lingual named entity recognition (NER) with no/little labeled data fall into two primary categories: model transfer based and data transfer based methods. In this paper we find that both method types can complement each…

Computation and Language · Computer Science 2020-07-16 Qianhui Wu , Zijia Lin , Börje F. Karlsson , Biqing Huang , Jian-Guang Lou

To better tackle the named entity recognition (NER) problem on languages with little/no labeled data, cross-lingual NER must effectively leverage knowledge learned from source languages with rich labeled data. Previous works on…

Computation and Language · Computer Science 2020-07-16 Qianhui Wu , Zijia Lin , Börje F. Karlsson , Jian-Guang Lou , Biqing Huang

Large language models (LLMs) allow us to generate high-quality human-like text. One interesting task in natural language processing (NLP) is named entity recognition (NER), which seeks to detect mentions of relevant information in…

Computation and Language · Computer Science 2024-06-10 Fabián Villena , Luis Miranda , Claudio Aracena

Contextual word embeddings (e.g. GPT, BERT, ELMo, etc.) have demonstrated state-of-the-art performance on various NLP tasks. Recent work with the multilingual version of BERT has shown that the model performs very well in zero-shot and…

Computation and Language · Computer Science 2020-03-23 Phillip Keung , Yichao Lu , Vikas Bhardwaj

Named Entity Recognition (NER) involves the identification and classification of named entities in unstructured text into predefined classes. NER in languages with limited resources, like French, is still an open problem due to the lack of…

Computation and Language · Computer Science 2022-12-08 Arjun Choudhry , Pankaj Gupta , Inder Khatri , Aaryan Gupta , Maxime Nicol , Marie-Jean Meurs , Dinesh Kumar Vishwakarma

While end-to-end neural machine translation (NMT) has made remarkable progress recently, NMT systems only rely on parallel corpora for parameter estimation. Since parallel corpora are usually limited in quantity, quality, and coverage,…

Computation and Language · Computer Science 2016-12-13 Yong Cheng , Wei Xu , Zhongjun He , Wei He , Hua Wu , Maosong Sun , Yang Liu

Large Language Models (LLMs) excel in many Natural Language Processing (NLP) tasks through in-context learning but often under-perform in Named Entity Recognition (NER), especially for lower-resource languages like Portuguese. While…

Machine Learning · Computer Science 2025-12-12 João Lucas Luz Lima Sarcinelli , Diego Furtado Silva

State-of-the-art named entity recognition systems rely heavily on hand-crafted features and domain-specific knowledge in order to learn effectively from the small, supervised training corpora that are available. In this paper, we introduce…

Computation and Language · Computer Science 2016-04-08 Guillaume Lample , Miguel Ballesteros , Sandeep Subramanian , Kazuya Kawakami , Chris Dyer

Despite the fact that large-scale Language Models (LLM) have achieved SOTA performances on a variety of NLP tasks, its performance on NER is still significantly below supervised baselines. This is due to the gap between the two tasks the…

Computation and Language · Computer Science 2023-10-10 Shuhe Wang , Xiaofei Sun , Xiaoya Li , Rongbin Ouyang , Fei Wu , Tianwei Zhang , Jiwei Li , Guoyin Wang

Cross-domain NER is a practical yet challenging problem since the data scarcity in the real-world scenario. A common practice is first to learn a NER model in a rich-resource general domain and then adapt the model to specific domains. Due…

Computation and Language · Computer Science 2024-08-09 Junhao Zheng , Haibin Chen , Qianli Ma

Cross-language pre-trained models such as multilingual BERT (mBERT) have achieved significant performance in various cross-lingual downstream NLP tasks. This paper proposes a multi-level contrastive learning (ML-CTL) framework to further…

Computation and Language · Computer Science 2022-03-01 Beiduo Chen , Wu Guo , Bin Gu , Quan Liu , Yongchao Wang

Building real-world complex Named Entity Recognition (NER) systems is a challenging task. This is due to the complexity and ambiguity of named entities that appear in various contexts such as short input sentences, emerging entities, and…

Computation and Language · Computer Science 2022-04-29 Abdellah El Mekki , Abdelkader El Mahdaouy , Mohammed Akallouch , Ismail Berrada , Ahmed Khoumsi

A significant shortcoming of current state-of-the-art (SOTA) named-entity recognition (NER) systems is their lack of generalization to unseen domains, which poses a major problem since obtaining labeled data for NER in a new domain is…

Artificial Intelligence · Computer Science 2021-11-16 Nguyen Van Hoang , Soeren Hougaard Mulvad , Dexter Neo Yuan Rong , Yang Yue

Accurate alignment between languages is fundamental for improving cross-lingual pre-trained language models (XLMs). Motivated by the natural phenomenon of code-switching (CS) in multilingual speakers, CS has been used as an effective data…

Computation and Language · Computer Science 2023-02-14 Chenxi Whitehouse , Fenia Christopoulou , Ignacio Iacobacci

Existing models for cross-domain named entity recognition (NER) rely on numerous unlabeled corpus or labeled NER training data in target domains. However, collecting data for low-resource target domains is not only expensive but also…

Computation and Language · Computer Science 2020-05-20 Zihan Liu , Genta Indra Winata , Pascale Fung

In cross-lingual named entity recognition (NER), self-training is commonly used to bridge the linguistic gap by training on pseudo-labeled target-language data. However, due to sub-optimal performance on target languages, the pseudo labels…

Computation and Language · Computer Science 2023-06-06 Ran Zhou , Xin Li , Lidong Bing , Erik Cambria , Chunyan Miao

Biomedical Named Entity Recognition (NER) is a fundamental task of Biomedical Natural Language Processing for extracting relevant information from biomedical texts, such as clinical records, scientific publications, and electronic health…

Computation and Language · Computer Science 2023-12-27 Fahime Shahrokh , Nasser Ghadiri , Rasoul Samani , Milad Moradi

Recently, several specialized instruction-tuned Large Language Models (LLMs) for Named Entity Recognition (NER) have emerged. Compared to traditional NER approaches, these models have demonstrated strong generalization capabilities.…

Computation and Language · Computer Science 2024-09-19 Andrew Zamai , Andrea Zugarini , Leonardo Rigutini , Marco Ernandes , Marco Maggini

In this work, we study the problem of named entity recognition (NER) in a low resource scenario, focusing on few-shot and zero-shot settings. Built upon large-scale pre-trained language models, we propose a novel NER framework, namely…

Computation and Language · Computer Science 2021-09-14 Yaqing Wang , Haoda Chu , Chao Zhang , Jing Gao

Named Entity Recognition (NER) in code-mixed text, particularly Hindi-English (Hinglish), presents unique challenges due to informal structure, transliteration, and frequent language switching. This study conducts a comparative evaluation…

Computation and Language · Computer Science 2025-09-03 Mayur Shirke , Amey Shembade , Pavan Thorat , Madhushri Wagh , Raviraj Joshi