English
Related papers

Related papers: CROP: Zero-shot Cross-lingual Named Entity Recogni…

200 papers

Transferring representations from large supervised tasks to downstream tasks has shown promising results in AI fields such as Computer Vision and Natural Language Processing (NLP). In parallel, the recent progress in Machine Translation…

Computation and Language · Computer Science 2018-09-14 Akiko Eriguchi , Melvin Johnson , Orhan Firat , Hideto Kazawa , Wolfgang Macherey

Named Entity Recognition (NER) is an essential precursor task for many natural language applications, such as relation extraction or event extraction. Much of the NER research has been done on datasets with few classes of entity types (e.g.…

Computation and Language · Computer Science 2020-09-17 Parul Awasthy , Taesun Moon , Jian Ni , Radu Florian

In this work, we explore the way to perform named entity recognition (NER) using only unlabeled data and named entity dictionaries. To this end, we formulate the task as a positive-unlabeled (PU) learning problem and accordingly propose a…

Computation and Language · Computer Science 2019-06-12 Minlong Peng , Xiaoyu Xing , Qi Zhang , Jinlan Fu , Xuanjing Huang

This paper evaluates Few-Shot Prompting with Large Language Models for Named Entity Recognition (NER). Traditional NER systems rely on extensive labeled datasets, which are costly and time-consuming to obtain. Few-Shot Prompting or…

Information Retrieval · Computer Science 2024-09-05 Hédi Zeghidi , Ludovic Moncla

Multilingual BERT (mBERT), a language model pre-trained on large multilingual corpora, has impressive zero-shot cross-lingual transfer capabilities and performs surprisingly well on zero-shot POS tagging and Named Entity Recognition (NER),…

Computation and Language · Computer Science 2022-05-18 Beiduo Chen , Wu Guo , Quan Liu , Kun Tao

Semantic segmentation has a broad range of applications, but its real-world impact has been significantly limited by the prohibitive annotation costs necessary to enable deployment. Segmentation methods that forgo supervision can side-step…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Gyungin Shin , Weidi Xie , Samuel Albanie

Prompt-based methods have been successfully applied to multilingual pretrained language models for zero-shot cross-lingual understanding. However, most previous studies primarily focused on sentence-level classification tasks, and only a…

Computation and Language · Computer Science 2024-03-14 Bolei Ma , Ercong Nie , Shuzhou Yuan , Helmut Schmid , Michael Färber , Frauke Kreuter , Hinrich Schütze

We present a bi-encoder framework for named entity recognition (NER), which applies contrastive learning to map candidate text spans and entity types into the same vector representation space. Prior work predominantly approaches NER as…

Computation and Language · Computer Science 2023-02-24 Sheng Zhang , Hao Cheng , Jianfeng Gao , Hoifung Poon

With the development of foundation models such as large language models, zero-shot transfer learning has become increasingly significant. This is highlighted by the generative capabilities of NLP models like GPT-4, and the retrieval-based…

Machine Learning · Computer Science 2024-06-25 Yuhan Li , Peisong Wang , Zhixun Li , Jeffrey Xu Yu , Jia Li

Pre-trained multilingual language encoders, such as multilingual BERT and XLM-R, show great potential for zero-shot cross-lingual transfer. However, these multilingual encoders do not precisely align words and phrases across languages.…

Computation and Language · Computer Science 2021-09-13 Kuan-Hao Huang , Wasi Uddin Ahmad , Nanyun Peng , Kai-Wei Chang

The aim of Named Entity Recognition (NER) is to identify references of named entities in unstructured documents, and to classify them into pre-defined semantic categories. NER often aids from added background knowledge in the form of…

Computation and Language · Computer Science 2015-11-24 S. Thenmalar , J. Balaji , T. V. Geetha

Multilingual BERT (mBERT) has shown reasonable capability for zero-shot cross-lingual transfer when fine-tuned on downstream tasks. Since mBERT is not pre-trained with explicit cross-lingual supervision, transfer performance can further be…

Computation and Language · Computer Science 2020-10-01 Saurabh Kulshreshtha , José Luis Redondo-García , Ching-Yun Chang

Traditional approaches to Named Entity Recognition (NER) frame the task into a BIO sequence labeling problem. Although these systems often excel in the downstream task at hand, they require extensive annotated data and struggle to…

Computation and Language · Computer Science 2024-11-15 Andrew Zamai , Leonardo Rigutini , Marco Maggini , Andrea Zugarini

Named entity recognition (NER) for identifying proper nouns in unstructured text is one of the most important and fundamental tasks in natural language processing. However, despite the widespread use of NER models, they still require a…

Computation and Language · Computer Science 2020-12-23 Zhifeng Hao , Di Lv , Zijian Li , Ruichu Cai , Wen Wen , Boyan Xu

Recent approaches have shown that training deep neural networks directly on large-scale image-text pair collections enables zero-shot transfer on various recognition tasks. One central issue is how this can be generalized to object…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Johnathan Xie , Shuai Zheng

Recognizing entities in texts is a central need in many information-seeking scenarios, and indeed, Named Entity Recognition (NER) is arguably one of the most successful examples of a widely adopted NLP task and corresponding NLP technology.…

Computation and Language · Computer Science 2023-10-24 Uri Katz , Matan Vetzler , Amir DN Cohen , Yoav Goldberg

Information extraction is an important task in NLP, enabling the automatic extraction of data for relational database filling. Historically, research and data was produced for English text, followed in subsequent years by datasets in…

Computation and Language · Computer Science 2019-12-13 Taesun Moon , Parul Awasthy , Jian Ni , Radu Florian

Large multilingual language models such as mBERT or XLM-R enable zero-shot cross-lingual transfer in various IR and NLP tasks. Cao et al. (2020) proposed a data- and compute-efficient method for cross-lingual adjustment of mBERT that uses a…

Computation and Language · Computer Science 2023-11-01 Pavel Efimov , Leonid Boytsov , Elena Arslanova , Pavel Braslavski

Continual Named Entity Recognition (CNER) is a burgeoning area, which involves updating an existing model by incorporating new entity types sequentially. Nevertheless, continual learning approaches are often severely afflicted by…

Computation and Language · Computer Science 2023-10-24 Duzhen Zhang , Wei Cong , Jiahua Dong , Yahan Yu , Xiuyi Chen , Yonggang Zhang , Zhen Fang

Named Entity Recognition (NER) involves identifying and categorizing named entities within textual data. Despite its significance, NER research has often overlooked low-resource languages like Myanmar (Burmese), primarily due to the lack of…

Computation and Language · Computer Science 2025-04-08 Kaung Lwin Thant , Kwankamol Nongpong , Ye Kyaw Thu , Thura Aung , Khaing Hsu Wai , Thazin Myint Oo