English
Related papers

Related papers: A Multi-way Parallel Named Entity Annotated Corpus…

200 papers

Recently, neural methods have achieved state-of-the-art (SOTA) results in Named Entity Recognition (NER) tasks for many languages without the need for manually crafted features. However, these models still require manually annotated…

Computation and Language · Computer Science 2019-11-25 M Saiful Bari , Shafiq Joty , Prathyusha Jwalapuram

Multilingual sentence representations pose a great advantage for low-resource languages that do not have enough data to build monolingual models on their own. These multilingual sentence representations have been separately exploited by few…

Computation and Language · Computer Science 2021-06-15 Dilan Sachintha , Lakmali Piyarathna , Charith Rajitha , Surangika Ranathunga

In the field of Natural Language Processing (NLP), Named Entity Recognition (NER) is recognized as a critical technology, employed across a wide array of applications. Traditional methodologies for annotating datasets for NER models are…

Computation and Language · Computer Science 2025-01-03 Yuji Naraki , Ryosuke Yamaki , Yoshikazu Ikeda , Takafumi Horie , Kotaro Yoshida , Ryotaro Shimizu , Hiroki Naganuma

Named Entity Recognition have been studied for different languages like English, German, Spanish and many others but no study have focused on Nepali language. In this paper we propose a neural based Nepali NER using latest state-of-the-art…

Computation and Language · Computer Science 2019-08-19 Oyesh Mann Singh , Ankur Padia , Anupam Joshi

Named Entity Recognition is one of the most important text processing requirement in many NLP tasks. In this paper we use a deep architecture to accomplish the task of recognizing named entities in a given Hindi text sentence. Bidirectional…

Computation and Language · Computer Science 2019-11-06 Bansi Shah , Sunil Kumar Kopparapu

Character-level patterns have been widely used as features in English Named Entity Recognition (NER) systems. However, to date there has been no direct investigation of the inherent differences between name and non-name tokens in text, nor…

Computation and Language · Computer Science 2018-09-21 Xiaodong Yu , Stephen Mayhew , Mark Sammons , Dan Roth

The state-of-the-art named entity recognition (NER) systems are supervised machine learning models that require large amounts of manually annotated data to achieve high accuracy. However, annotating NER data by human is expensive and…

Computation and Language · Computer Science 2019-11-04 Jian Ni , Georgiana Dinu , Radu Florian

We present, Naamapadam, the largest publicly available Named Entity Recognition (NER) dataset for the 11 major Indian languages from two language families. The dataset contains more than 400k sentences annotated with a total of at least…

Computation and Language · Computer Science 2023-05-30 Arnav Mhaske , Harshit Kedia , Sumanth Doddapaneni , Mitesh M. Khapra , Pratyush Kumar , Rudra Murthy , Anoop Kunchukuttan

Building named entity recognition (NER) models for languages that do not have much training data is a challenging task. While recent work has shown promising results on cross-lingual transfer from high-resource languages to low-resource…

Computation and Language · Computer Science 2019-09-10 Xiaolei Huang , Jonathan May , Nanyun Peng

Named entity recognition in real-world applications suffers from the diversity of entity types, the emergence of new entity types, and the lack of high-quality annotations. To address the above problems, this paper proposes an in-context…

Computation and Language · Computer Science 2023-05-29 Jiawei Chen , Yaojie Lu , Hongyu Lin , Jie Lou , Wei Jia , Dai Dai , Hua Wu , Boxi Cao , Xianpei Han , Le Sun

Named entity recognition (NER) is evolving from a sequence labeling task into a generative paradigm with the rise of large language models (LLMs). We conduct a systematic evaluation of open-source LLMs on both flat and nested NER tasks. We…

Computation and Language · Computer Science 2026-01-27 Qi Zhan , Yile Wang , Hui Huang

Building real-world complex Named Entity Recognition (NER) systems is a challenging task. This is due to the complexity and ambiguity of named entities that appear in various contexts such as short input sentences, emerging entities, and…

Computation and Language · Computer Science 2022-04-29 Abdellah El Mekki , Abdelkader El Mahdaouy , Mohammed Akallouch , Ismail Berrada , Ahmed Khoumsi

We introduce a new task called Multimodal Named Entity Recognition (MNER) for noisy user-generated data such as tweets or Snapchat captions, which comprise short text with accompanying images. These social media posts often come in…

Computation and Language · Computer Science 2018-02-23 Seungwhan Moon , Leonardo Neves , Vitor Carvalho

Parallel corpora are ideal for extracting a multilingual named entity (MNE) resource, i.e., a dataset of names translated into multiple languages. Prior work on extracting MNE datasets from parallel corpora required resources such as large…

Computation and Language · Computer Science 2022-05-02 Silvia Severini , Ayyoob Imani , Philipp Dufter , Hinrich Schütze

Spoken Named Entity Recognition (NER) aims to extract named entities from speech and categorise them into types like person, location, organization, etc. In this work, we present VietMed-NER - the first spoken NER dataset in the medical…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-03 Khai Le-Duc , David Thulke , Hung-Phong Tran , Long Vo-Dang , Khai-Nguyen Nguyen , Truong-Son Hy , Ralf Schlüter

As a fundamental natural language processing task and one of core knowledge extraction techniques, named entity recognition (NER) is widely used to extract information from texts for downstream tasks. Nested NER is a branch of NER in which…

Computation and Language · Computer Science 2022-04-19 Yifei Yang , Zuchao Li , Hai Zhao

In low-resource natural language processing (NLP), the key problems are a lack of target language training data, and a lack of native speakers to create it. Cross-lingual methods have had notable success in addressing these concerns, but in…

Computation and Language · Computer Science 2021-04-27 Tatiana Tsygankova , Francesca Marini , Stephen Mayhew , Dan Roth

This paper investigates the problem of Named Entity Recognition (NER) for extreme low-resource languages with only a few hundred tagged data samples. NER is a fundamental task in Natural Language Processing (NLP). A critical driver…

Computation and Language · Computer Science 2022-12-20 Shashank Sonkar , Zichao Wang , Richard G. Baraniuk

Cross-lingual named entity recognition (CrossNER) faces challenges stemming from uneven performance due to the scarcity of multilingual corpora, especially for non-English data. While prior efforts mainly focus on data-driven transfer…

Computation and Language · Computer Science 2024-02-22 Ying Mo , Jian Yang , Jiahao Liu , Qifan Wang , Ruoyu Chen , Jingang Wang , Zhoujun Li

In this paper, we describe our submission to the WMT19 low-resource parallel corpus filtering shared task. Our main approach is based on the LASER toolkit (Language-Agnostic SEntence Representations), which uses an encoder-decoder…

Computation and Language · Computer Science 2019-06-24 Vishrav Chaudhary , Yuqing Tang , Francisco Guzmán , Holger Schwenk , Philipp Koehn