English
Related papers

Related papers: An Open-Source Dataset and A Multi-Task Model for …

200 papers

Named entity recognition (NER) systems that perform well require task-related and manually annotated datasets. However, they are expensive to develop, and are thus limited in size. As there already exists a large number of NER datasets that…

Computation and Language · Computer Science 2019-04-23 Nargiza Nosirova , Mingbin Xu , Hui Jiang

The increasing diversity of languages used on the web introduces a new level of complexity to Information Retrieval (IR) systems. We can no longer assume that textual content is written in one language or even the same language family. In…

Computation and Language · Computer Science 2014-10-15 Rami Al-Rfou , Vivek Kulkarni , Bryan Perozzi , Steven Skiena

Named Entity Recognition(NER) is a task of recognizing entities at a token level in a sentence. This paper focuses on solving NER tasks in a multilingual setting for complex named entities. Our team, LLM-RM participated in the recently…

Computation and Language · Computer Science 2023-05-08 Rahul Mehta , Vasudeva Varma

The state-of-the-art named entity recognition (NER) systems are statistical machine learning models that have strong generalization capability (i.e., can recognize unseen entities that do not appear in training data) based on lexical and…

Computation and Language · Computer Science 2019-11-04 Jian Ni , Radu Florian

Named Entity Recognition (NER) plays an important role in a wide range of natural language processing tasks, such as relation extraction, question answering, etc. However, previous studies on NER are limited to particular genres, using…

Computation and Language · Computer Science 2020-11-03 Mengdi Zhu , Zheye Deng , Wenhan Xiong , Mo Yu , Ming Zhang , William Yang Wang

Named Entity Recognition (NER) systems play a vital role in NLP applications such as machine translation, summarization, and question-answering. These systems identify named entities, which encompass real-world concepts like locations,…

Computation and Language · Computer Science 2023-12-05 Harsh Chaudhari , Anuja Patil , Dhanashree Lavekar , Pranav Khairnar , Raviraj Joshi , Sachin Pande

This paper investigates the problem of Named Entity Recognition (NER) for extreme low-resource languages with only a few hundred tagged data samples. NER is a fundamental task in Natural Language Processing (NLP). A critical driver…

Computation and Language · Computer Science 2022-12-20 Shashank Sonkar , Zichao Wang , Richard G. Baraniuk

Supervised machine learning assumes the availability of fully-labeled data, but in many cases, such as low-resource languages, the only data available is partially annotated. We study the problem of Named Entity Recognition (NER) with…

Computation and Language · Computer Science 2019-09-23 Stephen Mayhew , Snigdha Chaturvedi , Chen-Tse Tsai , Dan Roth

Named entity recognition (NER) is an important research problem in natural language processing. There are three types of NER tasks, including flat, nested and discontinuous entity recognition. Most previous sequential labeling models are…

Computation and Language · Computer Science 2023-03-21 Ying Mo , Hongyin Tang , Jiahao Liu , Qifan Wang , Zenglin Xu , Jingang Wang , Wei Wu , Zhoujun Li

We present MultiCoNER, a large multilingual dataset for Named Entity Recognition that covers 3 domains (Wiki sentences, questions, and search queries) across 11 languages, as well as multilingual and code-mixing subsets. This dataset is…

Computation and Language · Computer Science 2022-09-01 Shervin Malmasi , Anjie Fang , Besnik Fetahu , Sudipta Kar , Oleg Rokhlenko

Named entity recognition (NER) is the process of recognising and classifying important information (entities) in text. Proper nouns, such as a person's name, an organization's name, or a location's name, are examples of entities. The NER is…

Computation and Language · Computer Science 2023-02-28 Onkar Litake , Maithili Sabane , Parth Patil , Aparna Ranade , Raviraj Joshi

We present OpenNER 1.0, a standardized collection of openly-available named entity recognition (NER) datasets. OpenNER contains 36 NER corpora that span 52 languages, human-annotated in varying named entity ontologies. We correct annotation…

Computation and Language · Computer Science 2025-12-19 Chester Palen-Michel , Maxwell Pickering , Maya Kruse , Jonne Sälevä , Constantine Lignos

We present, Naamapadam, the largest publicly available Named Entity Recognition (NER) dataset for the 11 major Indian languages from two language families. The dataset contains more than 400k sentences annotated with a total of at least…

Computation and Language · Computer Science 2023-05-30 Arnav Mhaske , Harshit Kedia , Sumanth Doddapaneni , Mitesh M. Khapra , Pratyush Kumar , Rudra Murthy , Anoop Kunchukuttan

Named-entity recognition (NER) detects texts with predefined semantic labels and is an essential building block for natural language processing (NLP). Notably, recent NER research focuses on utilizing massive extra data, including…

Computation and Language · Computer Science 2023-05-09 Yuxiang Zhang , Junjie Wang , Xinyu Zhu , Tetsuya Sakai , Hayato Yamana

Named entity recognition (NER) is an important task in NLP, which is all the more challenging in conversational domain with their noisy facets. Moreover, conversational texts are often available in limited amount, making supervised tasks…

Computation and Language · Computer Science 2019-02-22 Rezka Leonandya , Fariz Ikhwantri

For languages with no annotated resources, transferring knowledge from rich-resource languages is an effective solution for named entity recognition (NER). While all existing methods directly transfer from source-learned model to a target…

Computation and Language · Computer Science 2020-07-16 Qianhui Wu , Zijia Lin , Guoxin Wang , Hui Chen , Börje F. Karlsson , Biqing Huang , Chin-Yew Lin

In Natural Language Processing (NLP) pipelines, Named Entity Recognition (NER) is one of the preliminary problems, which marks proper nouns and other named entities such as Location, Person, Organization, Disease etc. Such entities, without…

The demand for sophisticated natural language processing (NLP) methods, particularly Named Entity Recognition (NER), has increased due to the exponential growth of Marathi-language digital content. In particular, NER is essential for…

Computation and Language · Computer Science 2024-10-15 Pranita Deshmukh , Nikita Kulkarni , Sanhita Kulkarni , Kareena Manghani , Geetanjali Kale , Raviraj Joshi

Accurate recognition of biomedical named entities is critical for medical information extraction and knowledge discovery. However, existing methods often struggle with nested entities, entity boundary ambiguity, and cross-lingual…

Computation and Language · Computer Science 2025-10-13 Tengxiao Lv , Ling Luo , Juntao Li , Yanhua Wang , Yuchen Pan , Chao Liu , Yanan Wang , Yan Jiang , Huiyi Lv , Yuanyuan Sun , Jian Wang , Hongfei Lin

The task of Named Entity Recognition (NER) is an important component of many natural language processing systems, such as relation extraction and knowledge graph construction. In this work, we present a simple and effective approach for…

Computation and Language · Computer Science 2022-03-29 Urchade Zaratiana , Pierre Holat , Nadi Tomeh , Thierry Charnois