English
Related papers

Related papers: A Multi-way Parallel Named Entity Annotated Corpus…

200 papers

Recognizing entities in texts is a central need in many information-seeking scenarios, and indeed, Named Entity Recognition (NER) is arguably one of the most successful examples of a widely adopted NLP task and corresponding NLP technology.…

Computation and Language · Computer Science 2023-10-24 Uri Katz , Matan Vetzler , Amir DN Cohen , Yoav Goldberg

Named Entity Recognition (NER) is essential in various Natural Language Processing (NLP) applications. Traditional NER models are effective but limited to a set of predefined entity types. In contrast, Large Language Models (LLMs) can…

Computation and Language · Computer Science 2023-11-16 Urchade Zaratiana , Nadi Tomeh , Pierre Holat , Thierry Charnois

In this paper we describe an end to end Neural Model for Named Entity Recognition NER) which is based on Bi-Directional RNN-LSTM. Almost all NER systems for Hindi use Language Specific features and handcrafted rules with gazetteers. Our…

Computation and Language · Computer Science 2017-11-13 Vinayak Athavale , Shreenivas Bharadwaj , Monik Pamecha , Ameya Prabhu , Manish Shrivastava

Cross-lingual Named Entity Recognition (CL-NER) aims to transfer knowledge from high-resource languages to low-resource languages. However, existing zero-shot CL-NER (ZCL-NER) approaches primarily focus on Latin script language (LSL), where…

Computation and Language · Computer Science 2025-09-03 Zhihao Zhang , Sophia Yat Mei Lee , Dong Zhang , Shoushan Li , Guodong Zhou

Parallel datasets are vital for performing and evaluating any kind of multilingual task. However, in the cases where one of the considered language pairs is a low-resource language, the existing top-down parallel data such as corpora are…

Computation and Language · Computer Science 2023-09-26 Kasun Wickramasinghe , Nisansa de Silva

Named entity recognition (NER) is a fundamental task in natural language processing that involves identifying and classifying entities in sentences into pre-defined types. It plays a crucial role in various research fields, including entity…

Computation and Language · Computer Science 2024-04-29 Dongsheng Wang , Xiaoqin Feng , Zeming Liu , Chuan Wang

State-of-the-art named entity recognition systems rely heavily on hand-crafted features and domain-specific knowledge in order to learn effectively from the small, supervised training corpora that are available. In this paper, we introduce…

Computation and Language · Computer Science 2016-04-08 Guillaume Lample , Miguel Ballesteros , Sandeep Subramanian , Kazuya Kawakami , Chris Dyer

Although over 100 languages are supported by strong off-the-shelf machine translation systems, only a subset of them possess large annotated corpora for named entity recognition. Motivated by this fact, we leverage machine translation to…

Computation and Language · Computer Science 2019-09-16 Alankar Jain , Bhargavi Paranjape , Zachary C. Lipton

For languages with no annotated resources, unsupervised transfer of natural language processing models such as named-entity recognition (NER) from resource-rich languages would be an appealing capability. However, differences in words and…

Computation and Language · Computer Science 2018-09-13 Jiateng Xie , Zhilin Yang , Graham Neubig , Noah A. Smith , Jaime Carbonell

This paper reports on the evaluation of Deep Learning (DL) transformer architecture models for Named-Entity Recognition (NER) on ten low-resourced South African (SA) languages. In addition, these DL transformer models were compared to other…

Computation and Language · Computer Science 2022-10-04 Ridewaan Hanslo

We propose an efficient modeling framework for cross-lingual named entity recognition in semi-structured text data. Our approach relies on both knowledge distillation and consistency training. The modeling framework leverages knowledge from…

Computation and Language · Computer Science 2023-07-19 Sunisth Kumar , Davide Liu , Alexandre Boulenger

The aim of Named Entity Recognition (NER) is to identify references of named entities in unstructured documents, and to classify them into pre-defined semantic categories. NER often aids from added background knowledge in the form of…

Computation and Language · Computer Science 2015-11-24 S. Thenmalar , J. Balaji , T. V. Geetha

The performance of Neural Machine Translation (NMT) depends significantly on the size of the available parallel corpus. Due to this fact, low resource language pairs demonstrate low translation performance compared to high resource language…

Computation and Language · Computer Science 2022-02-21 Ravinga Perera , Thilakshi Fonseka , Rashmini Naranpanawa , Uthayasanker Thayasivam

We introduce the Universal Named-Entity Recognition (UNER)framework, a 4-level classification hierarchy, and the methodology that isbeing adopted to create the first multilingual UNER corpus: the SETimesparallel corpus annotated for…

Computation and Language · Computer Science 2020-10-26 Diego Alves , Tin Kuculo , Gabriel Amaral , Gaurish Thakkar , Marko Tadic

Named Entity Recognition (NER) System aims to extract the existing information into the following categories such as: Persons Name, Organization, Location, Date and Time, Term, Designation and Short forms. Now, it is considered to be…

Computation and Language · Computer Science 2019-10-09 Awais Khan Jumani , Mashooque Ahmed Memon , Fida Hussain Khoso , Anwar Ali Sanjrani , Safeeullah Soomro

Standard English and Malaysian English exhibit notable differences, posing challenges for natural language processing (NLP) tasks on Malaysian English. Unfortunately, most of the existing datasets are mainly based on standard English and…

Computation and Language · Computer Science 2024-02-23 Mohan Raj Chanthran , Lay-Ki Soon , Huey Fang Ong , Bhawani Selvaretnam

Resources for the non-English languages are scarce and this paper addresses this problem in the context of machine translation, by automatically extracting parallel sentence pairs from the multilingual articles available on the Internet. In…

Computation and Language · Computer Science 2018-06-27 Sree Harsha Ramesh , Krishna Prasad Sankaranarayanan

We conducted a detailed analysis on the quality of web-mined corpora for two low-resource languages (making three language pairs, English-Sinhala, English-Tamil and Sinhala-Tamil). We ranked each corpus according to a similarity measure and…

Computation and Language · Computer Science 2024-06-17 Surangika Ranathunga , Nisansa de Silva , Menan Velayuthan , Aloka Fernando , Charitha Rathnayake

Supervised machine learning assumes the availability of fully-labeled data, but in many cases, such as low-resource languages, the only data available is partially annotated. We study the problem of Named Entity Recognition (NER) with…

Computation and Language · Computer Science 2019-09-23 Stephen Mayhew , Snigdha Chaturvedi , Chen-Tse Tsai , Dan Roth

Cross-lingual Named Entity Recognition (NER) leverages knowledge transfer between languages to identify and classify named entities, making it particularly useful for low-resource languages. We show that the data-based cross-lingual…

Computation and Language · Computer Science 2025-02-03 Andrei Politov , Oleh Shkalikov , René Jäkel , Michael Färber