English
Related papers

Related papers: ParaNames: A Massively Multilingual Entity Name Co…

200 papers

We analyze some of the fundamental design challenges that impact the development of a multilingual state-of-the-art named entity transliteration system, including curating bilingual named entity datasets and evaluation of multiple…

Computation and Language · Computer Science 2018-08-09 Yuval Merhav , Stephen Ash

Training state-of-the-art large language models requires vast amounts of clean and diverse textual data. However, building suitable multilingual datasets remains a challenge. In this work, we present HPLT v2, a collection of high-quality…

We present RONEC - the Named Entity Corpus for the Romanian language. The corpus contains over 26000 entities in ~5000 annotated sentences, belonging to 16 distinct classes. The sentences have been extracted from a copy-right free…

Computation and Language · Computer Science 2020-04-28 Stefan Daniel Dumitrescu , Andrei-Marius Avram

Being able to automatically discover synonymous entities in an open-world setting benefits various tasks such as entity disambiguation or knowledge graph canonicalization. Existing works either only utilize entity features, or rely on…

Computation and Language · Computer Science 2020-05-12 Chenwei Zhang , Yaliang Li , Nan Du , Wei Fan , Philip S. Yu

Scarcity of resources such as annotated text corpora for under-resourced languages like Albanian is a serious impediment in computational linguistics and natural language processing research. This paper presents AlbNER, a corpus of 900…

Computation and Language · Computer Science 2023-09-19 Erion Çano

Knowledge bases (KBs) are paramount in NLP. We employ multiview learning for increasing accuracy and coverage of entity type information in KBs. We rely on two metaviews: language and representation. For language, we consider high-resource…

Computation and Language · Computer Science 2018-10-25 Yadollah Yaghoobzadeh , Hinrich Schütze

Accurate recognition of biomedical named entities is critical for medical information extraction and knowledge discovery. However, existing methods often struggle with nested entities, entity boundary ambiguity, and cross-lingual…

Computation and Language · Computer Science 2025-10-13 Tengxiao Lv , Ling Luo , Juntao Li , Yanhua Wang , Yuchen Pan , Chao Liu , Yanan Wang , Yan Jiang , Huiyi Lv , Yuanyuan Sun , Jian Wang , Hongfei Lin

We present, Naamapadam, the largest publicly available Named Entity Recognition (NER) dataset for the 11 major Indian languages from two language families. The dataset contains more than 400k sentences annotated with a total of at least…

Computation and Language · Computer Science 2023-05-30 Arnav Mhaske , Harshit Kedia , Sumanth Doddapaneni , Mitesh M. Khapra , Pratyush Kumar , Rudra Murthy , Anoop Kunchukuttan

Large, high-quality datasets are crucial for training Large Language Models (LLMs). However, so far, there are few datasets available for specialized critical domains such as law and the available ones are often only for the English…

Computation and Language · Computer Science 2024-05-21 Joel Niklaus , Veton Matoshi , Matthias Stürmer , Ilias Chalkidis , Daniel E. Ho

Text in many domains involves a significant amount of named entities. Predict- ing the entity names is often challenging for a language model as they appear less frequent on the training corpus. In this paper, we propose a novel and…

Computation and Language · Computer Science 2018-05-15 Md Rizwan Parvez , Saikat Chakraborty , Baishakhi Ray , Kai-Wei Chang

Statements about entities occur everywhere, from newspapers and web pages to structured databases. Correlating references to entities across systems that use different identifiers or names for them is a widespread problem. In this paper, we…

Artificial Intelligence · Computer Science 2014-06-27 R. V. Guha

Recent multilingual named entity recognition (NER) work has shown that large language models (LLMs) can provide effective synthetic supervision, yet such datasets have mostly appeared as by-products of broader experiments rather than as…

Computation and Language · Computer Science 2025-12-17 Jonas Golde , Patrick Haller , Alan Akbik

This paper introduces a new model that uses named entity recognition, coreference resolution, and entity linking techniques, to approach the task of linking people entities on Wikipedia people pages to their corresponding Wikipedia pages if…

Computation and Language · Computer Science 2017-05-03 Weiqian Yan , Kanchan Khurad

We present a tool that, from automatically recognised names, tries to infer inter-person relations in order to present associated people on maps. Based on an in-house Named Entity Recognition tool, applied on clusters of an average of…

Computation and Language · Computer Science 2007-05-23 Bruno Pouliquen , Ralf Steinberger , Camelia Ignat , Tamara Oellinger

We introduce an architecture to learn joint multilingual sentence representations for 93 languages, belonging to more than 30 different families and written in 28 different scripts. Our system uses a single BiLSTM encoder with a shared BPE…

Computation and Language · Computer Science 2021-12-28 Mikel Artetxe , Holger Schwenk

This paper introduces MERLIN, a novel testbed system for the task of Multilingual Multimodal Entity Linking. The created dataset includes BBC news article titles, paired with corresponding images, in five languages: Hindi, Japanese,…

Computation and Language · Computer Science 2025-10-17 Sathyanarayanan Ramamoorthy , Vishwa Shah , Simran Khanuja , Zaid Sheikh , Shan Jie , Ann Chia , Shearman Chua , Graham Neubig

The aim of this paper is to propose a method for tagging named entities (NE), using natural language processing techniques. Beyond their literal meaning, named entities are frequently subject to metonymy. We show the limits of current NE…

Artificial Intelligence · Computer Science 2007-12-08 Thierry Poibeau

We present MULTICONER V2, a dataset for fine-grained Named Entity Recognition covering 33 entity classes across 12 languages, in both monolingual and multilingual settings. This dataset aims to tackle the following practical challenges in…

Computation and Language · Computer Science 2023-10-23 Besnik Fetahu , Zhiyu Chen , Sudipta Kar , Oleg Rokhlenko , Shervin Malmasi

Recently, neural methods have achieved state-of-the-art (SOTA) results in Named Entity Recognition (NER) tasks for many languages without the need for manually crafted features. However, these models still require manually annotated…

Computation and Language · Computer Science 2019-11-25 M Saiful Bari , Shafiq Joty , Prathyusha Jwalapuram

Searching for information about a specific person is an online activity frequently performed by many users. In most cases, users are aided by queries containing a name and sending back to the web search engines for finding their will.…

Computation and Language · Computer Science 2020-07-23 Aviad Elyashar , Rami Puzis , Michael Fire