English
Related papers

Related papers: Cross-lingual Named Entity Corpus for Slavic Langu…

200 papers

We introduce ParaNames, a massively multilingual parallel name resource consisting of 140 million names spanning over 400 languages. Names are provided for 16.8 million entities, and each entity is mapped from a complex type hierarchy to a…

Computation and Language · Computer Science 2024-05-16 Jonne Sälevä , Constantine Lignos

Entity linking is the task of associating linguistic expressions with entries in a knowledge base that represent real-world entities and concepts. Language resources for this task have primarily been developed for English, and the resources…

Computation and Language · Computer Science 2026-04-01 Shohei Higashiyama , Masao Ideuchi , Masao Utiyama

We present OpenNER 1.0, a standardized collection of openly-available named entity recognition (NER) datasets. OpenNER contains 36 NER corpora that span 52 languages, human-annotated in varying named entity ontologies. We correct annotation…

Computation and Language · Computer Science 2025-12-19 Chester Palen-Michel , Maxwell Pickering , Maya Kruse , Jonne Sälevä , Constantine Lignos

This paper is devoted to the study of methods for information extraction (entity recognition and relation classification) from scientific texts on information technology. Scientific publications provide valuable information into…

Computation and Language · Computer Science 2020-12-29 Elena Bruches , Alexey Pauls , Tatiana Batura , Vladimir Isachenko

Crawling national top-level domains has proven to be highly effective for collecting texts in less-resourced languages. This approach has been recently used for South Slavic languages and resulted in the largest general corpora for this…

Computation and Language · Computer Science 2026-03-02 Taja Kuzman Pungeršek , Peter Rupnik , Vít Suchomel , Nikola Ljubešić

We introduce Multi-SimLex, a large-scale lexical resource and evaluation benchmark covering datasets for 12 typologically diverse languages, including major languages (e.g., Mandarin Chinese, Spanish, Russian) as well as less-resourced ones…

Named Entity Recognition (NER) is a useful component in Natural Language Processing (NLP) applications. It is used in various tasks such as Machine Translation, Summarization, Information Retrieval, and Question-Answering systems. The…

We present the development of a Named Entity Recognition (NER) dataset for Tagalog. This corpus helps fill the resource gap present in Philippine languages today, where NER resources are scarce. The texts were obtained from a pretraining…

Computation and Language · Computer Science 2023-11-14 Lester James V. Miranda

Named entity recognition identifies common classes of entities in text, but these entity labels are generally sparse, limiting utility to downstream tasks. In this work we present ScienceExamCER, a densely-labeled semantic classification…

Computation and Language · Computer Science 2019-11-26 Hannah Smith , Zeyu Zhang , John Culnan , Peter Jansen

Defining psycholinguistic characteristics in written texts is a task gaining increasing attention from researchers. One of the most widely used tools in the current field is Linguistic Inquiry and Word Count (LIWC) that originally was…

Computation and Language · Computer Science 2026-01-29 Elina Sigdel , Anastasia Panfilova

In this paper we tackle multilingual named entity recognition task. We use the BERT Language Model as embeddings with bidirectional recurrent network, attention, and NCRF on the top. We apply multilingual BERT only as embedder without any…

Computation and Language · Computer Science 2023-10-04 Anton A. Emelyanov , Ekaterina Artemova

Deep neural networks have been employed for various spoken language recognition tasks, including tasks that are multilingual by definition such as spoken language identification. In this paper, we present a neural model for Slavic language…

Computation and Language · Computer Science 2020-10-26 Badr M. Abdullah , Jacek Kudera , Tania Avgustinova , Bernd Möbius , Dietrich Klakow

We describe a dataset developed for Named Entity Recognition in German federal court decisions. It consists of approx. 67,000 sentences with over 2 million tokens. The resource contains 54,000 manually annotated entities, mapped to 19…

Computation and Language · Computer Science 2020-03-31 Elena Leitner , Georg Rehm , Julián Moreno-Schneider

Recognizing semantic differences across documents is crucial for text generation evaluation and content alignment, especially in cross-lingual settings. However, as a standalone task, it has received little attention. We address this by…

Computation and Language · Computer Science 2026-04-28 Michelle Wastl , Jannis Vamvas , Rico Sennrich

The task of toxicity detection is still a relevant task, especially in the context of safe and fair LMs development. Nevertheless, labeled binary toxicity classification corpora are not available for all languages, which is understandable…

Computation and Language · Computer Science 2024-04-30 Daryna Dementieva , Valeriia Khylenko , Nikolay Babakov , Georg Groh

We present the Multilingual Entity Linking of Occupations (MELO) Benchmark, a new collection of 48 datasets for evaluating the linking of entity mentions in 21 languages to the ESCO Occupations multilingual taxonomy. MELO was built using…

Computation and Language · Computer Science 2024-10-14 Federico Retyk , Luis Gasco , Casimiro Pio Carrino , Daniel Deniz , Rabih Zbib

This paper will present textual corpora for Serbian (and Serbo-Croatian), usable for the training of large language models and publicly available at one of the several notable online repositories. Each corpus will be classified using…

Computation and Language · Computer Science 2024-05-16 Mihailo Škorić , Nikola Janković

India's rich cultural and linguistic diversity poses various challenges in the domain of Natural Language Processing (NLP), particularly in Named Entity Recognition (NER). NER is a NLP task that aims to identify and classify tokens into…

Computation and Language · Computer Science 2025-02-07 Mohammed Amaan Dhamaskar , Rasika Ransing

Named entity recognition (NER) is one of the tasks in natural language processing that can greatly benefit from the use of external knowledge sources. We propose a named entity recognition framework composed of knowledge-based feature…

Computation and Language · Computer Science 2019-06-07 Sławomir Dadas

We introduce a novel multilingual hierarchical corpus annotated for entity framing and role portrayal in news articles. The dataset uses a unique taxonomy inspired by storytelling elements, comprising 22 fine-grained roles, or archetypes,…