English
Related papers

Related papers: DaMuEL: A Large Multilingual Dataset for Entity Li…

200 papers

Misinformation is becoming increasingly prevalent on social media and in news articles. It has become so widespread that we require algorithmic assistance utilising machine learning to detect such content. Training these machine learning…

Machine Learning · Computer Science 2022-03-09 Dan Saattrup Nielsen , Ryan McConville

Despite the recent advancements in NLP with the advent of Large Language Models (LLMs), Entity Linking (EL) for historical texts remains challenging due to linguistic variation, noisy inputs, and evolving semantic conventions. Existing…

Computation and Language · Computer Science 2026-01-14 Cristian Santini , Marieke Van Erp , Mehwish Alam

With over 60M articles, Wikipedia has become the largest platform for open and freely accessible knowledge. While it has more than 15B monthly visits, its content is believed to be inaccessible to many readers due to the lack of readability…

Computation and Language · Computer Science 2024-06-05 Mykola Trokhymovych , Indira Sen , Martin Gerlach

The rapid development of multilingual large language models (LLMs) highlights the need for high-quality, diverse, and well-curated multilingual datasets. In this paper, we introduce DCAD-2000 (Data Cleaning as Anomaly Detection), a…

Computation and Language · Computer Science 2025-10-27 Yingli Shen , Wen Lai , Shuo Wang , Xueren Zhang , Kangyang Luo , Alexander Fraser , Maosong Sun

To study social, economic, and historical questions, researchers in the social sciences and humanities have started to use increasingly large unstructured textual datasets. While recent advances in NLP provide many tools to efficiently…

We present an approach based on multilingual sentence embeddings to automatically extract parallel sentences from the content of Wikipedia articles in 85 languages, including several dialects or low-resource languages. We do not limit the…

Computation and Language · Computer Science 2019-07-17 Holger Schwenk , Vishrav Chaudhary , Shuo Sun , Hongyu Gong , Francisco Guzmán

People use language for various purposes. Apart from sharing information, individuals may use it to express emotions or to show respect for another person. In this paper, we focus on the formality level of machine-generated translations and…

Computation and Language · Computer Science 2024-05-21 Dawid Wiśniewski , Zofia Rostek , Artur Nowakowski

High-quality multilingual training data is essential for effectively pretraining large language models (LLMs). Yet, the availability of suitable open-source multilingual datasets remains limited. Existing state-of-the-art datasets mostly…

We present a dataset of 833k paragraphs extracted from CC-BY licensed scientific publications, classified into four categories: acknowledgments, data mentions, software/code mentions, and clinical trial mentions. The paragraphs are…

Computation and Language · Computer Science 2025-10-28 Eric Jeangirard

Cross-document coreference, the problem of resolving entity mentions across multi-document collections, is crucial to automated knowledge base construction and data mining tasks. However, the scarcity of large labeled data sets has hindered…

Artificial Intelligence · Computer Science 2015-03-17 Sameer Singh , Michael Wick , Andrew McCallum

The advancements of Large Language Models (LLMs) have spurred a growing interest in their application to Named Entity Recognition (NER) methods. However, existing datasets are primarily designed for traditional machine learning methods and…

Computation and Language · Computer Science 2026-05-18 Hanjun Luo , Yingbin Jin , Xinfeng Li , Xuecheng Liu , Ruizhe Chen , Tong Shang , Kun Wang , Qingsong Wen , Zuozhu Liu

The Web of Linked Data is composed of tons of RDF documents interlinked to each other forming a huge repository of distributed semantic data. Effectively querying this distributed data source is an important open problem in the Semantic Web…

Databases · Computer Science 2015-07-21 Olaf Hartig , Jorge Pérez

Most vision-and-language pretraining research focuses on English tasks. However, the creation of multilingual multimodal evaluation datasets (e.g. Multi30K, xGQA, XVNLI, and MaRVL) poses a new challenge in finding high-quality training data…

Computation and Language · Computer Science 2022-10-25 Chen Qiu , Dan Oneata , Emanuele Bugliarello , Stella Frank , Desmond Elliott

Thanks to the development of the Semantic Web, a lot of new structured data has become available on the Web in the form of knowledge bases (KBs). Making this valuable data accessible and usable for end-users is one of the main goals of…

Artificial Intelligence · Computer Science 2018-03-05 Dennis Diefenbach , Andreas Both , Kamal Singh , Pierre Maret

We release a corpus of 43 million atomic edits across 8 languages. These edits are mined from Wikipedia edit history and consist of instances in which a human editor has inserted a single contiguous phrase into, or deleted a single…

Computation and Language · Computer Science 2018-08-29 Manaal Faruqui , Ellie Pavlick , Ian Tenney , Dipanjan Das

Document understanding tasks, in particular, Visually-rich Document Entity Retrieval (VDER), have gained significant attention in recent years thanks to their broad applications in enterprise AI. However, publicly available data have been…

Computation and Language · Computer Science 2023-10-27 Lijun Yu , Jin Miao , Xiaoyu Sun , Jiayi Chen , Alexander G. Hauptmann , Hanjun Dai , Wei Wei

Entity Linking (EL) is the process of associating ambiguous textual mentions to specific entities in a knowledge base. Traditional EL methods heavily rely on large datasets to enhance their performance, a dependency that becomes problematic…

Computation and Language · Computer Science 2024-10-11 Xukai Liu , Ye Liu , Kai Zhang , Kehang Wang , Qi Liu , Enhong Chen

Language models (LMs) have excelled in various broad domains. However, to ensure their safe and effective integration into real-world educational settings, they must demonstrate proficiency in specific, granular areas of knowledge. Existing…

Computation and Language · Computer Science 2025-05-27 Sagi Shaier , George Arthur Baker , Chiranthan Sridhar , Lawrence E Hunter , Katharina von der Wense

Natural Question Answering (QA) datasets play a crucial role in evaluating the capabilities of large language models (LLMs), ensuring their effectiveness in real-world applications. Despite the numerous QA datasets that have been developed…

We introduce KyrgyzNER, the first manually annotated named entity recognition dataset for the Kyrgyz language. Comprising 1,499 news articles from the 24.KG news portal, the dataset contains 10,900 sentences and 39,075 entity mentions…

Computation and Language · Computer Science 2025-09-24 Timur Turatali , Anton Alekseev , Gulira Jumalieva , Gulnara Kabaeva , Sergey Nikolenko