English
Related papers

Related papers: SiDiaC-v.2.0: Sinhala Diachronic Corpus Version 2.…

200 papers

This article presents a hybrid methodology for building a multilingual corpus designed to support the study of emerging concepts in the humanities and social sciences (HSS), illustrated here through the case of ``non-technological…

Computation and Language · Computer Science 2025-12-09 Revekka Kyriakoglou , Anna Pappa

Automated event extraction in social science applications often requires corpus-level evaluations: for example, aggregating text predictions across metadata and unbiased estimates of recall. We combine corpus-level evaluation requirements…

Computation and Language · Computer Science 2021-05-28 Andrew Halterman , Katherine A. Keith , Sheikh Muhammad Sarwar , Brendan O'Connor

Indigenous African languages are categorized as under-served in Natural Language Processing. They therefore experience poor digital inclusivity and information access. The processing challenge with such languages has been how to use machine…

Computation and Language · Computer Science 2025-01-17 Barack Wanjawa , Lilian Wanzare , Florence Indede , Owen McOnyango , Edward Ombui , Lawrence Muchemi

The rapid development of multilingual large language models (LLMs) highlights the need for high-quality, diverse, and well-curated multilingual datasets. In this paper, we introduce DCAD-2000 (Data Cleaning as Anomaly Detection), a…

Computation and Language · Computer Science 2025-10-27 Yingli Shen , Wen Lai , Shuo Wang , Xueren Zhang , Kangyang Luo , Alexander Fraser , Maosong Sun

Darija Open Dataset (DODa) represents an open-source project aimed at enhancing Natural Language Processing capabilities for the Moroccan dialect, Darija. With approximately 100,000 entries, DODa stands as the largest collaborative project…

Computation and Language · Computer Science 2024-05-24 Aissam Outchakoucht , Hamza Es-Samaali

Most Arabic natural language processing tools and resources are developed to serve Modern Standard Arabic (MSA), which is the official written language in the Arab World. Some Dialectal Arabic varieties, notably Egyptian Arabic, have…

Computation and Language · Computer Science 2016-09-13 Salam Khalifa , Nizar Habash , Dana Abdulrahim , Sara Hassan

We propose DuoRC, a novel dataset for Reading Comprehension (RC) that motivates several new challenges for neural approaches in language understanding beyond those offered by existing RC datasets. DuoRC contains 186,089 unique…

Computation and Language · Computer Science 2018-10-11 Amrita Saha , Rahul Aralikatte , Mitesh M. Khapra , Karthik Sankaranarayanan

Ancient Buddhist literature features frequent, yet often unannotated, textual parallels spread across diverse languages: Sanskrit, P\=ali, Buddhist Chinese, Tibetan, and more. The scale of this material makes manual examination prohibitive.…

Computation and Language · Computer Science 2026-01-13 Sebastian Nehrdich , Kurt Keutzer

We present SParC, a dataset for cross-domainSemanticParsing inContext that consists of 4,298 coherent question sequences (12k+ individual questions annotated with SQL queries). It is obtained from controlled user interactions with 200…

Over the past century, the Turkish language has undergone substantial changes, primarily driven by governmental interventions. In this work, our goal is to investigate the evolution of the Turkish language since the establishment of…

Computation and Language · Computer Science 2024-05-17 Togay Yazar , Mucahid Kutlu , İsa Kerem Bayırlı

We present a new Icelandic-English parallel corpus, the Icelandic Parallel Abstracts Corpus (IPAC), composed of abstracts from student theses and dissertations. The texts were collected from the Skemman repository which keeps records of all…

Computation and Language · Computer Science 2021-08-12 Haukur Barri Símonarson , Vésteinn Snæbjarnarson

The five idioms (i.e., varieties) of the Romansh language are largely standardized and are taught in the schools of the respective communities in Switzerland. In this paper, we present the first parallel corpus of Romansh idioms. The corpus…

Computation and Language · Computer Science 2026-02-16 Zachary Hopton , Jannis Vamvas , Andrin Büchler , Anna Rutkiewicz , Rico Cathomas , Rico Sennrich

Modern Translation Systems heavily rely on high-quality, large parallel datasets for state-of-the-art performance. However, such resources are largely unavailable for most of the South Asian languages. Among them, Nepali and Tamang fall…

In the last few years, open-domain question answering (ODQA) has advanced rapidly due to the development of deep learning techniques and the availability of large-scale QA datasets. However, the current datasets are essentially designed for…

Computation and Language · Computer Science 2022-02-23 Jiexin Wang , Adam Jatowt , Masatoshi Yoshikawa

We present an overview of the SCIDOCA 2025 Shared Task, which focuses on citation discovery and prediction in scientific documents. The task is divided into three subtasks: (1) Citation Discovery, where systems must identify relevant…

Digital Libraries · Computer Science 2025-09-30 An Dao , Vu Tran , Le-Minh Nguyen , Yuji Matsumoto

We introduce MegaWika 2, a large, multilingual dataset of Wikipedia articles with their citations and scraped web sources; articles are represented in a rich data structure, and scraped source texts are stored inline with precise character…

Digital Libraries · Computer Science 2025-08-07 Samuel Barham , Chandler May , Benjamin Van Durme

We present the Swiss Parliaments Corpus (SPC), an automatically aligned Swiss German speech to Standard German text corpus. This first version of the corpus is based on publicly available data of the Bernese cantonal parliament and consists…

Computation and Language · Computer Science 2021-06-10 Michel Plüss , Lukas Neukom , Christian Scheller , Manfred Vogel

In this paper, we propose a new word embedding based corpus consisting of more than 61 million words crawled from multiple web resources. We design a preprocessing pipeline for the filtration of unwanted text from crawled data. Afterwards,…

Computation and Language · Computer Science 2024-08-29 Wazir Ali , Saifullah Tumrani , Jay Kumar , Tariq Rahim Soomro

This paper presents an extension to a very low-resource parallel corpus collected in an endangered language, Griko, making it useful for computational research. The corpus consists of 330 utterances (about 20 minutes of speech) which have…

Computation and Language · Computer Science 2018-07-30 Marcely Zanon Boito , Antonios Anastasopoulos , Marika Lekakou , Aline Villavicencio , Laurent Besacier

Mining parallel document pairs for document-level machine translation (MT) remains challenging due to the limitations of existing Cross-Lingual Document Alignment (CLDA) techniques. Existing methods often rely on metadata such as URLs,…

Computation and Language · Computer Science 2025-11-11 Sanjay Suryanarayanan , Haiyue Song , Mohammed Safi Ur Rahman Khan , Anoop Kunchukuttan , Raj Dabre