Milimili. Collecting Parallel Data via Crowdsourcing
Computation and Language
2023-07-25 v1
Authors:
Alexander Antonov
Abstract
We present a methodology for gathering a parallel corpus through crowdsourcing, which is more cost-effective than hiring professional translators, albeit at the expense of quality. Additionally, we have made available experimental parallel data collected for Chechen-Russian and Fula-English language pairs.
Keywords
Cite
@article{arxiv.2307.12282,
title = {Milimili. Collecting Parallel Data via Crowdsourcing},
author = {Alexander Antonov},
journal= {arXiv preprint arXiv:2307.12282},
year = {2023}
}
Related papers
View all related →
Computation and Language · Computer Science
Using crowdsourcing system for creating site-specific statistical machine translation engine
Alexander Kalinin, George Savchenko
2014-09-22
Computation and Language · Computer Science
A Japanese-Chinese Parallel Corpus Using Crowdsourcing for Web Mining
Masaaki Nagata, Makoto Morishita, Katsuki Chousa, Norihito Yasuda
2024-05-16
Computation and Language · Computer Science
Multi-domain machine translation enhancements by parallel data extraction from comparable corpora
Krzysztof Wołk, Emilia Rejmund, Krzysztof Marasek
2016-03-23
Computation and Language · Computer Science
Harvesting comparable corpora and mining them for equivalent bilingual sentences using statistical classification and analogy- based heuristics
Krzysztof Wołk, Emilia Rejmund, Krzysztof Marasek
2015-11-20
Computation and Language · Computer Science
Generating Multilingual Parallel Corpus Using Subtitles
Farshad Jafari
2018-04-12
Computation and Language · Computer Science
Practical Comparable Data Collection for Low-Resource Languages via Images
Aman Madaan, Shruti Rijhwani, Antonios Anastasopoulos, Yiming Yang +1
2020-04-30
Computation and Language · Computer Science
What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks?
Nikita Nangia, Saku Sugawara, Harsh Trivedi, Alex Warstadt +2
2021-06-03
Computation and Language · Computer Science
Ukrainian-to-English folktale corpus: Parallel corpus creation and augmentation for machine translation in low-resource languages
Olena Burda-Lassen
2024-10-15
Computation and Language · Computer Science
Unsupervised Parallel Corpus Mining on Web Data
Guokun Lai, Zihang Dai, Yiming Yang
2020-09-21
Computation and Language · Computer Science
A Survey of Methods to Leverage Monolingual Data in Low-resource Neural Machine Translation
Ilshat Gibadullin, Aidar Valeev, Albina Khusainova, Adil Khan
2019-10-02
Computation and Language · Computer Science
A Morphologically-Aware Dictionary-based Data Augmentation Technique for Machine Translation of Under-Represented Languages
Md Mahfuz Ibn Alam, Sina Ahmadi, Antonios Anastasopoulos
2024-02-06
Computation and Language · Computer Science
Automatic Construction of Discourse Corpora for Dialogue Translation
Longyue Wang, Xiaojun Zhang, Zhaopeng Tu, Andy Way +1
2016-05-24
Computation and Language · Computer Science
Building Subject-aligned Comparable Corpora and Mining it for Truly Parallel Sentence Pairs
Krzysztof Wołk, Krzysztof Marasek
2015-09-30
Computation and Language · Computer Science
Don't Rule Out Monolingual Speakers: A Method For Crowdsourcing Machine Translation Data
Rajat Bhatnagar, Ananya Ganesh, Katharina Kann
2021-06-15
Computation and Language · Computer Science
A fully automated and scalable Parallel Data Augmentation for Low Resource Languages using Image and Text Analytics
Prawaal Sharma, Navneet Goyal, Poonam Goyal, Vishnupriyan R
2025-10-16
Computation and Language · Computer Science
Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Mining
Ivana Kvapilıkova, Mikel Artetxe, Gorka Labaka, Eneko Agirre +1
2021-05-24
Computation and Language · Computer Science
The Lab vs The Crowd: An Investigation into Data Quality for Neural Dialogue Models
José Lopes, Francisco J. Chiyah Garcia, Helen Hastie
2020-12-08
Machine Learning · Computer Science
CrowdMI: Multiple Imputation via Crowdsourcing
Lovedeep Gondara
2018-02-26
cmp-lg · Computer Science
Parallel Strands: A Preliminary Investigation into Mining the Web for Bilingual Text
Philip Resnik
2007-05-23
Artificial Intelligence · Computer Science
Crowdsourcing Parallel Corpus for English-Oromo Neural Machine Translation using Community Engagement Platform
Sisay Chala, Bekele Debisa, Amante Diriba, Silas Getachew +2
2021-02-16
Computation and Language · Computer Science
Extracting Parallel Sentences with Bidirectional Recurrent Neural Networks to Improve Machine Translation
Francis Grégoire, Philippe Langlais
2018-08-28
Computation and Language · Computer Science
Talking to myself: self-dialogues as data for conversational agents
Joachim Fainberg, Ben Krause, Mihai Dobre, Marco Damonte +4
2018-09-20
Computation and Language · Computer Science
Unsupervised comparable corpora preparation and exploration for bi-lingual translation equivalents
Krzysztof Wołk, Krzysztof Marasek
2015-12-08
Computation and Language · Computer Science
Beyond Human-Only: Evaluating Human-Machine Collaboration for Collecting High-Quality Translation Data
Zhongtao Liu, Parker Riley, Daniel Deutsch, Alison Lui +3
2024-10-16
Computation and Language · Computer Science
Majority Voting with Bidirectional Pre-translation For Bitext Retrieval
Alex Jones, Derry Tanti Wijaya
2021-03-15