English
Related papers

Related papers: Google Crowdsourced Speech Corpora and Related Ope…

200 papers

We present an analysis pipeline and best practice guidelines for building and curating corpora of everyday conversation in diverse languages. Surveying language documentation corpora and other resources that cover 67 languages and varieties…

Computation and Language · Computer Science 2022-05-11 Andreas Liesenfeld , Mark Dingemanse

Generative language modelling has surged in popularity with the emergence of services such as ChatGPT and Google Gemini. While these models have demonstrated transformative potential in productivity and communication, they overwhelmingly…

Computation and Language · Computer Science 2025-07-09 Josh McGiff , Nikola S. Nikolov

This technical report describes the methods and results of a three-week sprint to produce deployable speech recognition models for 31 under-served languages of the Common Voice project. We outline the preprocessing steps, hyperparameter…

Computation and Language · Computer Science 2021-05-12 Francis M. Tyers , Josh Meyer

Spoken language translation has recently witnessed a resurgence in popularity, thanks to the development of end-to-end models and the creation of new corpora, such as Augmented LibriSpeech and MuST-C. Existing datasets involve language…

Computation and Language · Computer Science 2020-06-11 Changhan Wang , Juan Pino , Anne Wu , Jiatao Gu

The success of large language models has driven interest in developing similar speech processing capabilities. However, a key challenge is the scarcity of high-quality spontaneous speech data, as most existing datasets contain scripted…

Natural Language Processing is a crucial frontier in artificial intelligence, with broad applications in many areas, including public health, agriculture, education, and commerce. However, due to the lack of substantial linguistic…

Computation and Language · Computer Science 2025-01-22 Audrey Mbogho , Quin Awuor , Andrew Kipkebut , Lilian Wanzare , Vivian Oloo

In this article, we introduce and evaluate the concept of robosourcing for creating educational content. Robosourcing lies in the intersection of crowdsourcing and large language models, where instead of a crowd of humans, requests to large…

Human-Computer Interaction · Computer Science 2022-11-10 Paul Denny , Sami Sarsa , Arto Hellas , Juho Leinonen

We present the HPLT (High Performance Language Technologies) language resources, a new massive multilingual dataset including both monolingual and bilingual corpora extracted from CommonCrawl and previously unused web crawls from the…

Learning idiomatic expressions is seen as one of the most challenging stages in second language learning because of their unpredictable meaning. A similar situation holds for their identification within natural language processing…

Computation and Language · Computer Science 2022-01-21 Gülşen Eryiğit , Ali Şentaş , Johanna Monti

Automatic Speech Recognition and Text-to-Speech systems are primarily trained in a supervised fashion and require high-quality, accurately labeled speech datasets. In this work, we examine common problems with speech data and introduce a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-10 Evelina Bakhturina , Vitaly Lavrukhin , Boris Ginsburg

Recent advancements in conversational systems have significantly enhanced human-machine interactions across various domains. However, training these systems is challenging due to the scarcity of specialized dialogue data. Traditionally,…

Computation and Language · Computer Science 2026-05-29 Heydar Soudani , Roxana Petcu , Evangelos Kanoulas , Faegheh Hasibi

The popularity of automatic speech-to-speech translation for human conversations is growing, but the quality varies significantly depending on the language pair. In a context of community interpreting for low-resource languages, namely…

Computation and Language · Computer Science 2025-06-03 Andrei Popescu-Belis , Alexis Allemann , Teo Ferrari , Gopal Krishnamani

Deep neural networks and huge language models are becoming omnipresent in natural language applications. As they are known for requiring large amounts of training data, there is a growing body of work to improve the performance in…

Computation and Language · Computer Science 2021-04-12 Michael A. Hedderich , Lukas Lange , Heike Adel , Jannik Strötgen , Dietrich Klakow

Spontaneous conversations in real-world settings such as those found in child-centered recordings have been shown to be amongst the most challenging audio files to process. Nevertheless, building speech processing models handling such a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-12 Marvin Lavechin , Ruben Bousbib , Hervé Bredin , Emmanuel Dupoux , Alejandrina Cristia

This report characterized the suitability of existing datasets for devising new Machine Learning models, decision making methods, and analysis algorithms to improve Collaborative Problem Solving and then enumerated requirements for future…

Machine Learning · Computer Science 2024-12-25 Gnaneswar Villuri , Alex Doboli

Audio captioning is a novel field of multi-modal translation and it is the task of creating a textual description of the content of an audio signal (e.g. "people talking in a big room"). The creation of a dataset for this task requires a…

Sound · Computer Science 2019-07-23 Samuel Lipping , Konstantinos Drossos , Tuomas Virtanen

To support machine learning of cross-language prosodic mappings and other ways to improve speech-to-speech translation, we present a protocol for collecting closely matched pairs of utterances across languages, a description of the…

Computation and Language · Computer Science 2023-07-17 Nigel G. Ward , Jonathan E. Avila , Emilia Rivas , Divette Marco

We present sentence aligned parallel corpora across 10 Indian Languages - Hindi, Telugu, Tamil, Malayalam, Gujarati, Urdu, Bengali, Oriya, Marathi, Punjabi, and English - many of which are categorized as low resource. The corpora are…

Computation and Language · Computer Science 2020-07-16 Shashank Siripragada , Jerin Philip , Vinay P. Namboodiri , C V Jawahar

Emerging digital technologies are exacerbating the existing divide in Open Access Data (OAD) between high-and low-resource languages, excluding many communities from the global digital transformation. Multilingual Linked Open Data Knowledge…

Artificial Intelligence · Computer Science 2026-05-08 Ndeye-Emilie Mbengue , Pierre Monnin , Miguel Couceiro , Fabien Gandon

Bengali is one of the most spoken languages in the world with over 300 million speakers globally. Despite its popularity, research into the development of Bengali speech recognition systems is hindered due to the lack of diverse open-source…