English
Related papers

Related papers: Using Songs to Improve Kazakh Automatic Speech Rec…

200 papers

Most of the previous approaches to lyrics-to-audio alignment used a pre-developed automatic speech recognition (ASR) system that innately suffered from several difficulties to adapt the speech model to individual singers. A significant…

Sound · Computer Science 2020-10-29 Sungkyun Chang , Kyogu Lee

Multilingual Automatic Speech Recognition (ASR) aims to recognize and transcribe speech from multiple languages within a single system. Whisper, one of the most advanced ASR models, excels in this domain by handling 99 languages…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-24 Shao-Syuan Huang , Kuan-Po Huang , Andy T. Liu , Hung-yi Lee

Automatic Speech Recognition (ASR) systems have achieved remarkable performance on widely used benchmarks such as LibriSpeech and Fleurs. However, these benchmarks do not adequately reflect the complexities of real-world conversational…

Computation and Language · Computer Science 2024-09-19 Gaurav Maheshwari , Dmitry Ivanov , Théo Johannet , Kevin El Haddad

Multilingual Automatic Speech Recognition (ASR) models are typically evaluated in a setting where the ground-truth language of the speech utterance is known, however, this is often not the case for most practical settings. Automatic Spoken…

Computation and Language · Computer Science 2024-09-30 Brian Yan , Vineel Pratap , Shinji Watanabe , Michael Auli

This paper introduces FLEURS-R, a speech restoration applied version of the Few-shot Learning Evaluation of Universal Representations of Speech (FLEURS) corpus. FLEURS-R maintains an N-way parallel speech corpus in 102 languages as FLEURS,…

Computation and Language · Computer Science 2024-08-13 Min Ma , Yuma Koizumi , Shigeki Karita , Heiga Zen , Jason Riesa , Haruko Ishikawa , Michiel Bacchiani

Exploiting cross-lingual resources is an effective way to compensate for data scarcity of low resource languages. Recently, a novel multilingual model fusion technique has been proposed where a model is trained to learn cross-lingual…

Computation and Language · Computer Science 2023-06-16 Muhammad Umar Farooq , Thomas Hain

Code-switching (CS) automatic speech recognition (ASR) faces challenges due to the language confusion resulting from accents, auditory similarity, and seamless language switches. Adaptation on the pre-trained multi-lingual model has shown…

Computation and Language · Computer Science 2025-01-07 Jiahui Zhao , Hao Shi , Chenrui Cui , Tianrui Wang , Hexin Liu , Zhaoheng Ni , Lingxuan Ye , Longbiao Wang

Arabic is known to present unique challenges for Automatic Speech Recognition (ASR). On one hand, its rich linguistic diversity and wide range of dialects complicate the development of robust, inclusive models. On the other, current…

Computation and Language · Computer Science 2024-06-10 Abdul Waheed , Karima Kadaoui , Muhammad Abdul-Mageed

With 4.5 million hours of English speech from 10 different sources across 120 countries and models of up to 10 billion parameters, we explore the frontiers of scale for automatic speech recognition. We propose data selection techniques to…

Computation and Language · Computer Science 2021-11-30 Alex Xiao , Weiyi Zheng , Gil Keren , Duc Le , Frank Zhang , Christian Fuegen , Ozlem Kalinli , Yatharth Saraf , Abdelrahman Mohamed

The tasks of automatic lyrics transcription and lyrics alignment have witnessed significant performance improvements in the past few years. However, most of the previous works only focus on English in which large-scale datasets are…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-22 Jun-You Wang , Chon-In Leong , Yu-Chen Lin , Li Su , Jyh-Shing Roger Jang

Although Automatic Speech Recognition (ASR) systems have become an integral part of modern technology, their evaluation remains challenging, particularly for low-resource languages such as Persian. This paper introduces Persian Speech…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-28 Nima Sedghiyeh , Sara Sadeghi , Reza Khodadadi , Farzin Kashani , Omid Aghdaei , Somayeh Rahimi , Mohammad Sadegh Safari

Producing a large amount of annotated speech data for training ASR systems remains difficult for more than 95% of languages all over the world which are low-resourced. However, we note human babies start to learn the language by the sounds…

Computation and Language · Computer Science 2019-04-11 Yi-Chen Chen , Sung-Feng Huang , Hung-yi Lee , Lin-shan Lee

Automatic Lyrics Transcription (ALT) for Vietnamese music presents unique challenges due to its tonal complexity and dialectal variations, but remains largely unexplored due to the lack of a dedicated dataset. Therefore, we curated the…

Artificial Intelligence · Computer Science 2025-12-23 Quoc Anh Nguyen , Bernard Cheng , Kelvin Soh

State-of-the-art automatic speech recognition (ASR) systems perform well on healthy speech. However, the performance on impaired speech still remains an issue. The current study explores the usefulness of using Wav2Vec self-supervised…

Computation and Language · Computer Science 2022-04-05 Abner Hernandez , Paula Andrea Pérez-Toro , Elmar Nöth , Juan Rafael Orozco-Arroyave , Andreas Maier , Seung Hee Yang

Automatic Speech Recognition (ASR) systems often struggle to accurately process children's speech due to its distinct and highly variable acoustic and linguistic characteristics. While recent advancements in self-supervised learning (SSL)…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-01 Abhijit Sinha , Hemant Kumar Kathania , Sudarsana Reddy Kadiri , Shrikanth Narayanan

Large-scale multilingual ASR models like Whisper excel in high-resource settings but face challenges in low-resource scenarios, such as rare languages and code-switching (CS), due to computational costs and catastrophic forgetting. We…

Computation and Language · Computer Science 2025-09-29 Hongli Yang , Yizhou Peng , Hao Huang , Sheng Li

Training a robust Automatic Speech Recognition (ASR) system for children's speech recognition is a challenging task due to inherent differences in acoustic attributes of adult and child speech and scarcity of publicly available children's…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-15 Vishwanath Pratap Singh , Hardik Sailor , Supratik Bhattacharya , Abhishek Pandey

Speech is understood better by using visual context; for this reason, there have been many attempts to use images to adapt automatic speech recognition (ASR) systems. Current work, however, has shown that visually adapted ASR models only…

Computation and Language · Computer Science 2020-02-19 Tejas Srinivasan , Ramon Sanabria , Florian Metze

We present a frontend for improving robustness of automatic speech recognition (ASR), that jointly implements three modules within a single model: acoustic echo cancellation, speech enhancement, and speech separation. This is achieved by…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-22 Tom O'Malley , Arun Narayanan , Quan Wang , Alex Park , James Walker , Nathan Howard

Automatic Speech Recognition (ASR) performance is heavily dependent on the availability of large-scale, high-quality datasets. For low-resource languages, existing open-source ASR datasets often suffer from insufficient quality and…

Computation and Language · Computer Science 2026-03-17 Thi Vu , Linh The Nguyen , Dat Quoc Nguyen