English
Related papers

Related papers: Elderly-Contextual Data Augmentation via Speech Sy…

200 papers

While supervised quality predictors for synthesized speech have demonstrated strong correlations with human ratings, their requirement for in-domain labeled training data hinders their generalization ability to new domains. Unsupervised…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-08 Erica Cooper , Takuma Okamoto , Yamato Ohtani , Tomoki Toda , Hisashi Kawai

Speech enhancement has recently achieved great success with various deep learning methods. However, most conventional speech enhancement systems are trained with supervised methods that impose two significant challenges. First, a majority…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-22 Viet Anh Trinh , Sebastian Braun

Data sparsity is a main problem hindering the development of code-switching (CS) NLP systems. In this paper, we investigate data augmentation techniques for synthesizing dialectal Arabic-English CS text. We perform lexical replacements…

Computation and Language · Computer Science 2023-04-05 Injy Hamed , Nizar Habash , Slim Abdennadher , Ngoc Thang Vu

With the advancement of speech synthesis technology, users have higher expectations for the naturalness and expressiveness of synthesized speech. But previous research ignores the importance of prompt selection. This study proposes a…

Sound · Computer Science 2025-04-15 Dan Luo , Chengyuan Ma , Weiqin Li , Jun Wang , Wei Chen , Zhiyong Wu

Advancements in deep neural networks have allowed automatic speech recognition (ASR) systems to attain human parity on several publicly available clean speech datasets. However, even state-of-the-art ASR systems experience performance…

Computation and Language · Computer Science 2023-10-17 Chen Chen , Yuchen Hu , Chao-Han Huck Yang , Sabato Macro Siniscalchi , Pin-Yu Chen , Eng Siong Chng

One common approach for question answering over speech data is to first transcribe speech using automatic speech recognition (ASR) and then employ text-based retrieval-augmented generation (RAG) on the transcriptions. While this cascaded…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-06 Do June Min , Karel Mundnich , Andy Lapastora , Erfan Soltanmohammadi , Srikanth Ronanki , Kyu Han

In this paper, we describe several techniques for improving the acoustic and language model of an automatic speech recognition (ASR) system operating on code-switching (CS) speech. We focus on the recognition of Frisian-Dutch radio…

Computation and Language · Computer Science 2018-07-31 Emre Yılmaz , Henk van den Heuvel , David A. van Leeuwen

End-to-end (E2E) automatic speech recognition (ASR) models have recently demonstrated superior performance over the traditional hybrid ASR models. Training an E2E ASR model requires a large amount of data which is not only expensive but may…

Machine Learning · Computer Science 2021-06-16 Amin Fazel , Wei Yang , Yulan Liu , Roberto Barra-Chicote , Yixiong Meng , Roland Maas , Jasha Droppo

Artificial speech synthesis has made a great leap in terms of naturalness as recent Text-to-Speech (TTS) systems are capable of producing speech with similar quality to human recordings. However, not all speaking styles are easy to model:…

Generative error correction (GER) with large language models (LLMs) has emerged as an effective post-processing approach to improve automatic speech recognition (ASR) performance. However, it often struggles with rare or domain-specific…

Sound · Computer Science 2025-05-26 Natsuo Yamashita , Masaaki Yamamoto , Hiroaki Kokubo , Yohei Kawaguchi

Automatic Speech Recognition (ASR) has recently shown remarkable progress, but accurately transcribing children's speech remains a significant challenge. Recent developments in Large Language Models (LLMs) have shown promise in improving…

Computation and Language · Computer Science 2025-05-27 Anfeng Xu , Tiantian Feng , So Hyun Kim , Somer Bishop , Catherine Lord , Shrikanth Narayanan

In recent years, automatic speech recognition (ASR) systems have significantly improved, especially in languages with a vast amount of transcribed speech data. However, ASR systems tend to perform poorly for low-resource languages with…

Computation and Language · Computer Science 2024-06-04 Ara Yeroyan , Nikolay Karpov

Automatic Speech Recognition (ASR) systems have been evolving quickly and reaching human parity in certain cases. The systems usually perform pretty well on reading style and clean speech, however, most of the available systems suffer from…

Computation and Language · Computer Science 2019-10-15 Quang Minh Nguyen , Thai Binh Nguyen , Ngoc Phuong Pham , The Loc Nguyen

Data augmentation (DA) is ubiquitously used in training of Automatic Speech Recognition (ASR) models. DA offers increased data variability, robustness and generalization against different acoustic distortions. Recently, personalization of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-20 Pablo Peso Parada , Spyros Fontalis , Md Asif Jalal , Karthikeyan Saravanan , Anastasios Drosou , Mete Ozay , Gil Ho Lee , Jungin Lee , Seokyeong Jung

Recent advancements in deep learning have significantly enhanced multilingual automatic speech recognition (ASR) due to the development of advanced model architectures and available large-scale multilingual datasets. Despite that,…

Computation and Language · Computer Science 2025-06-30 Jiahong Li , Yiwen Shao , Jianheng Zhuo , Chenda Li , Liliang Tang , Dong Yu , Yanmin Qian

Automated speaking assessment (ASA) on opinion expressions is often hampered by the scarcity of labeled recordings, which restricts prompt diversity and undermines scoring reliability. To address this challenge, we propose a novel training…

Computation and Language · Computer Science 2025-09-12 Chung-Chun Wang , Jhen-Ke Lin , Hao-Chien Lu , Hong-Yun Lin , Berlin Chen

This paper proposes a novel linear prediction coding-based data aug-mentation method for children's low and zero resource dialect ASR. The data augmentation procedure consists of perturbing the formant peaks of the LPC spectrum during LPC…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-23 Alexander Johnson , Ruchao Fan , Robin Morris , Abeer Alwan

Nowadays, data augmentation through synthetic data has been widely used in the field of Grammatical Error Correction (GEC) to alleviate the problem of data scarcity. However, these synthetic data are mainly used in the pre-training phase…

Computation and Language · Computer Science 2024-06-26 Yixuan Wang , Baoxin Wang , Yijun Liu , Qingfu Zhu , Dayong Wu , Wanxiang Che

The INTERSPEECH 2025 Challenge on Multilingual Conversational Speech Language Models (MLC-SLM) promotes multilingual conversational ASR with large language models (LLMs). Our previous SHNU-mASR system adopted a competitive…

Computation and Language · Computer Science 2026-02-03 Yuxiang Mei , Dongxing Xu , Jiaen Liang , Yanhua Long

Given recent advances in generative AI technology, a key question is how large language models (LLMs) can enhance acoustic modeling tasks using text decoding results from a frozen, pretrained automatic speech recognition (ASR) model. To…