English
Related papers

Related papers: Bridging the Language Gap: Synthetic Voice Diversi…

200 papers

Approaches to improving multilingual language understanding often struggle with significant performance gaps between high-resource and low-resource languages. While there are efforts to align the languages in a single latent space to…

Computation and Language · Computer Science 2024-11-18 Haeji Jung , Changdae Oh , Jooeon Kang , Jimin Sohn , Kyungwoo Song , Jinkyu Kim , David R. Mortensen

Large language models (LLMs) have revolutionized various domains but still struggle with non-Latin scripts and low-resource languages. This paper addresses the critical challenge of improving multilingual performance without extensive…

Computation and Language · Computer Science 2025-01-08 Somnath Kumar , Vaibhav Balloli , Mercy Ranjit , Kabir Ahuja , Sunayana Sitaram , Kalika Bali , Tanuja Ganu , Akshay Nambi

In this paper, we perform an in-depth study of how data augmentation techniques improve synthetic or spoofed audio detection. Specifically, we propose methods to deal with channel variability, different audio compressions, different…

Sound · Computer Science 2021-10-22 Ariel Cohen , Inbal Rimon , Eran Aflalo , Haim Permuter

Recent advances in neural TTS have led to models that can produce high-quality synthetic speech. However, these models typically require large amounts of training data, which can make it costly to produce a new voice with the desired…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-25 Marcel de Korte , Jaebok Kim , Esther Klabbers

Deep learning-based pronunciation scoring models highly rely on the availability of the annotated non-native data, which is costly and has scalability issues. To deal with the data scarcity problem, data augmentation is commonly used for…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-04 Kaiqi Fu , Shaojun Gao , Kai Wang , Wei Li , Xiaohai Tian , Zejun Ma

Data augmentation, a widely-employed technique for addressing data scarcity, involves generating synthetic data examples which are then used to augment available training data. Researchers have seen surprising success from simple methods,…

Computation and Language · Computer Science 2025-06-05 Ray Groshan , Michael Ginn , Alexis Palmer

In this paper, we present MixRep, a simple and effective data augmentation strategy based on mixup for low-resource ASR. MixRep interpolates the feature dimensions of hidden representations in the neural network that can be applied to both…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-19 Jiamin Xie , John H. L. Hansen

Whispering is a distinct form of speech known for its soft, breathy, and hushed characteristics, often used for private communication. The acoustic characteristics of whispered speech differ substantially from normally phonated speech and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-08 Zhaofeng Lin , Tanvina Patel , Odette Scharenborg

Applying changes to an input speech signal to change the perceived speaker of speech to a target while maintaining the content of the input is a challenging but interesting task known as Voice conversion (VC). Over the last few years, this…

Sound · Computer Science 2022-12-29 Olga Slizovskaia , Jordi Janer , Pritish Chandna , Oscar Mayor

Human talkers often address listeners with language-comprehension challenges, such as hard-of-hearing or non-native adults, by globally slowing down their speech. However, it remains unclear whether this strategy actually makes speech more…

Computation and Language · Computer Science 2026-04-01 Paige Tuttösí , Angelica Lim , H. Henny Yeung , Yue Wang , Jean-Julien Aucouturier

The automatic recognition of pathological speech, particularly from children with any articulatory impairment, is a challenging task due to various reasons. The lack of available domain specific data is one such obstacle that hinders its…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-05 Protima Nomo Sudro , Rohan Kumar Das , Rohit Sinha , S. R. Mahadeva Prasanna

Spoken Language Models (SLMs) have emerged as a promising paradigm for speech synthesis by bypassing explicit grapheme-to-phoneme pipelines. However, their effectiveness in low-resource languages remains fundamentally limited by the…

Computation and Language · Computer Science 2026-05-28 Yizhong Geng , Yanliang Li , Jinghan Yang , Tianhan Jiang , Boxun An , Ya Li , Xiaoyu Shen

Exploiting cross-lingual resources is an effective way to compensate for data scarcity of low resource languages. Recently, a novel multilingual model fusion technique has been proposed where a model is trained to learn cross-lingual…

Computation and Language · Computer Science 2023-06-16 Muhammad Umar Farooq , Thomas Hain

Cross-lingual speech adaptation aims to solve the problem of leveraging multiple rich-resource languages to build models for a low-resource target language. Since the low-resource language has limited training data, speech recognition…

Computation and Language · Computer Science 2021-12-21 Wenxin Hou , Han Zhu , Yidong Wang , Jindong Wang , Tao Qin , Renjun Xu , Takahiro Shinozaki

Speech processing systems currently do not support the vast majority of languages, in part due to the lack of data in low-resource languages. Cross-lingual transfer offers a compelling way to help bridge this digital divide by incorporating…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-03 Peter Wu , Jiatong Shi , Yifan Zhong , Shinji Watanabe , Alan W Black

Efforts to leverage deep learning models in low-resource regimes have led to numerous augmentation studies. However, the direct application of methods such as mixup and cutout to text data, is limited due to their discrete characteristics.…

Computation and Language · Computer Science 2024-03-26 Kyohoon Jin , Junho Lee , Juhwan Choi , Sangmin Song , Youngbin Kim

Automatic speech recognition systems have achieved remarkable performance on fluent speech but continue to degrade significantly when processing stuttered speech, a limitation that is particularly acute for low-resource languages like…

Computation and Language · Computer Science 2026-01-15 Fadhil Muhammad , Alwin Djuliansah , Adrian Aryaputra Hamzah , Kurniawati Azizah

Spoken Language Understanding (SLU) is one essential step in building a dialogue system. Due to the expensive cost of obtaining the labeled data, SLU suffers from the data scarcity problem. Therefore, in this paper, we focus on data…

Computation and Language · Computer Science 2021-09-03 Haitao Lin , Lu Xiang , Yu Zhou , Jiajun Zhang , Chengqing Zong

With the advances in deep learning, speech enhancement systems benefited from large neural network architectures and achieved state-of-the-art quality. However, speaker-agnostic methods are not always desirable, both in terms of quality and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-15 Anastasia Kuznetsova , Aswin Sivaraman , Minje Kim

Despite the rapid growth in model architecture, the scarcity of large parallel corpora remains the main bottleneck in Neural Machine Translation. Data augmentation is a technique that enhances the performance of data-hungry models by…

Computation and Language · Computer Science 2023-11-14 Seokjin Oh , Su Ah Lee , Woohwan Jung