中文
相关论文

相关论文: Low-Resource Text-to-Speech Using Specific Data an…

200 篇论文

Recurrent Neural Networks (RNNs) have become the standard modeling technique for sequence data, and are used in a number of novel text-to-speech models. However, training a TTS model including RNN components has certain requirements for GPU…

计算与语言 · 计算机科学 2023-04-18 Ziqi Liang

Aiming at reducing the reliance on expensive human annotations, data synthesis for Automatic Speech Recognition (ASR) has remained an active area of research. While prior work mainly focuses on synthetic speech generation for ASR data…

In this work we evaluate the utility of synthetic data for training automatic speech recognition (ASR). We use the ASR training data to train a text-to-speech (TTS) system similar to FastSpeech-2. With this TTS we reproduce the original…

计算与语言 · 计算机科学 2024-10-29 Benedikt Hilmes , Nick Rossenbach , and Ralf Schlüter

Recent success of the Tacotron speech synthesis architecture and its variants in producing natural sounding multi-speaker synthesized speech has raised the exciting possibility of replacing expensive, manually transcribed, domain-specific,…

计算与语言 · 计算机科学 2019-09-27 Andrew Rosenberg , Yu Zhang , Bhuvana Ramabhadran , Ye Jia , Pedro Moreno , Yonghui Wu , Zelin Wu

Recent neural Text-to-Speech (TTS) models have been shown to perform very well when enough data is available. However, fine-tuning them for new speakers or languages is not straightforward in a low-resource setup. In this paper, we show…

声音 · 计算机科学 2022-04-01 Hamed Hemati , Damian Borth

Most text-to-speech (TTS) methods use high-quality speech corpora recorded in a well-designed environment, incurring a high cost for data collection. To solve this problem, existing noise-robust TTS methods are intended to use noisy speech…

声音 · 计算机科学 2022-06-30 Takaaki Saeki , Kentaro Tachibana , Ryuichi Yamamoto

With the popularity of deep neural network, speech synthesis task has achieved significant improvements based on the end-to-end encoder-decoder framework in the recent days. More and more applications relying on speech synthesis technology…

音频与语音处理 · 电气工程与系统科学 2020-10-23 Dongyang Dai , Li Chen , Yuping Wang , Mu Wang , Rui Xia , Xuchen Song , Zhiyong Wu , Yuxuan Wang

Neural TTS has shown it can generate high quality synthesized speech. In this paper, we investigate the multi-speaker latent space to improve neural TTS for adapting the system to new speakers with only several minutes of speech or…

音频与语音处理 · 电气工程与系统科学 2019-09-04 Yan Deng , Lei He , Frank Soong

Building multispeaker neural network-based text-to-speech synthesis systems commonly relies on the availability of large amounts of high quality recordings from each speaker and conditioning the training process on the speaker's identity or…

音频与语音处理 · 电气工程与系统科学 2021-06-04 Beata Lorincz , Adriana Stan , Mircea Giurgiu

Data augmentation is a technique to generate new training data based on existing data. We evaluate the simple and cost-effective method of concatenating the original data examples to build new training instances. Continued training with…

计算与语言 · 计算机科学 2023-06-12 Tsz Kin Lam , Shigehiko Schamoni , Stefan Riezler

Training neural text-to-speech (TTS) models for a new speaker typically requires several hours of high quality speech data. Prior works on voice cloning attempt to address this challenge by adapting pre-trained multi-speaker TTS models for…

声音 · 计算机科学 2022-04-07 Paarth Neekhara , Jason Li , Boris Ginsburg

High-quality and intelligible speech is essential to text-to-speech (TTS) model training, however, obtaining high-quality data for low-resource languages is challenging and expensive. Applying speech enhancement on Automatic Speech…

音频与语音处理 · 电气工程与系统科学 2023-09-20 Zhaoheng Ni , Sravya Popuri , Ning Dong , Kohei Saijo , Xiaohui Zhang , Gael Le Lan , Yangyang Shi , Vikas Chandra , Changhan Wang

Text-to-speech (TTS) systems offer the opportunity to compensate for a hearing loss at the source rather than correcting for it at the receiving end. This removes limitations such as time constraints for algorithms that amplify a sound in a…

音频与语音处理 · 电气工程与系统科学 2021-03-23 Josef Schlittenlacher , Thomas Baer

This paper investigates the use of unsupervised text-to-speech synthesis (TTS) as a data augmentation method to improve accented speech recognition. TTS systems are trained with a small amount of accented speech training data and their…

计算与语言 · 计算机科学 2024-07-08 Cong-Thanh Do , Shuhei Imai , Rama Doddipatla , Thomas Hain

For articulatory-to-acoustic mapping, typically only limited parallel training data is available, making it impossible to apply fully end-to-end solutions like Tacotron2. In this paper, we experimented with transfer learning and adaptation…

音频与语音处理 · 电气工程与系统科学 2021-07-27 Csaba Zainkó , László Tóth , Amin Honarmandi Shandiz , Gábor Gosztolya , Alexandra Markó , Géza Németh , Tamás Gábor Csapó

The rapid growth of voice assistants powered by large language models (LLM) has highlighted a need for speech instruction data to train these systems. Despite the abundance of speech recognition data, there is a notable scarcity of speech…

音频与语音处理 · 电气工程与系统科学 2025-08-26 Alan Dao , Dinh Bach Vu , Huy Hoang Ha , Tuan Le Duc Anh , Shreyas Gopal , Yue Heng Yeo , Warren Keng Hoong Low , Eng Siong Chng , Jia Qi Yip

While automatic speech recognition (ASR) systems have achieved remarkable performance with large-scale datasets, their efficacy remains inadequate in low-resource settings, encompassing dialects, accents, minority languages, and long-tail…

音频与语音处理 · 电气工程与系统科学 2024-10-23 Guanrou Yang , Fan Yu , Ziyang Ma , Zhihao Du , Zhifu Gao , Shiliang Zhang , Xie Chen

Sequence-to-Sequence (S2S) models recently started to show state-of-the-art performance for automatic speech recognition (ASR). With these large and deep models overfitting remains the largest problem, outweighing performance improvements…

音频与语音处理 · 电气工程与系统科学 2020-02-04 Thai-Son Nguyen , Sebastian Stueker , Jan Niehues , Alex Waibel

In end-to-end automatic speech recognition system, one of the difficulties for language expansion is the limited paired speech and text training data. In this paper, we propose a novel method to generate augmented samples with unpaired…

音频与语音处理 · 电气工程与系统科学 2023-08-01 Eric Sun , Jinyu Li , Jian Xue , Yifan Gong

We present a textless speech-to-speech translation (S2ST) system that can translate speech from one language into another language and can be built without the need of any text data. Different from existing work in the literature, we tackle…