中文
相关论文

相关论文: Towards Robust Neural Vocoding for Speech Generati…

200 篇论文

This work proposes the use of clean speech vocoder parameters as the target for a neural network performing speech enhancement. These parameters have been designed for text-to-speech synthesis so that they both produce high-quality…

音频与语音处理 · 电气工程与系统科学 2019-04-03 Soumi Maiti , Michael I Mandel

Recently the state-of-the-art text-to-speech synthesis systems have shifted to a two-model approach: a sequence-to-sequence model to predict a representation of speech (typically mel-spectrograms), followed by a 'neural vocoder' model which…

音频与语音处理 · 电气工程与系统科学 2020-12-18 Jonas Rohnke , Tom Merritt , Jaime Lorenzo-Trueba , Adam Gabrys , Vatsal Aggarwal , Alexis Moinet , Roberto Barra-Chicote

Despite recent progress in generative adversarial network (GAN)-based vocoders, where the model generates raw waveform conditioned on acoustic features, it is challenging to synthesize high-fidelity audio for numerous speakers across…

声音 · 计算机科学 2023-02-17 Sang-gil Lee , Wei Ping , Boris Ginsburg , Bryan Catanzaro , Sungroh Yoon

The state-of-the-art in text-to-speech synthesis has recently improved considerably due to novel neural waveform generation methods, such as WaveNet. However, these methods suffer from their slow sequential inference process, while their…

音频与语音处理 · 电气工程与系统科学 2018-10-31 Lauri Juvela , Bajibabu Bollepalli , Junichi Yamagishi , Paavo Alku

Neural evaluation metrics derived for numerous speech generation tasks have recently attracted great attention. In this paper, we propose SVSNet, the first end-to-end neural network model to assess the speaker voice similarity between…

音频与语音处理 · 电气工程与系统科学 2022-03-28 Cheng-Hung Hu , Yu-Huai Peng , Junichi Yamagishi , Yu Tsao , Hsin-Min Wang

To date, various speech technology systems have adopted the vocoder approach, a method for synthesizing speech waveform that shows a major role in the performance of statistical parametric speech synthesis. WaveNet one of the best models…

声音 · 计算机科学 2021-06-15 Mohammed Salah Al-Radhi , Tamás Gábor Csapó , Csaba Zainkó , Géza Németh

Voice conversion technologies have been greatly improved in recent years with the help of deep learning, but their capabilities of producing natural sounding utterances in different conditions remain unclear. In this paper, we gave a…

音频与语音处理 · 电气工程与系统科学 2021-05-04 Tzu-hsien Huang , Jheng-hao Lin , Chien-yu Huang , Hung-yi Lee

Benefiting from the development of deep learning, text-to-speech (TTS) techniques using clean speech have achieved significant performance improvements. The data collected from real scenes often contains noise and generally needs to be…

音频与语音处理 · 电气工程与系统科学 2023-09-06 Qiushi Zhu , Yu Gu , Rilin Chen , Chao Weng , Yuchen Hu , Lirong Dai , Jie Zhang

Most neural vocoders employ band-limited mel-spectrograms to generate waveforms. If full-band spectral features are used as the input, the vocoder can be provided with as much acoustic information as possible. However, in some models…

音频与语音处理 · 电气工程与系统科学 2021-06-16 Won Jang , Dan Lim , Jaesam Yoon , Bongwan Kim , Juntae Kim

Recent speech technology research has seen a growing interest in using WaveNets as statistical vocoders, i.e., generating speech waveforms from acoustic features. These models have been shown to improve the generated speech quality over…

音频与语音处理 · 电气工程与系统科学 2018-04-26 Lauri Juvela , Vassilis Tsiaras , Bajibabu Bollepalli , Manu Airaksinen , Junichi Yamagishi , Paavo Alku

The development of neural vocoders (NVs) has resulted in the high-quality and fast generation of waveforms. However, conventional NVs target a single sampling rate and require re-training when applied to different sampling rates. A suitable…

音频与语音处理 · 电气工程与系统科学 2022-06-27 Kentaro Mitsui , Kei Sawada

Neural networks have recently become good at engaging in dialog. However, current approaches are based solely on verbal text, lacking the richness of a real face-to-face conversation. We propose a neural conversation model that aims to read…

计算机视觉与模式识别 · 计算机科学 2018-12-05 Hang Chu , Daiqing Li , Sanja Fidler

Vocoders received renewed attention as main components in statistical parametric text-to-speech (TTS) synthesis and speech transformation systems. Even though there are vocoding techniques give almost accepted synthesized speech, their high…

声音 · 计算机科学 2021-06-22 Mohammed Salah Al-Radhi , Tamás Gábor Csapó , Géza Németh

Precise control over speech characteristics, such as pitch, duration, and speech rate, remains a significant challenge in the field of voice conversion. The ability to manipulate parameters like pitch and syllable rate is an important…

声音 · 计算机科学 2025-07-08 Mathilde Abrassart , Nicolas Obin , Axel Roebel

We present SVCnet, a system for modelling speaker variability. Encoder Neural Networks specialized for each speech sound produce low dimensionality models of acoustical variation, and these models are further combined into an overall model…

声音 · 计算机科学 2022-11-17 Michael Witbrock , Patrick Haffner

This paper introduces WaveNet, a deep neural network for generating raw audio waveforms. The model is fully probabilistic and autoregressive, with the predictive distribution for each audio sample conditioned on all previous ones;…

This work considers training neural networks for speaker recognition with a much smaller dataset size compared to contemporary work. We artificially restrict the amount of data by proposing three subsets of the popular VoxCeleb2 dataset.…

声音 · 计算机科学 2023-02-28 Nik Vaessen , David A. van Leeuwen

We explore pretraining strategies including choice of base corpus with the aim of choosing the best strategy for zero-shot multi-speaker end-to-end synthesis. We also examine choice of neural vocoder for waveform synthesis, as well as…

声音 · 计算机科学 2020-11-11 Erica Cooper , Xin Wang , Yi Zhao , Yusuke Yasuda , Junichi Yamagishi

We investigate a novel cross-lingual multi-speaker text-to-speech synthesis approach for generating high-quality native or accented speech for native/foreign seen/unseen speakers in English and Mandarin. The system consists of three…

音频与语音处理 · 电气工程与系统科学 2019-11-27 Zhaoyu Liu , Brian Mak

We present a meta-learning approach for adaptive text-to-speech (TTS) with few data. During training, we learn a multi-speaker model using a shared conditional WaveNet core and independent learned embeddings for each speaker. The aim of…