English
Related papers

Related papers: TalkNet: Fully-Convolutional Non-Autoregressive Sp…

200 papers

Text-to-Speech (TTS) has recently seen great progress in synthesizing high-quality speech owing to the rapid development of parallel TTS systems, but producing speech with naturalistic prosodic variations, speaking styles and emotional…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-21 Yinghao Aaron Li , Cong Han , Nima Mesgarani

A lot of work has been done to build text-based language models for performing different NLP tasks, but not much research has been done in the case of audio-based language models. This paper proposes a Convolutional Autoencoder based neural…

Computation and Language · Computer Science 2020-09-30 Prakamya Mishra , Pranav Mathur

Neural speech synthesis models can synthesize high quality speech but typically require a high computational complexity to do so. In previous work, we introduced LPCNet, which uses linear prediction to significantly reduce the complexity of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-24 Jean-Marc Valin , Umut Isik , Paris Smaragdis , Arvindh Krishnaswamy

Attention-based end-to-end text-to-speech synthesis (TTS) is superior to conventional statistical methods in many ways. Transformer-based TTS is one of such successful implementations. While Transformer TTS models the speech frame sequence…

Machine Learning · Computer Science 2021-03-29 Rui Liu , Berrak Sisman , Haizhou Li

This paper proposes a WaveNet-based neural excitation model (ExcitNet) for statistical parametric speech synthesis systems. Conventional WaveNet-based neural vocoding systems significantly improve the perceptual quality of synthesized…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-23 Eunwoo Song , Kyungguen Byun , Hong-Goo Kang

This paper describes a variational auto-encoder based non-autoregressive text-to-speech (VAENAR-TTS) model. The autoregressive TTS (AR-TTS) models based on the sequence-to-sequence architecture can generate high-quality speech, but their…

Sound · Computer Science 2021-07-08 Hui Lu , Zhiyong Wu , Xixin Wu , Xu Li , Shiyin Kang , Xunying Liu , Helen Meng

Language models are increasingly used not only as standalone predictors but also as components in larger inference systems, from test-time reasoning to multi-model collaboration. We study language model networks, where pre-trained language…

Artificial Intelligence · Computer Science 2026-05-14 Shiguang Wu , Yaqing Wang , Quanming Yao

Recently, deep learning-based Text-to-Speech (TTS) systems have achieved high-quality speech synthesis results. Recurrent neural networks have become a standard modeling technique for sequential data in TTS systems and are widely used.…

Sound · Computer Science 2024-03-19 Ziqi Liang , Haoxiang Shi , Jiawei Wang , Keda Lu

In this work, a robust and efficient text-to-speech (TTS) synthesis system named Triple M is proposed for large-scale online application. The key components of Triple M are: 1) A sequence-to-sequence model adopts a novel multi-guidance…

Computation and Language · Computer Science 2021-04-08 Shilun Lin , Fenglong Xie , Li Meng , Xinhui Li , Li Lu

In this work, we propose Retentive Network (RetNet) as a foundation architecture for large language models, simultaneously achieving training parallelism, low-cost inference, and good performance. We theoretically derive the connection…

Computation and Language · Computer Science 2023-08-10 Yutao Sun , Li Dong , Shaohan Huang , Shuming Ma , Yuqing Xia , Jilong Xue , Jianyong Wang , Furu Wei

Recurrent Neural Networks (RNNs) have become the standard modeling technique for sequence data, and are used in a number of novel text-to-speech models. However, training a TTS model including RNN components has certain requirements for GPU…

Computation and Language · Computer Science 2023-04-18 Ziqi Liang

We propose an end-to-end model based on convolutional and recurrent neural networks for speech enhancement. Our model is purely data-driven and does not make any assumptions about the type or the stationarity of the noise. In contrast to…

Sound · Computer Science 2018-05-03 Han Zhao , Shuayb Zarar , Ivan Tashev , Chin-Hui Lee

State-of-the-art sequence-to-sequence acoustic networks, that convert a phonetic sequence to a sequence of spectral features with no explicit prosody prediction, generate speech with close to natural quality, when cascaded with neural…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-26 Slava Shechtman , Carmel Rabinovitz , Alex Sorin , Zvi Kons , Ron Hoory

In this work, we propose a new solution for parallel wave generation by WaveNet. In contrast to parallel WaveNet (van den Oord et al., 2018), we distill a Gaussian inverse autoregressive flow from the autoregressive WaveNet by minimizing a…

Computation and Language · Computer Science 2019-02-25 Wei Ping , Kainan Peng , Jitong Chen

We present a meta-learning approach for adaptive text-to-speech (TTS) with few data. During training, we learn a multi-speaker model using a shared conditional WaveNet core and independent learned embeddings for each speaker. The aim of…

Speaker extraction is to extract a target speaker's voice from multi-talker speech. It simulates humans' cocktail party effect or the selective listening ability. The prior work mostly performs speaker extraction in frequency domain, then…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-01 Chenglin Xu , Wei Rao , Eng Siong Chng , Haizhou Li

In this paper, we propose a high-quality generative text-to-speech (TTS) system using an effective spectrum and excitation estimation method. Our previous research verified the effectiveness of the ExcitNet-based speech generation model in…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-22 Ohsung Kwon , Eunwoo Song , Jae-Min Kim , Hong-Goo Kang

This paper presents a novel neural speech phase prediction model which predicts wrapped phase spectra directly from amplitude spectra. The proposed model is a cascade of a residual convolutional network and a parallel estimation…

Sound · Computer Science 2024-03-27 Yang Ai , Zhen-Hua Ling

This paper presents a simple end-to-end model for speech recognition, combining a convolutional network based acoustic model and a graph decoding. It is trained to output letters, with transcribed speech, without the need for force…

Machine Learning · Computer Science 2016-09-14 Ronan Collobert , Christian Puhrsch , Gabriel Synnaeve

This paper introduces Parallel Tacotron 2, a non-autoregressive neural text-to-speech model with a fully differentiable duration model which does not require supervised duration signals. The duration model is based on a novel attention…

Sound · Computer Science 2021-08-31 Isaac Elias , Heiga Zen , Jonathan Shen , Yu Zhang , Ye Jia , RJ Skerry-Ryan , Yonghui Wu