English
Related papers

Related papers: FeatherWave: An efficient high-fidelity neural voc…

200 papers

Neural speech synthesis models have recently demonstrated the ability to synthesize high quality speech for text-to-speech and compression applications. These new models often require powerful GPUs to achieve real-time operation, so being…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-20 Jean-Marc Valin , Jan Skoglund

Neural speech synthesis algorithms are a promising new approach for coding speech at very low bitrate. They have so far demonstrated quality that far exceeds traditional vocoders, at the cost of very high complexity. In this work, we…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-01 Jean-Marc Valin , Jan Skoglund

We propose a linear prediction (LP)-based waveform generation method via WaveNet vocoding framework. A WaveNet-based neural vocoder has significantly improved the quality of parametric text-to-speech (TTS) systems. However, it is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-05 Min-Jae Hwang , Frank Soong , Eunwoo Song , Xi Wang , Hyeonjoo Kang , Hong-Goo Kang

In this paper, we propose an improved LPCNet vocoder using a linear prediction (LP)-structured mixture density network (MDN). The recently proposed LPCNet vocoder has successfully achieved high-quality and lightweight speech synthesis…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-03 Min-Jae Hwang , Eunwoo Song , Ryuichi Yamamoto , Frank Soong , Hong-Goo Kang

State-of-the-art sequence-to-sequence acoustic networks, that convert a phonetic sequence to a sequence of spectral features with no explicit prosody prediction, generate speech with close to natural quality, when cascaded with neural…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-26 Slava Shechtman , Carmel Rabinovitz , Alex Sorin , Zvi Kons , Ron Hoory

Neural speech synthesis models can synthesize high quality speech but typically require a high computational complexity to do so. In previous work, we introduced LPCNet, which uses linear prediction to significantly reduce the complexity of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-24 Jean-Marc Valin , Umut Isik , Paris Smaragdis , Arvindh Krishnaswamy

Neural vocoders have recently demonstrated high quality speech synthesis, but typically require a high computational complexity. LPCNet was proposed as a way to reduce the complexity of neural synthesis by using linear prediction (LP) to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-31 Krishna Subramani , Jean-Marc Valin , Umut Isik , Paris Smaragdis , Arvindh Krishnaswamy

We present a lightweight adaptable neural TTS system with high quality output. The system is composed of three separate neural network blocks: prosody prediction, acoustic feature prediction and Linear Prediction Coding Net as a neural…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-27 Zvi Kons , Slava Shechtman , Alex Sorin , Carmel Rabinovitz , Ron Hoory

Recently, neural vocoders have been widely used in speech synthesis tasks, including text-to-speech and voice conversion. However, when encountering data distribution mismatch between training and inference, neural vocoders trained on real…

Sound · Computer Science 2020-08-21 Po-chun Hsu , Chun-hsuan Wang , Andy T. Liu , Hung-yi Lee

Recently the state-of-the-art text-to-speech synthesis systems have shifted to a two-model approach: a sequence-to-sequence model to predict a representation of speech (typically mel-spectrograms), followed by a 'neural vocoder' model which…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-18 Jonas Rohnke , Tom Merritt , Jaime Lorenzo-Trueba , Adam Gabrys , Vatsal Aggarwal , Alexis Moinet , Roberto Barra-Chicote

We present a novel high-fidelity real-time neural vocoder called VocGAN. A recently developed GAN-based vocoder, MelGAN, produces speech waveforms in real-time. However, it often produces a waveform that is insufficient in quality or…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-31 Jinhyeok Yang , Junmo Lee , Youngik Kim , Hoonyoung Cho , Injung Kim

Nowadays more and more applications can benefit from edge-based text-to-speech (TTS). However, most existing TTS models are too computationally expensive and are not flexible enough to be deployed on the diverse variety of edge devices with…

Sound · Computer Science 2020-11-30 Bichen Wu , Qing He , Peizhao Zhang , Thilo Koehler , Kurt Keutzer , Peter Vajda

This paper presents a novel high-fidelity and low-latency universal neural vocoder framework based on multiband WaveRNN with data-driven linear prediction for discrete waveform modeling (MWDLP). MWDLP employs a coarse-fine bit WaveRNN…

Sound · Computer Science 2021-07-06 Patrick Lumban Tobing , Tomoki Toda

Text-to-Speech (TTS) services that run on edge devices have many advantages compared to cloud TTS, e.g., latency and privacy issues. However, neural vocoders with a low complexity and small model footprint inevitably generate annoying…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-01 Sangjun Park , Kihyun Choo , Joohyung Lee , Anton V. Porov , Konstantin Osipov , June Sig Sung

Low and ultra-low-bitrate neural speech coding achieves unprecedented coding gain by generating speech signals from compact speech features. This paper introduces additional coding efficiency in neural speech coding by reducing the temporal…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-07 Haici Yang , Wootaek Lim , Minje Kim

Sequential models achieve state-of-the-art results in audio, visual and textual domains with respect to both estimating the data distribution and generating high-quality samples. Efficient sampling for this class of models has however…

LPCNet is an efficient vocoder that combines linear prediction and deep neural network modules to keep the computational complexity low. In this work, we present two techniques to further reduce it's complexity, aiming for a low-cost LPCNet…

In this paper, we propose multi-band MelGAN, a much faster waveform generation model targeting to high-quality text-to-speech. Specifically, we improve the original MelGAN by the following aspects. First, we increase the receptive field of…

Sound · Computer Science 2020-11-18 Geng Yang , Shan Yang , Kai Liu , Peng Fang , Wei Chen , Lei Xie

In recent years, neural vocoders have surpassed classical speech generation approaches in naturalness and perceptual quality of the synthesized speech. Computationally heavy models like WaveNet and WaveGlow achieve best results, while…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Ahmed Mustafa , Nicola Pia , Guillaume Fuchs

In this paper, we integrate a simple non-parallel voice conversion (VC) system with a WaveNet (WN) vocoder and a proposed collapsed speech suppression technique. The effectiveness of WN as a vocoder for generating high-fidelity speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-08 Yi-Chiao Wu , Patrick Lumban Tobing , Kazuhiro Kobayashi , Tomoki Hayashi , Tomoki Toda
‹ Prev 1 2 3 10 Next ›