English
Related papers

Related papers: Bunched LPCNet : Vocoder for Low-cost Neural Text-…

200 papers

Text-to-Speech (TTS) services that run on edge devices have many advantages compared to cloud TTS, e.g., latency and privacy issues. However, neural vocoders with a low complexity and small model footprint inevitably generate annoying…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-01 Sangjun Park , Kihyun Choo , Joohyung Lee , Anton V. Porov , Konstantin Osipov , June Sig Sung

State-of-the-art sequence-to-sequence acoustic networks, that convert a phonetic sequence to a sequence of spectral features with no explicit prosody prediction, generate speech with close to natural quality, when cascaded with neural…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-26 Slava Shechtman , Carmel Rabinovitz , Alex Sorin , Zvi Kons , Ron Hoory

Neural vocoders have recently demonstrated high quality speech synthesis, but typically require a high computational complexity. LPCNet was proposed as a way to reduce the complexity of neural synthesis by using linear prediction (LP) to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-31 Krishna Subramani , Jean-Marc Valin , Umut Isik , Paris Smaragdis , Arvindh Krishnaswamy

Neural speech synthesis models have recently demonstrated the ability to synthesize high quality speech for text-to-speech and compression applications. These new models often require powerful GPUs to achieve real-time operation, so being…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-20 Jean-Marc Valin , Jan Skoglund

In this paper, we propose an improved LPCNet vocoder using a linear prediction (LP)-structured mixture density network (MDN). The recently proposed LPCNet vocoder has successfully achieved high-quality and lightweight speech synthesis…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-03 Min-Jae Hwang , Eunwoo Song , Ryuichi Yamamoto , Frank Soong , Hong-Goo Kang

We present a lightweight adaptable neural TTS system with high quality output. The system is composed of three separate neural network blocks: prosody prediction, acoustic feature prediction and Linear Prediction Coding Net as a neural…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-27 Zvi Kons , Slava Shechtman , Alex Sorin , Carmel Rabinovitz , Ron Hoory

Neural speech synthesis models can synthesize high quality speech but typically require a high computational complexity to do so. In previous work, we introduced LPCNet, which uses linear prediction to significantly reduce the complexity of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-24 Jean-Marc Valin , Umut Isik , Paris Smaragdis , Arvindh Krishnaswamy

Neural speech synthesis algorithms are a promising new approach for coding speech at very low bitrate. They have so far demonstrated quality that far exceeds traditional vocoders, at the cost of very high complexity. In this work, we…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-01 Jean-Marc Valin , Jan Skoglund

We propose a linear prediction (LP)-based waveform generation method via WaveNet vocoding framework. A WaveNet-based neural vocoder has significantly improved the quality of parametric text-to-speech (TTS) systems. However, it is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-05 Min-Jae Hwang , Frank Soong , Eunwoo Song , Xi Wang , Hyeonjoo Kang , Hong-Goo Kang

In this work, a robust and efficient text-to-speech (TTS) synthesis system named Triple M is proposed for large-scale online application. The key components of Triple M are: 1) A sequence-to-sequence model adopts a novel multi-guidance…

Computation and Language · Computer Science 2021-04-08 Shilun Lin , Fenglong Xie , Li Meng , Xinhui Li , Li Lu

The increasingly stringent requirement on quality-of-experience in 5G/B5G communication systems has led to the emerging neural speech enhancement techniques, which however have been developed in isolation from the existing expert-rule based…

Sound · Computer Science 2022-06-23 Yang Liu , Na Tang , Xiaoli Chu , Yang Yang , Jun Wang

Vocoders received renewed attention as main components in statistical parametric text-to-speech (TTS) synthesis and speech transformation systems. Even though there are vocoding techniques give almost accepted synthesized speech, their high…

Sound · Computer Science 2021-06-22 Mohammed Salah Al-Radhi , Tamás Gábor Csapó , Géza Németh

Recently, the effectiveness of text-to-speech (TTS) systems combined with neural vocoders to generate high-fidelity speech has been shown. However, collecting the required training data and building these advanced systems from scratch are…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Yi-Chiao Wu , Patrick Lumban Tobing , Kazuki Yasuhara , Noriyuki Matsunaga , Yamato Ohtani , Tomoki Toda

Recently, deep learning-based Text-to-Speech (TTS) systems have achieved high-quality speech synthesis results. Recurrent neural networks have become a standard modeling technique for sequential data in TTS systems and are widely used.…

Sound · Computer Science 2024-03-19 Ziqi Liang , Haoxiang Shi , Jiawei Wang , Keda Lu

Recurrent Neural Networks (RNNs) have become the standard modeling technique for sequence data, and are used in a number of novel text-to-speech models. However, training a TTS model including RNN components has certain requirements for GPU…

Computation and Language · Computer Science 2023-04-18 Ziqi Liang

Recent advancements in end-to-end neural speech codecs enable compressing audio at extremely low bitrates while maintaining high-fidelity reconstruction. Meanwhile, low computational complexity and low latency are crucial for real-time…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-21 Leyan Yang , Ronghui Hu , Yang Xu , Jing Lu

Transformer-based text to speech (TTS) model (e.g., Transformer TTS~\cite{li2019neural}, FastSpeech~\cite{ren2019fastspeech}) has shown the advantages of training and inference efficiency over RNN-based model (e.g.,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Mingjian Chen , Xu Tan , Yi Ren , Jin Xu , Hao Sun , Sheng Zhao , Tao Qin , Tie-Yan Liu

We introduce SupertonicTTS, a novel text-to-speech (TTS) system designed for efficient and streamlined speech synthesis. SupertonicTTS comprises three components: a speech autoencoder for continuous latent representation, a text-to-latent…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-24 Hyeongju Kim , Jinhyeok Yang , Yechan Yu , Seunghun Ji , Jacob Morton , Frederik Bous , Joon Byun , Juheon Lee

Phonetic speech transcription is crucial for fine-grained linguistic analysis and downstream speech applications. While Connectionist Temporal Classification (CTC) is a widely used approach for such tasks due to its efficiency, it often…

Current end-to-end spoken language models (SLMs) have made notable progress, yet they still encounter considerable response latency. This delay primarily arises from the autoregressive generation of speech tokens and the reliance on complex…

Computation and Language · Computer Science 2025-11-14 Yuhao Wang , Ziyang Cheng , Heyang Liu , Ronghua Wu , Qunshan Gu , Yanfeng Wang , Yu Wang
‹ Prev 1 2 3 10 Next ›