English
Related papers

Related papers: LPCNet: Improving Neural Speech Synthesis Through …

200 papers

Text-to-Speech (TTS) services that run on edge devices have many advantages compared to cloud TTS, e.g., latency and privacy issues. However, neural vocoders with a low complexity and small model footprint inevitably generate annoying…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-01 Sangjun Park , Kihyun Choo , Joohyung Lee , Anton V. Porov , Konstantin Osipov , June Sig Sung

The research presents a voice conversion model using coefficient mapping and neural network. Most previous works on parametric speech synthesis did not account for losses in spectral details causing over smoothing and invariably, an…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-12 Olaide Ayodeji Agbolade , Samson A. Oyetunji

Noise reduction is an important part of modern hearing aids and is included in most commercially available devices. Deep learning-based state-of-the-art algorithms, however, either do not consider real-time and frequency resolution…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-29 Hendrik Schröter , Tobias Rosenkranz , Alberto N. Escalante B. , Marc Aubreville , Andreas Maier

In recent years, neural vocoders have surpassed classical speech generation approaches in naturalness and perceptual quality of the synthesized speech. Computationally heavy models like WaveNet and WaveGlow achieve best results, while…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Ahmed Mustafa , Nicola Pia , Guillaume Fuchs

We study the problem of compressing recurrent neural networks (RNNs). In particular, we focus on the compression of RNN acoustic models, which are motivated by the goal of building compact and accurate speech recognition systems which can…

Computation and Language · Computer Science 2016-05-03 Rohit Prabhavalkar , Ouais Alsharif , Antoine Bruguier , Ian McGraw

We propose TalkNet, a convolutional non-autoregressive neural model for speech synthesis. The model consists of two feed-forward convolutional networks. The first network predicts grapheme durations. An input text is expanded by repeating…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-13 Stanislav Beliaev , Yurii Rebryk , Boris Ginsburg

Numerous models have shown great success in the fields of speech recognition as well as speech synthesis, but models for speech to speech processing have not been heavily explored. We propose Speech to Speech Synthesis Network (STSSN), a…

Sound · Computer Science 2026-02-20 Bjorn Johnson , Jared Levy

This work introduces UDPNet, a novel architecture designed to accelerate the reverse diffusion process in speech synthesis. Unlike traditional diffusion models that rely on timestep embeddings and shared network parameters, UDPNet unrolls…

Sound · Computer Science 2025-06-12 Peter Ochieng

Recurrent Neural Networks (RNNs) have become the standard modeling technique for sequence data, and are used in a number of novel text-to-speech models. However, training a TTS model including RNN components has certain requirements for GPU…

Computation and Language · Computer Science 2023-04-18 Ziqi Liang

Porting state of the art deep learning algorithms to resource constrained compute platforms (e.g. VR, AR, wearables) is extremely challenging. We propose a fast, compact, and accurate model for convolutional neural networks that enables…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Hessam Bagherinezhad , Mohammad Rastegari , Ali Farhadi

Automatic speech recognition systems usually rely on spectral-based features, such as MFCC of PLP. These features are extracted based on prior knowledge such as, speech perception or/and speech production. Recently, convolutional neural…

Machine Learning · Computer Science 2015-04-17 Dimitri Palaz , Mathew Magimai Doss , Ronan Collobert

This paper deals the combination of nonlinear predictive models with classical LPCC parameterization for speaker recognition. It is shown that the combination of both a measure defined over LPCC coefficients and a measure defined over…

Sound · Computer Science 2022-03-08 Marcos Faundez-Zanuy

We propose the multi-head convolutional neural network (MCNN) architecture for waveform synthesis from spectrograms. Nonlinear interpolation in MCNN is employed with transposed convolution layers in parallel heads. MCNN achieves more than…

Sound · Computer Science 2018-12-26 Sercan O. Arik , Heewoo Jun , Gregory Diamos

Convolutional neural networks (CNNs) are a standard component of many current state-of-the-art Large Vocabulary Continuous Speech Recognition (LVCSR) systems. However, CNNs in LVCSR have not kept pace with recent advances in other domains…

Computation and Language · Computer Science 2016-01-26 Tom Sercu , Christian Puhrsch , Brian Kingsbury , Yann LeCun

Convolutional Neural Networks (CNNs) are effective models for reducing spectral variations and modeling spectral correlations in acoustic features for automatic speech recognition (ASR). Hybrid speech recognition systems incorporating CNNs…

Computation and Language · Computer Science 2017-01-11 Ying Zhang , Mohammad Pezeshki , Philemon Brakel , Saizheng Zhang , Cesar Laurent Yoshua Bengio , Aaron Courville

Agile hardware development requires fast and accurate circuit quality evaluation from early design stages. Existing work of high-level synthesis (HLS) performance prediction usually needs extensive feature engineering after the synthesis…

Machine Learning · Computer Science 2022-09-16 Nan Wu , Hang Yang , Yuan Xie , Pan Li , Cong Hao

The constant Q transform (CQT) has been shown to be one of the most effective speech signal pre-transforms to facilitate synthetic speech detection, followed by either hand-crafted (subband) constant Q cepstral coefficient (CQCC) feature…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-13 Guang Hua , Andrew Beng Jin Teoh , Haijian Zhang

This paper presents an end-to-end text-to-speech system with low latency on a CPU, suitable for real-time applications. The system is composed of an autoregressive attention-based sequence-to-sequence acoustic model and the LPCNet vocoder…

Modifying the pitch and timing of an audio signal are fundamental audio editing operations with applications in speech manipulation, audio-visual synchronization, and singing voice editing and synthesis. Thus far, methods for pitch-shifting…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-07 Max Morrison , Zeyu Jin , Nicholas J. Bryan , Juan-Pablo Caceres , Bryan Pardo

Deep Convolutional Neural Networks (CNNs) are more powerful than Deep Neural Networks (DNN), as they are able to better reduce spectral variation in the input signal. This has also been confirmed experimentally, with CNNs showing…