English
Related papers

Related papers: High-Fidelity and Low-Latency Universal Neural Voc…

200 papers

In the last years there has been a growing interest for nonlinear speech models. Several works have been published revealing the better performance of nonlinear techniques, but little attention has been dedicated to the implementation of…

Sound · Computer Science 2022-04-04 Marcos Faundez-Zanuy

Recently, our proposed recurrent neural network (RNN) based all deep learning minimum variance distortionless response (ADL-MVDR) beamformer method yielded superior performance over the conventional MVDR by replacing the matrix inversion…

Sound · Computer Science 2021-04-27 Xiyun Li , Yong Xu , Meng Yu , Shi-Xiong Zhang , Jiaming Xu , Bo Xu , Dong Yu

Current end-to-end spoken language models (SLMs) have made notable progress, yet they still encounter considerable response latency. This delay primarily arises from the autoregressive generation of speech tokens and the reliance on complex…

Computation and Language · Computer Science 2025-11-14 Yuhao Wang , Ziyang Cheng , Heyang Liu , Ronghua Wu , Qunshan Gu , Yanfeng Wang , Yu Wang

Recent neural networks such as WaveNet and sampleRNN that learn directly from speech waveform samples have achieved very high-quality synthetic speech in terms of both naturalness and speaker similarity even in multi-speaker text-to-speech…

Audio and Speech Processing · Electrical Eng. & Systems 2018-08-01 Yi Zhao , Shinji Takaki , Hieu-Thi Luong , Junichi Yamagishi , Daisuke Saito , Nobuaki Minematsu

This paper explores the potential universality of neural vocoders. We train a WaveRNN-based vocoder on 74 speakers coming from 17 languages. This vocoder is shown to be capable of generating speech of consistently good quality (98% relative…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-05 Jaime Lorenzo-Trueba , Thomas Drugman , Javier Latorre , Thomas Merritt , Bartosz Putrycz , Roberto Barra-Chicote , Alexis Moinet , Vatsal Aggarwal

Automatic detection of speaker confidence is critical for adaptive computing but remains constrained by limited labelled data and the subjectivity of paralinguistic annotations. This paper proposes a semi-supervised hybrid framework that…

Sound · Computer Science 2026-05-13 Adam Wynn , Jingyun Wang

The majority of mainstream neural vocoders primarily focus on speech quality and generation speed, while overlooking latency, which is a critical factor in real-time applications. Excessive latency leads to noticeable delays in user…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-18 Hui-Peng Du , Yang Ai , Zhen-Hua Ling

Edge devices operate in constrained and varying resource settings, requiring dynamic architectures that can adapt to limitations of the available resources. To meet such demands, layer dropping ($\mathcal{LD}$) approach is typically used to…

Sound · Computer Science 2026-01-28 Abdul Hannan , Daniele Falavigna , Shah Nawaz , Mubashir Noman , Markus Schedl , Alessio Brutti

We present a universal neural vocoder based on Parallel WaveNet, with an additional conditioning network called Audio Encoder. Our universal vocoder offers real-time high-quality speech synthesis on a wide range of use cases. We tested it…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Yunlong Jiao , Adam Gabrys , Georgi Tinchev , Bartosz Putrycz , Daniel Korzekwa , Viacheslav Klimkov

Waveform-based deep learning faces a dilemma between nonparametric and parametric approaches. On one hand, convolutional neural networks (convnets) may approximate any linear time-invariant system; yet, in practice, their frequency…

Sound · Computer Science 2024-07-09 Vincent Lostanlen , Daniel Haider , Han Han , Mathieu Lagrange , Peter Balazs , Martin Ehler

This work explores the use of a monolingual Deep Neural Network (DNN) model as an universal background model (UBM) to address the problem of Language Recognition (LR) in I-vector framework. A Time Delay Deep Neural Network (TDDNN)…

Audio and Speech Processing · Electrical Eng. & Systems 2018-04-16 Mousmita Sarma , Kandarpa Kumar Sarma , Nagendra Kumar Goel

This study proposes a fully convolutional network (FCN) model for raw waveform-based speech enhancement. The proposed system performs speech enhancement in an end-to-end (i.e., waveform-in and waveform-out) manner, which dif-fers from most…

Machine Learning · Statistics 2017-06-16 Szu-Wei Fu , Yu Tsao , Xugang Lu , Hisashi Kawai

We study a deep learning (DL) based limited feedback methods for multi-antenna systems. Deep neural networks (DNNs) are introduced to replace an end-to-end limited feedback procedure including pilot-aided channel training process, channel…

Information Theory · Computer Science 2019-12-20 Jeonghyeon Jang , Hoon Lee , Sangwon Hwang , Haibao Ren , Inkyu Lee

Conventional Frequency Domain Linear Prediction (FDLP) technique models the squared Hilbert envelope of speech with varied degrees of approximation which can be sampled at the required frame rate and used as features for Automatic Speech…

Sound · Computer Science 2022-04-04 Samik Sadhu , Hynek Hermansky

Recent advancements in wireless technologies towards the next-generation cellular networks have brought a new era that made it possible to apply cellular technology on traditionally-wired networks with tighter requirements, such as…

Networking and Internet Architecture · Computer Science 2023-09-19 Kerim Gökarslan

High-quality audio is essential in a wide range of applications, including online communication, virtual assistants, and the multimedia industry. However, degradation caused by noise, compression, and transmission artifacts remains a major…

Most neural vocoders employ band-limited mel-spectrograms to generate waveforms. If full-band spectral features are used as the input, the vocoder can be provided with as much acoustic information as possible. However, in some models…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-16 Won Jang , Dan Lim , Jaesam Yoon , Bongwan Kim , Juntae Kim

The emergence of 6th generation (6G) mobile networks brings new challenges in supporting high-mobility communications, particularly in addressing the issue of channel aging. While existing channel prediction methods offer improved accuracy…

Machine Learning · Computer Science 2024-10-30 Yanliang Jin , Yifan Wu , Yuan Gao , Shunqing Zhang , Shugong Xu , Cheng-Xiang Wang

In this paper, we propose a quasi-periodic neural network (QPNet) vocoder with a novel network architecture named pitch-dependent dilated convolution (PDCNN) to improve the pitch controllability of WaveNet (WN) vocoder. The effectiveness of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-24 Yi-Chiao Wu , Tomoki Hayashi , Patrick Lumban Tobing , Kazuhiro Kobayashi , Tomoki Toda

Recent work on wireless radiance fields represents a promising deep learning approach for channel prediction, however, in complex environments these methods still exhibit limited robustness, slow convergence, and modest accuracy due to…

Signal Processing · Electrical Eng. & Systems 2025-11-13 Yulin Fu , Jiancun Fan , Shiyu Zhai , Zhibo Duan , Jie Luo