English
Related papers

Related papers: Parallel Synthesis for Autoregressive Speech Gener…

200 papers

Advanced Generative Adversarial Networks (GANs) are remarkable in generating intelligible audio from a random latent vector. In this paper, we examine the task of recovering the latent vector of both synthesized and real audio. Previous…

Sound · Computer Science 2020-10-19 Andrew Keyes , Nicky Bayat , Vahid Reza Khazaie , Yalda Mohsenzadeh

Animating still face images with deep generative models using a speech input signal is an active research topic and has seen important recent progress.However, much of the effort has been put into lip syncing and rendering quality while the…

Graphics · Computer Science 2024-12-13 Louis Airale , Dominique Vaufreydaz , Xavier Alameda-Pineda

Speech-to-text errors made by automatic speech recognition (ASR) systems negatively impact downstream models. Error correction models as a post-processing text editing method have been recently developed for refining the ASR outputs.…

Computation and Language · Computer Science 2023-06-22 Ziji Zhang , Zhehui Wang , Rajesh Kamma , Sharanya Eswaran , Narayanan Sadagopan

Although state-of-the-art parallel WaveNet has addressed the issue of real-time waveform generation, there remains problems. Firstly, due to the noisy input signal of the model, there is still a gap between the quality of generated and…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-22 Qiao Tian , Xucheng Wan , Shan Liu

We propose AudioStyleGAN (ASGAN), a new generative adversarial network (GAN) for unconditional speech synthesis. As in the StyleGAN family of image synthesis models, ASGAN maps sampled noise to a disentangled latent vector which is then…

Sound · Computer Science 2022-10-12 Matthew Baas , Herman Kamper

Autoregressive models for video generation typically operate frame-by-frame, extending next-token prediction from language to video's temporal dimension. We question that unlike word as token is universally agreed in language if frame is a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Sucheng Ren , Chen Chen , Zhenbang Wang , Liangchen Song , Xiangxin Zhu , Alan Yuille , Yinfei Yang , Jiasen Lu

Visual autoregressive (VAR) models have recently emerged as an efficient paradigm for text-to-image generation. Despite their strong generative capability, existing VAR-based personalization methods remain limited to static settings,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Junhao Li , Xinhao Zhong , Yi sun , Yuxia Qiao , Bin Chen , Shu-Tao Xia , Yaowei Wang

This paper proposes a WaveNet-based neural excitation model (ExcitNet) for statistical parametric speech synthesis systems. Conventional WaveNet-based neural vocoding systems significantly improve the perceptual quality of synthesized…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-23 Eunwoo Song , Kyungguen Byun , Hong-Goo Kang

This paper introduces PAG-a novel optimization and decoding approach that guides autoregressive generation of document identifiers in generative retrieval models through simultaneous decoding. To this aim, PAG constructs a set-based and…

Information Retrieval · Computer Science 2024-04-24 Hansi Zeng , Chen Luo , Hamed Zamani

Attention-based models such as Transformers and recurrent models like state space models (SSMs) have emerged as successful methods for autoregressive sequence modeling. Although both enable parallel training, none enable parallel generation…

Machine Learning · Computer Science 2024-07-12 Gaspard Lambrechts , Yann Claes , Pierre Geurts , Damien Ernst

Autoregressive models have recently shown great promise in visual generation by leveraging discrete token sequences akin to language modeling. However, existing approaches often suffer from inefficiency, either due to token-by-token…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Ruiqing Yang , Kaixin Zhang , Zheng Zhang , Shan You , Tao Huang

Retrieval-Augmented Generation (RAG) improves factual grounding in large language models but suffers from substantial latency due to synchronous retrieval. While recent work explores asynchronous retrieval, existing approaches rely on…

Computation and Language · Computer Science 2026-05-19 Wuyang Zhang , Shichao Pei

WaveCycleGAN has recently been proposed to bridge the gap between natural and synthesized speech waveforms in statistical parametric speech synthesis and provides fast inference with a moving average model rather than an autoregressive…

Sound · Computer Science 2019-04-10 Kou Tanaka , Hirokazu Kameoka , Takuhiro Kaneko , Nobukatsu Hojo

This paper presents a novel neural speech phase prediction model which predicts wrapped phase spectra directly from amplitude spectra. The proposed model is a cascade of a residual convolutional network and a parallel estimation…

Sound · Computer Science 2024-03-27 Yang Ai , Zhen-Hua Ling

In sequence-to-sequence Transformer ASR, autoregressive (AR) models achieve strong accuracy but suffer from slow decoding, while non-autoregressive (NAR) models enable parallel decoding at the cost of degraded performance. We propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-26 Hao Yen , Pin-Jui Ku , Ante Jukić , Sabato Marco Siniscalchi

Neural waveform models such as the WaveNet are used in many recent text-to-speech systems, but the original WaveNet is quite slow in waveform generation because of its autoregressive (AR) structure. Although faster non-AR models were…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-30 Xin Wang , Shinji Takaki , Junichi Yamagishi

In this paper we demonstrate speech synthesis using different electroencephalography (EEG) feature sets recently introduced in [1]. We make use of a recurrent neural network (RNN) regression model to predict acoustic features directly from…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-05 Gautam Krishna , Co Tran , Yan Han , Mason Carnahan

Most neural network speech enhancement models ignore speech production mathematical models by directly mapping Fourier transform spectrums or waveforms. In this work, we propose a neural source filter network for speech enhancement.…

Sound · Computer Science 2022-10-31 Shulin He , Wei Rao , Jinjiang Liu , Jun Chen , Yukai Ju , Xueliang Zhang , Yannan Wang , Shidong Shang

We present a neural vocoder designed with low-powered Alternative and Augmentative Communication devices in mind. By combining elements of successful modern vocoders with established ideas from an older generation of technology, our system…

Sound · Computer Science 2023-06-09 Oliver Watts , Lovisa Wihlborg , Cassia Valentini-Botinhao

Deep autoregressive sequence-to-sequence models have demonstrated impressive performance across a wide variety of tasks in recent years. While common architecture classes such as recurrent, convolutional, and self-attention networks make…

Machine Learning · Computer Science 2018-11-09 Mitchell Stern , Noam Shazeer , Jakob Uszkoreit