English

Complex Recurrent Variational Autoencoder with Application to Speech Enhancement

Audio and Speech Processing 2024-10-28 v2

Abstract

As an extension of variational autoencoder (VAE), complex VAE uses complex Gaussian distributions to model latent variables and data. This work proposes a complex recurrent VAE framework, specifically in which complex-valued recurrent neural network and L1 reconstruction loss are used. Firstly, to account for the temporal property of speech signals, this work introduces complex-valued recurrent neural network in the complex VAE framework. Besides, L1 loss is used as the reconstruction loss in this framework. To exemplify the use of the complex generative model in speech processing, we choose speech enhancement as the specific application in this paper. Experiments are based on the TIMIT dataset. The results show that the proposed method offers improvements on objective metrics in speech intelligibility and signal quality.

Keywords

Cite

@article{arxiv.2204.02195,
  title  = {Complex Recurrent Variational Autoencoder with Application to Speech Enhancement},
  author = {Yuying Xie and Thomas Arildsen and Zheng-Hua Tan},
  journal= {arXiv preprint arXiv:2204.02195},
  year   = {2024}
}

Comments

This work has been submitted to the IEEE for possible publication

R2 v1 2026-06-24T10:38:27.880Z