English
Related papers

Related papers: A Statistically Principled and Computationally Eff…

200 papers

Variational Autoencoders (VAEs) provide a theoretically-backed and popular framework for deep generative models. However, learning a VAE from data poses still unanswered theoretical questions and considerable practical challenges. In this…

Machine Learning · Computer Science 2020-06-01 Partha Ghosh , Mehdi S. M. Sajjadi , Antonio Vergari , Michael Black , Bernhard Schölkopf

Deep generative models applied to audio have improved by a large margin the state-of-the-art in many speech and music related tasks. However, as raw waveform modelling remains an inherently difficult task, audio generative models are either…

Machine Learning · Computer Science 2021-12-16 Antoine Caillon , Philippe Esling

The Variational Autoencoder (VAE) is a seminal approach in deep generative modeling with latent variables. Interpreting its reconstruction process as a nonlinear transformation of samples from the latent posterior distribution, we apply the…

Machine Learning · Computer Science 2023-06-09 Faris Janjoš , Lars Rosenbaum , Maxim Dolgov , J. Marius Zöllner

Variational autoencoders (VAEs) are one class of generative probabilistic latent-variable models designed for inference based on known data. We develop three variations on VAEs by introducing a second parameterized encoder/decoder pair and,…

Machine Learning · Computer Science 2023-04-06 R. I. Cukier

This paper focuses on single-channel semi-supervised speech enhancement. We learn a speaker-independent deep generative speech model using the framework of variational autoencoders. The noise model remains unsupervised because we do not…

Sound · Computer Science 2019-05-01 Simon Leglaive , Umut Simsekli , Antoine Liutkus , Laurent Girin , Radu Horaud

We present a new method for improving the performances of variational autoencoder (VAE). In addition to enforcing the deep feature consistent principle thus ensuring the VAE output and its corresponding input images to have similar deep…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Xianxu Hou , Ke Sun , Linlin Shen , Guoping Qiu

In this paper we address the problem of enhancing speech signals in noisy mixtures using a source separation approach. We explore the use of neural networks as an alternative to a popular speech variance model based on supervised…

Sound · Computer Science 2019-02-06 Simon Leglaive , Laurent Girin , Radu Horaud

Variational autoencoder (VAE) is a very successful generative model whose key element is the so called amortized inference network, which can perform test time inference using a single feed forward pass. Unfortunately, this comes at the…

Machine Learning · Computer Science 2021-02-08 Minyoung Kim , Vladimir Pavlovic

In previous work, we proposed a variational autoencoder-based (VAE) Bayesian permutation training speech enhancement (SE) method (PVAE) which indicated that the SE performance of the traditional deep neural network-based (DNN) method could…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-12 Yang Xiang , Jesper Lisby Højvang , Morten Højfeldt Rasmussen , Mads Græsbøll Christensen

Learning from an imbalanced distribution presents a major challenge in predictive modeling, as it generally leads to a reduction in the performance of standard algorithms. Various approaches exist to address this issue, but many of them…

Machine Learning · Computer Science 2024-12-11 Samuel Stocksieker , Denys Pommeret , Arthur Charpentier

The electroencephalogram (EEG) is a powerful method to understand how the brain processes speech. Linear models have recently been replaced for this purpose with deep neural networks and yield promising results. In related EEG…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-25 Lies Bollens , Tom Francart , Hugo Van Hamme

Variational autoencoders (VAE) represent a popular, flexible form of deep generative model that can be stochastically fit to samples from a given random process using an information-theoretic variational bound on the true underlying…

Machine Learning · Computer Science 2019-10-08 Bin Dai , Yu Wang , John Aston , Gang Hua , David Wipf

Variational AutoEncoder (VAE) has been extended as a representative nonlinear method for collaborative filtering. However, the bottleneck of VAE lies in the softmax computation over all items, such that it takes linear costs in the number…

Machine Learning · Computer Science 2022-05-31 Jin Chen , Defu Lian , Binbin Jin , Xu Huang , Kai Zheng , Enhong Chen

Recently, the standard variational autoencoder has been successfully used to learn a probabilistic prior over speech signals, which is then used to perform speech enhancement. Variational autoencoders have then been conditioned on a label…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-04 Guillaume Carbajal , Julius Richter , Timo Gerkmann

Understanding and controlling latent representations in deep generative models is a challenging yet important problem for analyzing, transforming and generating various types of data. In speech processing, inspiring from the anatomical…

Sound · Computer Science 2023-03-22 Samir Sadok , Simon Leglaive , Laurent Girin , Xavier Alameda-Pineda , Renaud Séguier

Generally, the performance of deep neural networks (DNNs) heavily depends on the quality of data representation learning. Our preliminary work has emphasized the significance of deep representation learning (DRL) in the context of speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-18 Yang Xiang , Jingguang Tian , Xinhui Hu , Xinkang Xu , ZhaoHui Yin

Variational autoencoders were proven successful in domains such as computer vision and speech processing. Their adoption for modeling user preferences is still unexplored, although recently it is starting to gain attention in the current…

Machine Learning · Computer Science 2018-11-27 Noveen Sachdeva , Giuseppe Manco , Ettore Ritacco , Vikram Pudi

Deep probabilistic generative models have achieved incredible success in many fields of application. Among such models, variational autoencoders (VAEs) have proved their ability in modeling a generative process by learning a latent…

Machine Learning · Computer Science 2022-12-16 Eleonora Grassucci , Danilo Comminiello , Aurelio Uncini

We extend variational autoencoders (VAEs) to collaborative filtering for implicit feedback. This non-linear probabilistic model enables us to go beyond the limited modeling capacity of linear factor models which still largely dominate…

Machine Learning · Statistics 2018-02-19 Dawen Liang , Rahul G. Krishnan , Matthew D. Hoffman , Tony Jebara

Variational Autoencoders (VAEs) are essential for large-scale audio tasks like diffusion-based generation. However, existing open-source models often neglect auditory perceptual aspects during training, leading to weaknesses in phase…

Sound · Computer Science 2025-11-07 Kangdi Wang , Zhiyue Wu , Dinghao Zhou , Rui Lin , Junyu Dai , Tao Jiang