English
Related papers

Related papers: A Tutorial on VAEs: From Bayes' Rule to Lossless C…

200 papers

Data assimilation refers to a set of algorithms designed to compute the optimal estimate of a system's state by refining the prior prediction (known as background states) using observed data. Variational assimilation methods rely on the…

Machine Learning · Computer Science 2024-05-24 Yi Xiao , Qilong Jia , Wei Xue , Lei Bai

Machine learning methods often need a large amount of labeled training data. Since the training data is assumed to be the ground truth, outliers can severely degrade learned representations and performance of trained models. Here we apply…

Machine Learning · Statistics 2019-12-24 Haleh Akrami , Anand A. Joshi , Jian Li , Sergul Aydore , Richard M. Leahy

Variational auto-encoders (VAEs) are deep generative latent variable models that can be used for learning the distribution of complex data. VAEs have been successfully used to learn a probabilistic prior over speech signals, which is then…

Sound · Computer Science 2020-12-18 Mostafa Sadeghi , Simon Leglaive , Xavier Alameda-PIneda , Laurent Girin , Radu Horaud

This paper introduces the Descriptive Variational Autoencoder (DVAE), an unsupervised and end-to-end trainable neural network for predicting vehicle trajectories that provides partial interpretability. The novel approach is based on the…

Machine Learning · Computer Science 2021-06-25 Marion Neumeier , Andreas Tollkühn , Thomas Berberich , Michael Botsch

Variational auto-encoder (VAE) is a powerful unsupervised learning framework for image generation. One drawback of VAE is that it generates blurry images due to its Gaussianity assumption and thus L2 loss. To allow the generation of high…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Lei Cai , Hongyang Gao , Shuiwang Ji

Variational AutoEncoders (VAEs) provide a means to generate representational latent embeddings. Previous research has highlighted the benefits of achieving representations that are disentangled, particularly for downstream tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-18 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

The framework of variational autoencoders (VAEs) provides a principled method for jointly learning latent-variable models and corresponding inference models. However, the main drawback of this approach is the blurriness of the generated…

Machine Learning · Computer Science 2020-07-01 Ioannis Gatopoulos , Maarten Stol , Jakub M. Tomczak

Variational autoencoder-based voice conversion (VAE-VC) has the advantage of requiring only pairs of speeches and speaker labels for training. Unlike the majority of the research in VAE-VC which focuses on utilizing auxiliary losses or…

Sound · Computer Science 2021-12-07 Kei Akuzawa , Kotaro Onishi , Keisuke Takiguchi , Kohki Mametani , Koichiro Mori

Longitudinal datasets measured repeatedly over time from individual subjects, arise in many biomedical, psychological, social, and other studies. A common approach to analyse high-dimensional data that contains missing values is to learn a…

Machine Learning · Statistics 2021-04-21 Siddharth Ramchandran , Gleb Tikhonov , Kalle Kujanpää , Miika Koskinen , Harri Lähdesmäki

In the field of machine learning, it is still a critical issue to identify and supervise the learned representation without manually intervening or intuition assistance to extract useful knowledge or serve for the downstream tasks. In this…

Machine Learning · Computer Science 2025-12-10 Shiqi Liu , Jingxin Liu , Qian Zhao , Xiangyong Cao , Huibin Li , Deyu Meng , Hongying Meng , Sheng Liu

The variational auto-encoder (VAE) is a popular method for learning a generative model and embeddings of the data. Many real datasets are hierarchically structured. However, traditional VAEs map data in a Euclidean latent space which cannot…

Machine Learning · Statistics 2019-11-27 Emile Mathieu , Charline Le Lan , Chris J. Maddison , Ryota Tomioka , Yee Whye Teh

Representation learning seeks to expose certain aspects of observed data in a learned representation that's amenable to downstream tasks like classification. For instance, a good representation for 2D images might be one that describes only…

Machine Learning · Computer Science 2017-03-07 Xi Chen , Diederik P. Kingma , Tim Salimans , Yan Duan , Prafulla Dhariwal , John Schulman , Ilya Sutskever , Pieter Abbeel

Variational Auto-Encoder (VAE) has been widely applied as a fundamental generative model in machine learning. For complex samples like imagery objects or scenes, however, VAE suffers from the dimensional dilemma between reconstruction…

Machine Learning · Computer Science 2020-02-18 Deli Zhao , Jiapeng Zhu , Bo Zhang

The variational autoencoder (VAE) is a powerful generative model that can estimate the probability of a data point by using latent variables. In the VAE, the posterior of the latent variable given the data point is regularized by the prior…

Machine Learning · Statistics 2019-12-30 Hiroshi Takahashi , Tomoharu Iwata , Yuki Yamanaka , Masanori Yamada , Satoshi Yagi

Interpretable machine learning is rapidly becoming a crucial tool for scientific discovery. Among existing approaches, variational autoencoders (VAEs) have shown promise in extracting the hidden physical features of some input data, with no…

Auto-encoding Variational Bayes (AEVB) is a powerful and general algorithm for fitting latent variable models (a promising direction for unsupervised learning), and is well-known for training the Variational Auto-Encoder (VAE). In this…

Machine Learning · Computer Science 2022-08-17 Yang Zhi-Han

Stochastic processes provide a mathematically elegant way model complex data. In theory, they provide flexible priors over function classes that can encode a wide range of interesting assumptions. In practice, however, efficient inference…

Machine Learning · Computer Science 2022-09-15 Swapnil Mishra , Seth Flaxman , Tresnia Berah , Harrison Zhu , Mikko Pakkanen , Samir Bhatt

Variational Autoencoders (VAEs) are powerful generative models that have been widely used in various fields, including image and text generation. However, one of the known challenges in using VAEs is the model's sensitivity to its…

Machine Learning · Computer Science 2024-12-31 Gabriela Sejnova , Michal Vavrecka , Karla Stepanova

Inference and inverse problems are closely related concepts, both fundamentally involving the deduction of unknown causes or parameters from observed data. Bayesian inference, a powerful class of methods, is often employed to solve a…

Machine Learning · Statistics 2024-09-17 Yuan-Hao Wei , Yan-Jie Sun , Chen Zhang

Paradoxically, a Variational Autoencoder (VAE) could be pushed in two opposite directions, utilizing powerful decoder model for generating realistic images but collapsing the learned representation, or increasing regularization coefficient…

Machine Learning · Computer Science 2022-03-30 Trung Ngo , Najwa Laabid , Ville Hautamäki , Merja Heinäniemi