English
Related papers

Related papers: Tutorial on Variational Autoencoders

200 papers

We consider the closely related problems of sampling from a distribution known up to a normalizing constant, and estimating said normalizing constant. We show how variational autoencoders (VAEs) can be applied to this task. In their…

Machine Learning · Computer Science 2022-09-22 George T. Cantwell

Stochastic processes provide a mathematically elegant way model complex data. In theory, they provide flexible priors over function classes that can encode a wide range of interesting assumptions. In practice, however, efficient inference…

Machine Learning · Computer Science 2022-09-15 Swapnil Mishra , Seth Flaxman , Tresnia Berah , Harrison Zhu , Mikko Pakkanen , Samir Bhatt

The variational autoencoder (VAE) is a popular deep latent variable model used to analyse high-dimensional datasets by learning a low-dimensional latent representation of the data. It simultaneously learns a generative model and an…

Machine Learning · Computer Science 2023-11-21 Mine Öğretir , Siddharth Ramchandran , Dimitrios Papatheodorou , Harri Lähdesmäki

The surrogate loss of variational autoencoders (VAEs) poses various challenges to their training, inducing the imbalance between task fitting and representation inference. To avert this, the existing strategies for VAEs focus on adjusting…

Neural and Evolutionary Computing · Computer Science 2024-04-02 Zhangkai Wu , Longbing Cao , Lei Qi

We introduce a novel variational autoencoder (VAE) architecture that can generate realistic and diverse high energy physics events. The model we propose utilizes several techniques from VAE literature in order to simulate high fidelity jet…

High Energy Physics - Phenomenology · Physics 2020-09-11 Kosei Dohi

Variational autoencoders (VAEs) are deep probabilistic models that are used in scientific applications. Many works try to mitigate this problem from the probabilistic methods perspective by new inference techniques or training procedures.…

Machine Learning · Statistics 2024-12-24 Tim Z. Xiao , Johannes Zenn , Robert Bamler

The variational auto-encoder (VAE) is a popular method for learning a generative model and embeddings of the data. Many real datasets are hierarchically structured. However, traditional VAEs map data in a Euclidean latent space which cannot…

Machine Learning · Statistics 2019-11-27 Emile Mathieu , Charline Le Lan , Chris J. Maddison , Ryota Tomioka , Yee Whye Teh

We propose to utilize a variational autoencoder (VAE) for data-driven channel estimation. The underlying true and unknown channel distribution is modeled by the VAE as a conditional Gaussian distribution in a novel way, parameterized by the…

Signal Processing · Electrical Eng. & Systems 2023-04-07 Michael Baur , Benedikt Fesl , Michael Koller , Wolfgang Utschick

Autoencoders have found widespread application in both their original deterministic form and in their variational formulation (VAEs). In scientific applications and in image processing it is often of interest to consider data that are…

Machine Learning · Statistics 2025-09-09 Justin Bunker , Mark Girolami , Hefin Lambley , Andrew M. Stuart , T. J. Sullivan

Given the notably increasing complexity of mathematical models to study realistic systems and their coupling to their environment that constrains their dynamics, both analytical approaches and numerical methods that build on these models,…

Quantum Physics · Physics 2019-11-11 I. Luchnikov , A. Ryzhov , P. -J. C. Stas , S. N. Filippov , H. Ouerdane

We develop data-driven methods for incorporating physical information for priors to learn parsimonious representations of nonlinear systems arising from parameterized PDEs and mechanics. Our approach is based on Variational Autoencoders…

Machine Learning · Computer Science 2021-03-17 Ryan Lopez , Paul J. Atzberger

The key idea of variational auto-encoders (VAEs) resembles that of traditional auto-encoder models in which spatial information is supposed to be explicitly encoded in the latent space. However, the latent variables in VAEs are vectors,…

Machine Learning · Computer Science 2019-01-23 Zhengyang Wang , Hao Yuan , Shuiwang Ji

Does a Variational AutoEncoder (VAE) consistently encode typical samples generated from its decoder? This paper shows that the perhaps surprising answer to this question is `No'; a (nominally trained) VAE does not necessarily amortize…

Machine Learning · Computer Science 2020-12-08 A. Taylan Cemgil , Sumedh Ghaisas , Krishnamurthy Dvijotham , Sven Gowal , Pushmeet Kohli

The paper presents the application of Variational Autoencoders (VAE) for data dimensionality reduction and explorative analysis of mass spectrometry imaging data (MSI). The results confirm that VAEs are capable of detecting the patterns…

Quantitative Methods · Quantitative Biology 2017-08-25 Paolo Inglese , James L. Alexander , Anna Mroz , Zoltan Takats , Robert Glen

The high cost of acquiring labels is one of the main challenges in deploying supervised machine learning algorithms. Active learning is a promising approach to control the learning process and address the difficulties of data labeling by…

Machine Learning · Computer Science 2019-11-19 Farhad Pourkamali-Anaraki , Michael B. Wakin

Conditional variational autoencoders (CVAEs) are versatile deep generative models that extend the standard VAE framework by conditioning the generative model with auxiliary covariates. The original CVAE model assumes that the data samples…

Machine Learning · Statistics 2022-03-03 Siddharth Ramchandran , Gleb Tikhonov , Otto Lönnroth , Pekka Tiikkainen , Harri Lähdesmäki

Auto-encoding Variational Bayes (AEVB) is a powerful and general algorithm for fitting latent variable models (a promising direction for unsupervised learning), and is well-known for training the Variational Auto-Encoder (VAE). In this…

Machine Learning · Computer Science 2022-08-17 Yang Zhi-Han

Variational Autoencoders (VAEs) have become a popular approach for dimensionality reduction. However, despite their ability to identify latent low-dimensional structures embedded within high-dimensional data, these latent representations…

Machine Learning · Statistics 2020-08-27 Kaspar Märtens , Christopher Yau

Artificial Intelligence in healthcare is a new and exciting frontier and the possibilities are endless. With deep learning approaches beating human performances in many areas, the logical next step is to attempt their application in the…

Machine Learning · Computer Science 2018-08-21 Ally Salim

Variational autoencoders (VAEs) and generative adversarial networks (GANs) enjoy an intuitive connection to manifold learning: in training the decoder/generator is optimized to approximate a homeomorphism between the data distribution and…

Machine Learning · Computer Science 2020-08-28 Henry Li , Ofir Lindenbaum , Xiuyuan Cheng , Alexander Cloninger