English
Related papers

Related papers: Unsupervised anomaly localization using VAE and be…

200 papers

Variational autoencoders (VAEs) are a popular framework for modeling complex data distributions; they can be efficiently trained via variational inference by maximizing the evidence lower bound (ELBO), at the expense of a gap to the exact…

The variational autoencoder (VAE) is a simple and efficient generative artificial intelligence method for modeling complex probability distributions of various types of data, such as images and texts. However, it suffers some main…

Machine Learning · Computer Science 2025-02-14 Xi Chen , Shaofan Li

Variational Autoencoders (VAEs) typically rely on a probabilistic decoder with a predefined likelihood, most commonly an isotropic Gaussian, to model the data conditional on latent variables. While convenient for optimization, this choice…

Machine Learning · Statistics 2025-04-29 Chen Xu , Qiang Wang , Lijun Sun

As one of the most popular generative models, Variational Autoencoder (VAE) approximates the posterior of latent variables based on amortized variational inference. However, when the decoder network is sufficiently expressive, VAE may lead…

Machine Learning · Computer Science 2021-10-26 Dazhong Shen , Chuan Qin , Chao Wang , Hengshu Zhu , Enhong Chen , Hui Xiong

Recent approaches for modelling dynamics of physical systems with neural networks enforce Lagrangian or Hamiltonian structure to improve prediction and generalization. However, when coordinates are embedded in high-dimensional data such as…

Machine Learning · Computer Science 2022-09-02 Yaofeng Desmond Zhong , Naomi Ehrich Leonard

Autoencoder (AE) is a neural network (NN) architecture that is trained to reconstruct an input at its output. By measuring the reconstruction errors of new input samples, AE can detect anomalous samples deviated from the trained data…

Machine Learning · Computer Science 2023-02-16 Jinho Choi , Jihong Park , Abhinav Japesh , Adarsh

Variational Autoencoders (VAE) are widely used for dimensionality reduction of large-scale tabular and image datasets, under the assumption of independence between data observations. In practice, however, datasets are often correlated, with…

Machine Learning · Statistics 2024-12-25 Giora Simchoni , Saharon Rosset

Machine learning methods often need a large amount of labeled training data. Since the training data is assumed to be the ground truth, outliers can severely degrade learned representations and performance of trained models. Here we apply…

Machine Learning · Statistics 2019-12-24 Haleh Akrami , Anand A. Joshi , Jian Li , Sergul Aydore , Richard M. Leahy

VAE, or variational auto-encoder, compresses data into latent attributes, and generates new data of different varieties. VAE based on KL divergence has been considered as an effective technique for data augmentation. In this paper, we…

Machine Learning · Computer Science 2022-08-17 Zichuan Chen , Peng Liu

Variational auto-encoders (VAEs) provide an attractive solution to image generation problem. However, they tend to produce blurred and over-smoothed images due to their dependence on pixel-wise reconstruction loss. This paper introduces a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-30 Salman H. Khan , Munawar Hayat , Nick Barnes

Representation learning seeks to expose certain aspects of observed data in a learned representation that's amenable to downstream tasks like classification. For instance, a good representation for 2D images might be one that describes only…

Machine Learning · Computer Science 2017-03-07 Xi Chen , Diederik P. Kingma , Tim Salimans , Yan Duan , Prafulla Dhariwal , John Schulman , Ilya Sutskever , Pieter Abbeel

Variational Auto-Encoders (VAEs) are capable of learning latent representations for high dimensional data. However, due to the i.i.d. assumption, VAEs only optimize the singleton variational distributions and fail to account for the…

Machine Learning · Computer Science 2020-04-20 Da Tang , Dawen Liang , Tony Jebara , Nicholas Ruozzi

Latent variable models like the Variational Auto-Encoder (VAE) are commonly used to learn representations of images. However, for downstream tasks like semantic classification, the representations learned by VAE are less competitive than…

Machine Learning · Statistics 2022-05-31 Mingtian Zhang , Tim Z. Xiao , Brooks Paige , David Barber

Through training on unlabeled data, anomaly detection has the potential to impact computer-aided diagnosis by outlining suspicious regions. Previous work on deep-learning-based anomaly detection has primarily focused on the reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2019-12-03 David Zimmerer , Jens Petersen , Simon A. A. Kohl , Klaus H. Maier-Hein

In this paper, we demonstrate the potential of applying Variational Autoencoder (VAE) [10] for anomaly detection in skin disease images. VAE is a class of deep generative models which is trained by maximizing the evidence lower bound of…

Machine Learning · Computer Science 2018-07-26 Yuchen Lu , Peng Xu

The Variational Autoencoder (VAE) is a powerful architecture capable of representation learning and generative modeling. When it comes to learning interpretable (disentangled) representations, VAE and its variants show unparalleled…

Machine Learning · Computer Science 2019-04-17 Michal Rolinek , Dominik Zietlow , Georg Martius

Variational autoencoders (VAEs), as an important aspect of generative models, have received a lot of research interests and reached many successful applications. However, it is always a challenge to achieve the consistency between the…

Machine Learning · Computer Science 2022-05-10 Xiaoyu Chen , Chen Gong , Qiang He , Xinwen Hou , Yu Liu

When trained effectively, the Variational Autoencoder (VAE) is both a powerful language model and an effective representation learning framework. In practice, however, VAEs are trained with the evidence lower bound (ELBO) as a surrogate…

Machine Learning · Computer Science 2019-09-04 Bohan Li , Junxian He , Graham Neubig , Taylor Berg-Kirkpatrick , Yiming Yang

Density estimation, compression and data generation are crucial tasks in artificial intelligence. Variational Auto-Encoders (VAEs) constitute a single framework to achieve these goals. Here, we present a novel class of generative models,…

Machine Learning · Statistics 2021-07-07 Ioannis Gatopoulos , Jakub M. Tomczak

Variational auto-encoders (VAEs) are a popular and powerful deep generative model. Previous works on VAEs have assumed a factorized likelihood model, whereby the output uncertainty of each pixel is assumed to be independent. This…

Machine Learning · Statistics 2026-05-14 Gara Dorta , Sara Vicente , Lourdes Agapito , Neill D. F. Campbell , Ivor Simpson