English
Related papers

Related papers: Hierarchical Variational Autoencoder for Visual Co…

200 papers

We apply variational autoencoders (VAE) to X-ray diffraction (XRD) data analysis on both simulated and experimental thin-film data. We show that crystal structure representations learned by a VAE reveal latent information, such as the…

Materials Science · Physics 2021-04-12 Lars Banko , Phillip M. Maffettone , Dennis Naujoks , Daniel Olds , Alfred Ludwig

The goal of a classification model is to assign the correct labels to data. In most cases, this data is not fully described by the given set of labels. Often a rich set of meaningful concepts exist in the domain that can much more precisely…

Machine Learning · Computer Science 2021-08-23 Yoeri Poels , Vlado Menkovski

Variational Autoencoder (VAE) aims to compress pixel data into low-dimensional latent space, playing an important role in OpenAI's Sora and other latent video diffusion generation models. While most of existing video VAEs inflate a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Pingyu Wu , Kai Zhu , Yu Liu , Liming Zhao , Wei Zhai , Yang Cao , Zheng-Jun Zha

Learning disentanglement aims at finding a low dimensional representation which consists of multiple explanatory and generative factors of the observational data. The framework of variational autoencoder (VAE) is commonly used to…

Machine Learning · Computer Science 2023-12-20 Mengyue Yang , Furui Liu , Zhitang Chen , Xinwei Shen , Jianye Hao , Jun Wang

Despite progress in training neural networks for lossy image compression, current approaches fail to maintain both perceptual quality and abstract features at very low bitrates. Encouraged by recent success in learning discrete…

Machine Learning · Computer Science 2020-10-19 Will Williams , Sam Ringer , Tom Ash , John Hughes , David MacLeod , Jamie Dougherty

People can easily imagine the potential sound while seeing an event. This natural synchronization between audio and visual signals reveals their intrinsic correlations. To this end, we propose to learn the audio-visual correlations from the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Ye Zhu , Yu Wu , Hugo Latapie , Yi Yang , Yan Yan

Variational Convertor-Encoder (VCE) converts an image to various styles; we present this novel architecture for the problem of one-shot generalization and its transfer to new tasks not seen before without additional training. We also…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Chengshuai Li , Shuai Han , Jianping Xing

Masked autoencoder (MAE), a simple and effective self-supervised learning framework based on the reconstruction of masked image regions, has recently achieved prominent success in a variety of vision tasks. Despite the emergence of…

Machine Learning · Computer Science 2023-06-09 Lingjing Kong , Martin Q. Ma , Guangyi Chen , Eric P. Xing , Yuejie Chi , Louis-Philippe Morency , Kun Zhang

Variational Auto-Encoder (VAE) has been widely applied as a fundamental generative model in machine learning. For complex samples like imagery objects or scenes, however, VAE suffers from the dimensional dilemma between reconstruction…

Machine Learning · Computer Science 2020-02-18 Deli Zhao , Jiapeng Zhu , Bo Zhang

This paper proposes a non-parallel many-to-many voice conversion (VC) method using a variant of the conditional variational autoencoder (VAE) called an auxiliary classifier VAE (ACVAE). The proposed method has three key features. First, it…

Machine Learning · Statistics 2020-10-13 Hirokazu Kameoka , Takuhiro Kaneko , Kou Tanaka , Nobukatsu Hojo

With the introduction of the variational autoencoder (VAE), probabilistic latent variable models have received renewed attention as powerful generative models. However, their performance in terms of test likelihood and quality of generated…

Machine Learning · Statistics 2020-01-13 Lars Maaløe , Marco Fraccaro , Valentin Liévin , Ole Winther

As a general-purpose generative model architecture, VAE has been widely used in the field of image and natural language processing. VAE maps high dimensional sample data into continuous latent variables with unsupervised learning. Sampling…

Machine Learning · Statistics 2019-11-05 Yao Li

Variational AutoEncoders (VAEs) are powerful generative models that merge elements from statistics and information theory with the flexibility offered by deep neural networks to efficiently solve the generation problem for high dimensional…

Machine Learning · Computer Science 2021-03-02 A. Asperti , D. Evangelista , E. Loli Piccolomini

Semi-supervised learning is attracting increasing attention due to the fact that datasets of many domains lack enough labeled data. Variational Auto-Encoder (VAE), in particular, has demonstrated the benefits of semi-supervised learning.…

Machine Learning · Computer Science 2018-12-04 Yang Li , Quan Pan , Suhang Wang , Haiyun Peng , Tao Yang , Erik Cambria

Often the analysis of time-dependent chemical and biophysical systems produces high-dimensional time-series data for which it can be difficult to interpret which individual features are most salient. While recent work from our group and…

Variational autoencoders were proven successful in domains such as computer vision and speech processing. Their adoption for modeling user preferences is still unexplored, although recently it is starting to gain attention in the current…

Machine Learning · Computer Science 2018-11-27 Noveen Sachdeva , Giuseppe Manco , Ettore Ritacco , Vikram Pudi

Although variational autoencoders (VAEs) represent a widely influential deep generative model, many aspects of the underlying energy function remain poorly understood. In particular, it is commonly believed that Gaussian encoder/decoder…

Machine Learning · Computer Science 2019-10-31 Bin Dai , David Wipf

Disentangled representation learning aims to learn low-dimensional representations where each dimension corresponds to an underlying generative factor. While the Variational Auto-Encoder (VAE) is widely used for this purpose, most existing…

Machine Learning · Computer Science 2024-12-31 Di Fan , Yannian Kou , Chuanhou Gao

Denoising autoencoders (DAE) are trained to reconstruct their clean inputs with noise injected at the input level, while variational autoencoders (VAE) are trained with noise injected in their stochastic hidden layer, with a regularizer…

Machine Learning · Computer Science 2016-01-05 Daniel Jiwoong Im , Sungjin Ahn , Roland Memisevic , Yoshua Bengio

In this tutorial, we explore Variational Autoencoders (VAEs), an essential framework for unsupervised learning, particularly suited for high-dimensional datasets such as neuroimaging. By integrating deep learning with Bayesian inference,…

Image and Video Processing · Electrical Eng. & Systems 2025-01-15 C. Vázquez-García , F. J. Martínez-Murcia , F. Segovia Román , Juan M. Górriz Sáez