English
Related papers

Related papers: HQ-VAE: Hierarchical Discrete Representation Learn…

200 papers

Hierarchical Bayesian methods can unify many related tasks (e.g. k-shot classification, conditional and unconditional generation) as inference within a single generative model. However, when this generative model is expressed as a powerful…

Machine Learning · Computer Science 2018-07-25 Luke B. Hewitt , Maxwell I. Nye , Andreea Gane , Tommi Jaakkola , Joshua B. Tenenbaum

We present a Split Vector Quantized Variational Autoencoder (SVQ-VAE) architecture using a split vector quantizer for NTTS, as an enhancement to the well-known Variational Autoencoder (VAE) and Vector Quantized Variational Autoencoder…

Sound · Computer Science 2023-09-15 Marek Strong , Jonas Rohnke , Antonio Bonafonte , Mateusz Łajszczak , Trevor Wood

The Variational Autoencoder (VAE) is a powerful architecture capable of representation learning and generative modeling. When it comes to learning interpretable (disentangled) representations, VAE and its variants show unparalleled…

Machine Learning · Computer Science 2019-04-17 Michal Rolinek , Dominik Zietlow , Georg Martius

The ability of Variational Autoencoders (VAEs) to learn disentangled representations has made them popular for practical applications. However, their behaviour is not yet fully understood. For example, the questions of when they can provide…

Machine Learning · Computer Science 2022-09-27 Lisa Bonheme , Marek Grzes

Variational auto-encoders (VAEs) are deep generative latent variable models that can be used for learning the distribution of complex data. VAEs have been successfully used to learn a probabilistic prior over speech signals, which is then…

Sound · Computer Science 2020-12-18 Mostafa Sadeghi , Simon Leglaive , Xavier Alameda-PIneda , Laurent Girin , Radu Horaud

Given the complex geometry of white matter streamlines, Autoencoders have been proposed as a dimension-reduction tool to simplify the analysis streamlines in a low-dimensional latent spaces. However, despite these recent successes, the…

Machine Learning · Statistics 2023-11-21 Andrew Lizarraga , Brandon Taraku , Edouardo Honig , Ying Nian Wu , Shantanu H. Joshi

Unsupervised learning of discrete representations in neural networks (NNs) from continuous ones is essential for many modern applications. Vector Quantisation (VQ) has become popular for this, in particular in the context of generative…

Machine Learning · Computer Science 2024-07-10 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

We propose an approach to symbolic regression based on a novel variational autoencoder for generating hierarchical structures, HVAE. It combines simple atomic units with shared weights to recursively encode and decode the individual nodes…

Machine Learning · Computer Science 2023-09-12 Sebastian Mežnar , Sašo Džeroski , Ljupčo Todorovski

Paradoxically, a Variational Autoencoder (VAE) could be pushed in two opposite directions, utilizing powerful decoder model for generating realistic images but collapsing the learned representation, or increasing regularization coefficient…

Machine Learning · Computer Science 2022-03-30 Trung Ngo , Najwa Laabid , Ville Hautamäki , Merja Heinäniemi

Inverse problems often involve matching observational data using a physical model that takes a large number of parameters as input. These problems tend to be under-constrained and require regularization to impose additional structure on the…

Computational Physics · Physics 2019-06-07 Daniel O'Malley , John K. Golden , Velimir V. Vesselinov

Unsupervised representation learning holds the promise of exploiting large amounts of unlabeled data to learn general representations. A promising technique for unsupervised learning is the framework of Variational Auto-encoders (VAEs).…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Kamal Gupta , Saurabh Singh , Abhinav Shrivastava

Cross-modal retrieval is to utilize one modality as a query to retrieve data from another modality, which has become a popular topic in information retrieval, machine learning, and database. How to effectively measure the similarity between…

Information Retrieval · Computer Science 2021-12-07 Jiwei Zhang , Yi Yu , Suhua Tang , Jianming Wu , Wei Li

In just three years, Variational Autoencoders (VAEs) have emerged as one of the most popular approaches to unsupervised learning of complicated distributions. VAEs are appealing because they are built on top of standard function…

Machine Learning · Statistics 2021-01-05 Carl Doersch

Learning a robust Variational Autoencoder (VAE) is a fundamental step for many deep learning applications in medical image analysis, such as MRI synthesizes. Existing brain VAEs predominantly focus on single-modality data (i.e., T1-weighted…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Mingjie Li , Edward Kim , Yue Zhao , Ehsan Adeli , Kilian M. Pohl

Learning a robust video Variational Autoencoder (VAE) is essential for reducing video redundancy and facilitating efficient video generation. Directly applying image VAEs to individual frames in isolation can result in temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yazhou Xing , Yang Fei , Yingqing He , Jingye Chen , Jiaxin Xie , Xiaowei Chi , Qifeng Chen

Variational Autoencoders (VAEs) have recently been highly successful at imputing and acquiring heterogeneous missing data. However, within this specific application domain, existing VAE methods are restricted by using only one layer of…

Machine Learning · Computer Science 2022-12-23 Ignacio Peis , Chao Ma , José Miguel Hernández-Lobato

Machine learning has had a great deal of success in image processing. However, the focus of this work has largely been on realistic images, ignoring more niche art styles such as pixel art. Additionally, many traditional machine learning…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Akash Saravanan , Matthew Guzdial

Learning from heterogeneous data poses challenges such as combining data from various sources and of different types. Meanwhile, heterogeneous data are often associated with missingness in real-world applications due to heterogeneity and…

Machine Learning · Computer Science 2021-02-26 Yu Gong , Hossein Hajimirsadeghi , Jiawei He , Thibaut Durand , Greg Mori

Variational Autoencoder is a scalable method for learning latent variable models of complex data. It employs a clear objective that can be easily optimized. However, it does not explicitly measure the quality of learned representations. We…

Machine Learning · Computer Science 2020-05-29 Andriy Serdega , Dae-Shik Kim

In recent years Variation Autoencoders have become one of the most popular unsupervised learning of complicated distributions.Variational Autoencoder (VAE) provides more efficient reconstructive performance over a traditional autoencoder.…

Machine Learning · Statistics 2017-07-12 Gautam Ramachandra