English
Related papers

Related papers: Discovering Influential Factors in Variational Aut…

200 papers

One major challenge of disentanglement learning with variational autoencoders is the trade-off between disentanglement and reconstruction fidelity. Previous studies, which increase the information bottleneck during training, tend to lose…

Machine Learning · Computer Science 2023-10-05 Jiantao Wu , Shentong Mo , Xiang Yang , Muhammad Awais , Sara Atito , Xingshen Zhang , Lin Wang , Xiang Yang

After deep generative models were successfully applied to image generation tasks, learning disentangled latent variables of data has become a crucial part of deep generative model research. Many models have been proposed to learn an…

Machine Learning · Computer Science 2019-07-08 Sangchul Hahn , Heeyoul Choi

The surrogate loss of variational autoencoders (VAEs) poses various challenges to their training, inducing the imbalance between task fitting and representation inference. To avert this, the existing strategies for VAEs focus on adjusting…

Neural and Evolutionary Computing · Computer Science 2024-04-02 Zhangkai Wu , Longbing Cao , Lei Qi

Multiple modalities often co-occur when describing natural phenomena. Learning a joint representation of these modalities should yield deeper and more useful representations. Previous generative approaches to multi-modal input either do not…

Machine Learning · Computer Science 2018-11-13 Mike Wu , Noah Goodman

Learning from an imbalanced distribution presents a major challenge in predictive modeling, as it generally leads to a reduction in the performance of standard algorithms. Various approaches exist to address this issue, but many of them…

Machine Learning · Computer Science 2024-12-11 Samuel Stocksieker , Denys Pommeret , Arthur Charpentier

Most existing works on disentangled representation learning are solely built upon an marginal independence assumption: all factors in disentangled representations should be statistically independent. This assumption is necessary but…

Machine Learning · Computer Science 2020-07-02 Xiaojiang Yang , Wendong Bi , Yitong Sun , Yu Cheng , Junchi Yan

While unsupervised variational autoencoders (VAE) have become a powerful tool in neuroimage analysis, their application to supervised learning is under-explored. We aim to close this gap by proposing a unified probabilistic model for…

Machine Learning · Computer Science 2019-07-15 Qingyu Zhao , Ehsan Adeli , Nicolas Honnorat , Tuo Leng , Kilian M. Pohl

We apply variational autoencoders (VAE) to X-ray diffraction (XRD) data analysis on both simulated and experimental thin-film data. We show that crystal structure representations learned by a VAE reveal latent information, such as the…

Materials Science · Physics 2021-04-12 Lars Banko , Phillip M. Maffettone , Dennis Naujoks , Daniel Olds , Alfred Ludwig

Learning the latent representation of data in unsupervised fashion is a very interesting process that provides relevant features for enhancing the performance of a classifier. For speech emotion recognition tasks, generating effective…

Sound · Computer Science 2020-07-29 Siddique Latif , Rajib Rana , Junaid Qadir , Julien Epps

Unsupervised representation learning holds the promise of exploiting large amounts of unlabeled data to learn general representations. A promising technique for unsupervised learning is the framework of Variational Auto-encoders (VAEs).…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Kamal Gupta , Saurabh Singh , Abhinav Shrivastava

Longitudinal datasets measured repeatedly over time from individual subjects, arise in many biomedical, psychological, social, and other studies. A common approach to analyse high-dimensional data that contains missing values is to learn a…

Machine Learning · Statistics 2021-04-21 Siddharth Ramchandran , Gleb Tikhonov , Kalle Kujanpää , Miika Koskinen , Harri Lähdesmäki

Variational autoencoder (VAE) estimates the posterior parameters (mean and variance) of latent variables corresponding to each input data. While it is used for many tasks, the transparency of the model is still an underlying issue. This…

Machine Learning · Statistics 2023-02-23 Akira Nakagawa , Keizo Kato , Taiji Suzuki

The variational autoencoder (VAE) is a simple and efficient generative artificial intelligence method for modeling complex probability distributions of various types of data, such as images and texts. However, it suffers some main…

Machine Learning · Computer Science 2025-02-14 Xi Chen , Shaofan Li

Variational autoencoders (VAEs) provide an effective and simple method for modeling complex distributions. However, training VAEs often requires considerable hyperparameter tuning to determine the optimal amount of information retained by…

Machine Learning · Computer Science 2021-07-13 Oleh Rybkin , Kostas Daniilidis , Sergey Levine

Variational autoencoders are prominent generative models for modeling discrete data. However, with flexible decoders, they tend to ignore the latent codes. In this paper, we study a VAE model with a deterministic decoder (DD-VAE) for…

Machine Learning · Computer Science 2020-03-05 Daniil Polykovskiy , Dmitry Vetrov

Variational autoencoders (VAEs) employ Bayesian inference to interpret sensory inputs, mirroring processes that occur in primate vision across both ventral (Higgins et al., 2021) and dorsal (Vafaii et al., 2023) pathways. Despite their…

Machine Learning · Computer Science 2024-12-10 Hadi Vafaii , Dekel Galor , Jacob L. Yates

Latent variable models like the Variational Auto-Encoder (VAE) are commonly used to learn representations of images. However, for downstream tasks like semantic classification, the representations learned by VAE are less competitive than…

Machine Learning · Statistics 2022-05-31 Mingtian Zhang , Tim Z. Xiao , Brooks Paige , David Barber

VAEs, or variational autoencoders, are autoencoders that explicitly learn the distribution of the input image space rather than assuming no prior information about the distribution. This allows it to classify similar samples close to each…

Machine Learning · Computer Science 2023-02-08 Fareed Sheriff , Sameer Pai

Variational autoencoders (VAEs) are a popular framework for modeling complex data distributions; they can be efficiently trained via variational inference by maximizing the evidence lower bound (ELBO), at the expense of a gap to the exact…

As an important problem in causal inference, we discuss the identification and estimation of treatment effects (TEs) under limited overlap; that is, when subjects with certain features belong to a single treatment group. We use a latent…

Machine Learning · Statistics 2022-04-22 Pengzhou Wu , Kenji Fukumizu