English
Related papers

Related papers: Y-Autoencoders: disentangling latent representatio…

200 papers

The ability to accurately model random fields plays a critical role in science and engineering for problems involving uncertain, spatially-varying quantities such as heterogeneous material properties and turbulent flows. Deep generative…

We present a simple neural rendering architecture that helps variational autoencoders (VAEs) learn disentangled representations. Instead of the deconvolutional network typically used in the decoder of VAEs, we tile (broadcast) the latent…

Machine Learning · Computer Science 2019-08-15 Nicholas Watters , Loic Matthey , Christopher P. Burgess , Alexander Lerchner

Deep neural networks with discrete latent variables offer the promise of better symbolic reasoning, and learning abstractions that are more useful to new tasks. There has been a surge in interest in discrete latent variable models, however,…

Machine Learning · Computer Science 2018-07-23 Aurko Roy , Ashish Vaswani , Arvind Neelakantan , Niki Parmar

Variational Autoencoder (VAE)-based generative models offer flexible representation learning by incorporating meta-priors, general premises considered beneficial for downstream tasks. However, the incorporated meta-priors often involve…

Machine Learning · Computer Science 2023-02-27 Nao Nakagawa , Ren Togo , Takahiro Ogawa , Miki Haseyama

Probabilistic generative models are attractive for scientific modeling because their inferred parameters can be used to generate hypotheses and design experiments. This requires that the learned model provide an accurate representation of…

Machine Learning · Statistics 2023-01-18 Liyun Tu , Austin Talbot , Neil Gallagher , David Carlson

The central question in representation learning is what constitutes a good or meaningful representation. In this work we argue that if we consider data with inherent cluster structures, where clusters can be characterized through different…

Machine Learning · Computer Science 2022-12-05 Pascal Mattia Esser , Satyaki Mukherjee , Mahalakshmi Sabanayagam , Debarghya Ghoshdastidar

Learning robust representations of authorial style is crucial for authorship attribution and AI-generated text detection. However, existing methods often struggle with content-style entanglement, where models learn spurious correlations…

Computation and Language · Computer Science 2026-04-24 Hieu Man , Van-Cuong Pham , Nghia Trung Ngo , Franck Dernoncourt , Thien Huu Nguyen

Image generation has advanced rapidly over the past decade, yet the literature seems fragmented across different models and application domains. This paper aims to offer a comprehensive survey of breakthrough image generation models,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Rouzbeh Shirvani

Deep neural networks are powerful tools for biomedical image segmentation. These models are often trained with heavy supervision, relying on pairs of images and corresponding voxel-level labels. However, obtaining segmentations of…

Image and Video Processing · Electrical Eng. & Systems 2020-04-30 Evan M. Yu , Juan Eugenio Iglesias , Adrian V. Dalca , Mert R. Sabuncu

The manifold hypothesis states that high-dimensional data can be modeled as lying on or near a low-dimensional, nonlinear manifold. Variational Autoencoders (VAEs) approximate this manifold by learning mappings from low-dimensional latent…

Machine Learning · Statistics 2021-03-03 Marissa C. Connor , Gregory H. Canal , Christopher J. Rozell

Structured variational autoencoders (SVAEs) combine probabilistic graphical model priors on latent variables, deep neural networks to link latent variables to observed data, and structure-exploiting algorithms for approximate posterior…

Machine Learning · Statistics 2023-05-29 Yixiu Zhao , Scott W. Linderman

Variational Autoencoders for multimodal data hold promise for many tasks in data analysis, such as representation learning, conditional generation, and imputation. Current architectures either share the encoder output, decoder input, or…

As one of the most popular generative models, Variational Autoencoder (VAE) approximates the posterior of latent variables based on amortized variational inference. However, when the decoder network is sufficiently expressive, VAE may lead…

Machine Learning · Computer Science 2021-10-26 Dazhong Shen , Chuan Qin , Chao Wang , Hengshu Zhu , Enhong Chen , Hui Xiong

Semi-supervised learning is attracting increasing attention due to the fact that datasets of many domains lack enough labeled data. Variational Auto-Encoder (VAE), in particular, has demonstrated the benefits of semi-supervised learning.…

Machine Learning · Computer Science 2018-12-04 Yang Li , Quan Pan , Suhang Wang , Haiyun Peng , Tao Yang , Erik Cambria

Disentangled representation learning finds compact, independent and easy-to-interpret factors of the data. Learning such has been shown to require an inductive bias, which we explicitly encode in a generative model of images. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Nicki Skafte Detlefsen , Søren Hauberg

Approximating distributions over complicated manifolds, such as natural images, are conceptually attractive. The deep latent variable model, trained using variational autoencoders and generative adversarial networks, is now a key technique…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Wenju Xu , Shawn Keshmiri , Guanghui Wang

While the beta-VAE family is aiming to find disentangled representations and acquire human-interpretable generative factors, like what an ICA (from the linear domain) does, we propose Full Encoder, a novel unified autoencoder framework as a…

Machine Learning · Computer Science 2021-07-14 Zhouzheng Li , Kun Feng

The recently developed variational autoencoders (VAEs) have proved to be an effective confluence of the rich representational power of neural networks with Bayesian methods. However, most work on VAEs use a rather simple prior over the…

Machine Learning · Computer Science 2017-08-29 Prasoon Goyal , Zhiting Hu , Xiaodan Liang , Chenyu Wang , Eric Xing

A feature learning task involves training models that are capable of inferring good representations (transformations of the original space) from input data alone. When working with limited or unlabelled data, and also when multiple visual…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Gabriel B. Cavallari , Leonardo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

Autoencoders (AE) have recently been widely employed to approach the novelty detection problem. Trained only on the normal data, the AE is expected to reconstruct the normal data effectively while fail to regenerate the anomalous data,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Mohammadreza Salehi , Atrin Arya , Barbod Pajoum , Mohammad Otoofi , Amirreza Shaeiri , Mohammad Hossein Rohban , Hamid R. Rabiee