English
Related papers

Related papers: Variational Learning of Disentangled Representatio…

200 papers

Disentangled representation learning has seen a surge in interest over recent times, generally focusing on new models which optimise one of many disparate disentanglement metrics. Symmetry Based Disentangled Representation learning…

Machine Learning · Computer Science 2021-11-12 Matthew Painter , Jonathon Hare , Adam Prugel-Bennett

We view disentanglement learning as discovering an underlying structure that equivariantly reflects the factorized variations shown in data. Traditionally, such a structure is fixed to be a vector space with data variations represented by…

Machine Learning · Computer Science 2021-06-08 Xinqi Zhu , Chang Xu , Dacheng Tao

We construct an unsupervised learning model that achieves nonlinear disentanglement of underlying factors of variation in naturalistic videos. Previous work suggests that representations can be disentangled if all but a few factors in the…

Disentangled representation learning is one of the major goals of deep learning, and is a key step for achieving explainable and generalizable models. A well-defined theoretical guarantee still lacks for the VAE-based unsupervised methods,…

Machine Learning · Computer Science 2022-03-16 Tao Yang , Xuanchi Ren , Yuwang Wang , Wenjun Zeng , Nanning Zheng

Conflicting objectives present a considerable challenge in interleaving multi-task learning, necessitating the need for meticulous design and balance to ensure effective learning of a representative latent data space across all tasks…

Machine Learning · Computer Science 2025-01-17 Noelle Y. L. Wong , Eng Yeow Cheu , Zhonglin Chiam , Dipti Srinivasan

A variational autoencoder (VAE) is a probabilistic machine learning framework for posterior inference that projects an input set of high-dimensional data to a lower-dimensional, latent space. The latent space learned with a VAE offers…

Machine Learning · Computer Science 2022-11-16 Rafael Pastrana

Continuous treatment effect estimation holds significant practical importance across various decision-making and assessment domains, such as healthcare and the military. However, current methods for estimating dose-response curves hinge on…

Machine Learning · Computer Science 2024-06-05 Ruijing Cui , Jianbin Sun , Bingyu He , Kewei Yang , Bingfeng Ge

Disentangled representations seek to recover latent factors of variation underlying observed data, yet their identifiability is still not fully understood. We introduce a unified framework in which disentanglement is achieved through…

Machine Learning · Computer Science 2026-05-12 Stefan Matthes , Zhiwei Han , Hao Shen

We define and address the problem of unsupervised learning of disentangled representations on data generated from independent factors of variation. We propose FactorVAE, a method that disentangles by encouraging the distribution of…

Machine Learning · Statistics 2019-07-10 Hyunjik Kim , Andriy Mnih

Intelligent behaviour in the real-world requires the ability to acquire new knowledge from an ongoing sequence of experiences while preserving and reusing past knowledge. We propose a novel algorithm for unsupervised representation learning…

Disentangling factors of variation has become a very challenging problem on representation learning. Existing algorithms suffer from many limitations, such as unpredictable disentangling factors, poor quality of generated images from…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Taihong Xiao , Jiapeng Hong , Jinwen Ma

In disentangled representation learning, a model is asked to tease apart a dataset's underlying sources of variation and represent them independently of one another. Since the model is provided with no ground truth information about these…

Machine Learning · Computer Science 2023-10-24 Kyle Hsu , Will Dorrell , James C. R. Whittington , Jiajun Wu , Chelsea Finn

The problem of fair classification can be mollified if we develop a method to remove the embedded sensitive information from the classification features. This line of separating the sensitive information is developed through the causal…

Machine Learning · Computer Science 2020-12-10 Hyemi Kim , Seungjae Shin , JoonHo Jang , Kyungwoo Song , Weonyoung Joo , Wanmo Kang , Il-Chul Moon

Learning rich representation from data is an important task for deep generative models such as variational auto-encoder (VAE). However, by extracting high-level abstractions in the bottom-up inference process, the goal of preserving all…

Machine Learning · Computer Science 2020-02-26 Zhiyuan Li , Jaideep Vitthal Murkute , Prashnna Kumar Gyawali , Linwei Wang

The (variational) graph auto-encoder is widely used to learn representations for graph-structured data. However, the formation of real-world graphs is a complicated and heterogeneous process influenced by latent factors. Existing encoders…

Machine Learning · Computer Science 2024-07-17 Di Fan , Chuanhou Gao

Learning a disentangled, interpretable, and structured latent representation in 3D generative models of faces and bodies is still an open problem. The problem is particularly acute when control over identity features is required. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Simone Foti , Bongjin Koo , Danail Stoyanov , Matthew J. Clarkson

The ability of learning disentangled representations represents a major step for interpretable NLP systems as it allows latent linguistic features to be controlled. Most approaches to disentanglement rely on continuous variables, both for…

Computation and Language · Computer Science 2021-09-16 Giangiacomo Mercatali , André Freitas

Latent variable models such as the Variational Auto-Encoder (VAE) have become a go-to tool for analyzing biological data, especially in the field of single-cell genomics. One remaining challenge is the interpretability of latent variables…

Genomics · Quantitative Biology 2023-02-20 Romain Lopez , Nataša Tagasovska , Stephen Ra , Kyunghyn Cho , Jonathan K. Pritchard , Aviv Regev

We propose an approach to learn image representations that consist of disentangled factors of variation without exploiting any manual labeling or data domain knowledge. A factor of variation corresponds to an image attribute that can be…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Qiyang Hu , Attila Szabó , Tiziano Portenier , Matthias Zwicker , Paolo Favaro

We present a self-supervised method to disentangle factors of variation in high-dimensional data that does not rely on prior knowledge of the underlying variation profile (e.g., no assumptions on the number or distribution of the individual…

Machine Learning · Computer Science 2022-09-23 Eric Yeats , Frank Liu , David Womble , Hai Li