English
Related papers

Related papers: Disentangling Generative Factors of Physical Field…

200 papers

Deep latent variable models (DLVMs) are designed to learn meaningful representations in an unsupervised manner, such that the hidden explanatory factors are interpretable by independent latent variables (aka disentanglement). The…

Machine Learning · Computer Science 2025-01-28 Surojit Saha , Sarang Joshi , Ross Whitaker

Learning disentangled representations from visual data, where different high-level generative factors are independently encoded, is of importance for many computer vision tasks. Solving this problem, however, typically requires to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Adria Ruiz , Oriol Martinez , Xavier Binefa , Jakob Verbeek

Disentangled visual representations have largely been studied with generative models such as Variational AutoEncoders (VAEs). While prior work has focused on generative methods for disentangled representation learning, these approaches do…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Andrea Burns , Aaron Sarna , Dilip Krishnan , Aaron Maschinot

Distributed learning and Edge AI necessitate efficient data processing, low-latency communication, decentralized model training, and stringent data privacy to facilitate real-time intelligence on edge devices while reducing dependency on…

Machine Learning · Computer Science 2025-07-08 Lucas Heublein , Simon Kocher , Tobias Feigl , Alexander Rügamer , Christopher Mutschler , Felix Ott

In many data analysis tasks, it is beneficial to learn representations where each dimension is statistically independent and thus disentangled from the others. If data generating factors are also statistically independent, disentangled…

Machine Learning · Statistics 2019-12-12 Harshvardhan Sikka , Weishun Zhong , Jun Yin , Cengiz Pehlevan

Recently there has been an increased interest in unsupervised learning of disentangled representations using the Variational Autoencoder (VAE) framework. Most of the existing work has focused largely on modifying the variational cost…

Machine Learning · Statistics 2019-09-12 Jan Stühmer , Richard E. Turner , Sebastian Nowozin

Learning disentangled representations of real-world data is a challenging open problem. Most previous methods have focused on either supervised approaches which use attribute labels or unsupervised approaches that manipulate the…

Computation and Language · Computer Science 2021-01-26 Vikash Balasubramanian , Ivan Kobyzev , Hareesh Bahuleyan , Ilya Shapiro , Olga Vechtomova

Given a dataset of images containing different objects with different features such as shape, size, rotation, and x-y position; and a Variational Autoencoder (VAE); creating a disentangled encoding of these features in the hidden space…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Mohammad Haghir Ebrahimabadi

Disentanglement is a useful property in representation learning which increases the interpretability of generative models such as Variational autoencoders (VAE), Generative Adversarial Models, and their many variants. Typically in such…

Machine Learning · Computer Science 2022-05-31 Arun Pandey , Michael Fanuel , Joachim Schreurs , Johan A. K. Suykens

Learning interpretable representations with variational autoencoders (VAEs) is a major goal of representation learning. The main challenge lies in obtaining disentangled representations, where each latent dimension corresponds to a distinct…

One major challenge of disentanglement learning with variational autoencoders is the trade-off between disentanglement and reconstruction fidelity. Previous studies, which increase the information bottleneck during training, tend to lose…

Machine Learning · Computer Science 2023-10-05 Jiantao Wu , Shentong Mo , Xiang Yang , Muhammad Awais , Sara Atito , Xingshen Zhang , Lin Wang , Xiang Yang

Disentangled representations enable models to separate factors of variation that are shared across experimental conditions from those that are condition-specific. This separation is essential in domains such as biomedical data analysis,…

Machine Learning · Computer Science 2025-12-16 Yuli Slavutsky , Ozgur Beker , David Blei , Bianca Dumitrascu

The ability to accurately model random fields plays a critical role in science and engineering for problems involving uncertain, spatially-varying quantities such as heterogeneous material properties and turbulent flows. Deep generative…

A large part of the literature on learning disentangled representations focuses on variational autoencoders (VAE). Recent developments demonstrate that disentanglement cannot be obtained in a fully unsupervised setting without inductive…

Machine Learning · Computer Science 2021-02-11 Graziano Mita , Maurizio Filippone , Pietro Michiardi

Disentangled representation learning aims to learn low-dimensional representations where each dimension corresponds to an underlying generative factor. While the Variational Auto-Encoder (VAE) is widely used for this purpose, most existing…

Machine Learning · Computer Science 2024-12-31 Di Fan , Yannian Kou , Chuanhou Gao

Designing realistic digital humans is extremely complex. Most data-driven generative models used to simplify the creation of their underlying geometric shape do not offer control over the generation of local shape attributes. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Simone Foti , Bongjin Koo , Danail Stoyanov , Matthew J. Clarkson

The performance of $\beta$-Variational-Autoencoders ($\beta$-VAEs) and their variants on learning semantically meaningful, disentangled representations is unparalleled. On the other hand, there are theoretical arguments suggesting the…

Machine Learning · Computer Science 2021-02-16 Dominik Zietlow , Michal Rolinek , Georg Martius

We present a self-supervised method to disentangle factors of variation in high-dimensional data that does not rely on prior knowledge of the underlying variation profile (e.g., no assumptions on the number or distribution of the individual…

Machine Learning · Computer Science 2022-09-23 Eric Yeats , Frank Liu , David Womble , Hai Li

Paradoxically, a Variational Autoencoder (VAE) could be pushed in two opposite directions, utilizing powerful decoder model for generating realistic images but collapsing the learned representation, or increasing regularization coefficient…

Machine Learning · Computer Science 2022-03-30 Trung Ngo , Najwa Laabid , Ville Hautamäki , Merja Heinäniemi

Variational autoencoders (VAE) represent a popular, flexible form of deep generative model that can be stochastically fit to samples from a given random process using an information-theoretic variational bound on the true underlying…

Machine Learning · Computer Science 2019-10-08 Bin Dai , Yu Wang , John Aston , Gang Hua , David Wipf