English
Related papers

Related papers: Disentangling and Learning Robust Representations …

200 papers

Learning interpretable representations with variational autoencoders (VAEs) is a major goal of representation learning. The main challenge lies in obtaining disentangled representations, where each latent dimension corresponds to a distinct…

We present a framework for learning disentangled and interpretable jointly continuous and discrete representations in an unsupervised manner. By augmenting the continuous latent distribution of variational autoencoders with a relaxed…

Machine Learning · Statistics 2018-10-23 Emilien Dupont

Disentangled representation learning aims to learn low-dimensional representations where each dimension corresponds to an underlying generative factor. While the Variational Auto-Encoder (VAE) is widely used for this purpose, most existing…

Machine Learning · Computer Science 2024-12-31 Di Fan , Yannian Kou , Chuanhou Gao

Several factors contribute to the appearance of an object in a visual scene, including pose, illumination, and deformation, among others. Each factor accounts for a source of variability in the data, while the multiplicative interactions of…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Mengjiao Wang , Zhixin Shu , Shiyang Cheng , Yannis Panagakis , Dimitris Samaras , Stefanos Zafeiriou

Deep neural networks have become increasingly of interest in dynamical system prediction, but out-of-distribution generalization and long-term stability still remains challenging. In this work, we treat the domain parameters of dynamical…

Machine Learning · Computer Science 2023-06-02 Stathi Fotiadis , Mario Lino , Shunlong Hu , Stef Garasto , Chris D Cantwell , Anil Anthony Bharath

Recommendation models are typically trained on observational user interaction data, but the interactions between latent factors in users' decision-making processes lead to complex and entangled data. Disentangling these latent factors to…

Information Retrieval · Computer Science 2023-04-18 Siyu Wang , Xiaocong Chen , Quan Z. Sheng , Yihong Zhang , Lina Yao

The ability to extract generative parameters from high-dimensional fields of data in an unsupervised manner is a highly desirable yet unrealized goal in computational physics. This work explores the use of variational autoencoders (VAEs)…

Computational Physics · Physics 2021-11-16 Christian Jacobsen , Karthik Duraisamy

The rising need for explainable deep neural network architectures has utilized semantic concepts as explainable units. Several approaches utilizing disentangled representation learning estimate the generative factors and utilize them as…

Machine Learning · Computer Science 2024-10-22 Sanchit Sinha , Guangzhi Xiong , Aidong Zhang

Representation learning assumes that real-world data is generated by a few semantically meaningful generative factors (i.e., sources of variation) and aims to discover them in the latent space. These factors are expected to be causally…

Machine Learning · Computer Science 2023-10-27 Xiaoyu Liu , Jiaxin Yuan , Bang An , Yuancheng Xu , Yifan Yang , Furong Huang

The ability to learn disentangled representations that split underlying sources of variation in high dimensional, unstructured data is important for data efficient and robust use of neural networks. While various approaches aiming towards…

Machine Learning · Statistics 2019-05-15 Raphael Suter , Đorđe Miladinović , Bernhard Schölkopf , Stefan Bauer

A disentangled representation of a data set should be capable of recovering the underlying factors that generated it. One question that arises is whether using Euclidean space for latent variable models can produce a disentangled…

Machine Learning · Computer Science 2020-03-23 Luis A. Pérez Rey

Conditional Generative Models are now acknowledged an essential tool in Machine Learning. This paper focuses on their control. While many approaches aim at disentangling the data through the coordinate-wise control of their latent…

Machine Learning · Computer Science 2020-01-23 Victor Berger , Michèle Sebag

Learning disentangled representations of real-world data is a challenging open problem. Most previous methods have focused on either supervised approaches which use attribute labels or unsupervised approaches that manipulate the…

Computation and Language · Computer Science 2021-01-26 Vikash Balasubramanian , Ivan Kobyzev , Hareesh Bahuleyan , Ilya Shapiro , Olga Vechtomova

Many problems in machine learning and related application areas are fundamentally variants of conditional modeling and sampling across multi-aspect data, either multi-view, multi-modal, or simply multi-group. For example, sampling from the…

Machine Learning · Computer Science 2018-06-26 Samuel K. Ainsworth , Nicholas J. Foti , Emily B. Fox

Generative models that learn disentangled representations for different factors of variation in an image can be very useful for targeted data augmentation. By sampling from the disentangled latent subspace of interest, we can efficiently…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Ananya Harsh Jha , Saket Anand , Maneesh Singh , V. S. R. Veeravasarapu

Variational autoencoders (VAEs) learn representations of data by jointly training a probabilistic encoder and decoder network. Typically these models encode all features of the data into a single variable. Here we are interested in learning…

The ability of learning disentangled representations represents a major step for interpretable NLP systems as it allows latent linguistic features to be controlled. Most approaches to disentanglement rely on continuous variables, both for…

Computation and Language · Computer Science 2021-09-16 Giangiacomo Mercatali , André Freitas

Learning disentangled representations leads to interpretable models and facilitates data generation with style transfer, which has been extensively studied on static data such as images in an unsupervised learning framework. However, only a…

Machine Learning · Computer Science 2021-01-20 Jun Han , Martin Renqiang Min , Ligong Han , Li Erran Li , Xuan Zhang

While deep generative models have significantly advanced representation learning, they may inherit or amplify biases and fairness issues by encoding sensitive attributes alongside predictive features. Enforcing strict independence in…

Machine Learning · Computer Science 2025-11-18 Chenrui Ma , Xi Xiao , Tianyang Wang , Xiao Wang , Yanning Shen

Latent traversal is a popular approach to visualize the disentangled latent representations. Given a bunch of variations in a single unit of the latent representation, it is expected that there is a change in a single factor of variation of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Xinqi Zhu , Chang Xu , Dacheng Tao