English
Related papers

Related papers: Discond-VAE: Disentangling Continuous Factors from…

200 papers

Learning precise representations of users and items to fit observed interaction data is the fundamental task of collaborative filtering. Existing studies usually infer entangled representations to fit such interaction data, neglecting to…

Information Retrieval · Computer Science 2024-01-11 Zhiqiang Guo , Guohui Li , Jianjun Li , Chaoyang Wang , Si Shi

A disentangled representation of a data set should be capable of recovering the underlying factors that generated it. One question that arises is whether using Euclidean space for latent variable models can produce a disentangled…

Machine Learning · Computer Science 2020-03-23 Luis A. Pérez Rey

The problem of feature disentanglement has been explored in the literature, for the purpose of image and video processing and text analysis. State-of-the-art methods for disentangling feature representations rely on the presence of many…

Machine Learning · Computer Science 2017-11-28 Ershad Banijamali , Amir-Hossein Karimi , Alexander Wong , Ali Ghodsi

Most existing works on disentangled representation learning are solely built upon an marginal independence assumption: all factors in disentangled representations should be statistically independent. This assumption is necessary but…

Machine Learning · Computer Science 2020-07-02 Xiaojiang Yang , Wendong Bi , Yitong Sun , Yu Cheng , Junchi Yan

We present a self-supervised method to disentangle factors of variation in high-dimensional data that does not rely on prior knowledge of the underlying variation profile (e.g., no assumptions on the number or distribution of the individual…

Machine Learning · Computer Science 2022-09-23 Eric Yeats , Frank Liu , David Womble , Hai Li

Semi-supervised learning is attracting increasing attention due to the fact that datasets of many domains lack enough labeled data. Variational Auto-Encoder (VAE), in particular, has demonstrated the benefits of semi-supervised learning.…

Machine Learning · Computer Science 2018-12-04 Yang Li , Quan Pan , Suhang Wang , Haiyun Peng , Tao Yang , Erik Cambria

Disentangled representations, where the higher level data generative factors are reflected in disjoint latent dimensions, offer several benefits such as ease of deriving invariant representations, transferability to other tasks,…

Machine Learning · Computer Science 2018-12-31 Abhishek Kumar , Prasanna Sattigeri , Avinash Balakrishnan

Deep neural networks have become increasingly of interest in dynamical system prediction, but out-of-distribution generalization and long-term stability still remains challenging. In this work, we treat the domain parameters of dynamical…

Machine Learning · Computer Science 2023-06-02 Stathi Fotiadis , Mario Lino , Shunlong Hu , Stef Garasto , Chris D Cantwell , Anil Anthony Bharath

We propose an algorithm, guided variational autoencoder (Guided-VAE), that is able to learn a controllable generative model by performing latent representation disentanglement learning. The learning objective is achieved by providing…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Zheng Ding , Yifan Xu , Weijian Xu , Gaurav Parmar , Yang Yang , Max Welling , Zhuowen Tu

Latent variable models such as the Variational Auto-Encoder (VAE) have become a go-to tool for analyzing biological data, especially in the field of single-cell genomics. One remaining challenge is the interpretability of latent variables…

Genomics · Quantitative Biology 2023-02-20 Romain Lopez , Nataša Tagasovska , Stephen Ra , Kyunghyn Cho , Jonathan K. Pritchard , Aviv Regev

Disentangled sequential autoencoders (DSAEs) represent a class of probabilistic graphical models that describes an observed sequence with dynamic latent variables and a static latent variable. The former encode information at a frame rate…

Sound · Computer Science 2022-06-16 Yin-Jyun Luo , Sebastian Ewert , Simon Dixon

Representation learning assumes that real-world data is generated by a few semantically meaningful generative factors (i.e., sources of variation) and aims to discover them in the latent space. These factors are expected to be causally…

Machine Learning · Computer Science 2023-10-27 Xiaoyu Liu , Jiaxin Yuan , Bang An , Yuancheng Xu , Yifan Yang , Furong Huang

Latent traversal is a popular approach to visualize the disentangled latent representations. Given a bunch of variations in a single unit of the latent representation, it is expected that there is a change in a single factor of variation of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Xinqi Zhu , Chang Xu , Dacheng Tao

Deep latent-variable models learn representations of high-dimensional data in an unsupervised manner. A number of recent efforts have focused on learning representations that disentangle statistically independent axes of variation by…

Contrastive Analysis VAE (CA-VAEs) is a family of Variational auto-encoders (VAEs) that aims at separating the common factors of variation between a background dataset (BG) (i.e., healthy subjects) and a target dataset (TG) (i.e., patients)…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Robin Louiset , Edouard Duchesnay , Antoine Grigis , Benoit Dufumier , Pietro Gori

Recently there has been an increased interest in unsupervised learning of disentangled representations using the Variational Autoencoder (VAE) framework. Most of the existing work has focused largely on modifying the variational cost…

Machine Learning · Statistics 2019-09-12 Jan Stühmer , Richard E. Turner , Sebastian Nowozin

The rising need for explainable deep neural network architectures has utilized semantic concepts as explainable units. Several approaches utilizing disentangled representation learning estimate the generative factors and utilize them as…

Machine Learning · Computer Science 2024-10-22 Sanchit Sinha , Guangzhi Xiong , Aidong Zhang

Learning interpretable and human-controllable representations that uncover factors of variation in data remains an ongoing key challenge in representation learning. We investigate learning group-disentangled representations for groups of…

Machine Learning · Computer Science 2021-10-26 Linh Tran , Amir Hosein Khasahmadi , Aditya Sanghi , Saeid Asgari

In disentangled representation learning, the goal is to achieve a compact representation that consists of all interpretable generative factors in the observational data. Learning disentangled representations for graphs becomes increasingly…

Machine Learning · Computer Science 2023-11-20 Jingyun Feng , Lin Zhang , Lili Yang

One major challenge of disentanglement learning with variational autoencoders is the trade-off between disentanglement and reconstruction fidelity. Previous studies, which increase the information bottleneck during training, tend to lose…

Machine Learning · Computer Science 2023-10-05 Jiantao Wu , Shentong Mo , Xiang Yang , Muhammad Awais , Sara Atito , Xingshen Zhang , Lin Wang , Xiang Yang