English
Related papers

Related papers: Disentangling Factors of Variation with Cycle-Cons…

200 papers

Learning disentangled causal representations is a challenging problem that has gained significant attention recently due to its implications for extracting meaningful information for downstream tasks. In this work, we define a new notion of…

Machine Learning · Computer Science 2024-08-27 Aneesh Komanduri , Yongkai Wu , Feng Chen , Xintao Wu

Learning disentangled representations of real-world data is a challenging open problem. Most previous methods have focused on either supervised approaches which use attribute labels or unsupervised approaches that manipulate the…

Computation and Language · Computer Science 2021-01-26 Vikash Balasubramanian , Ivan Kobyzev , Hareesh Bahuleyan , Ilya Shapiro , Olga Vechtomova

A crucial problem in learning disentangled image representations is controlling the degree of disentanglement during image editing, while preserving the identity of objects. In this work, we propose a simple yet effective model with the…

Machine Learning · Computer Science 2019-12-30 Zengjie Song , Oluwasanmi Koyejo , Jiangshe Zhang

We investigate the problem of learning representations that are invariant to certain nuisance or sensitive factors of variation in the data while retaining as much of the remaining information as possible. Our model is based on a…

Machine Learning · Statistics 2017-08-11 Christos Louizos , Kevin Swersky , Yujia Li , Max Welling , Richard Zemel

Recent developments in biosignal processing have enabled users to exploit their physiological status for manipulating devices in a reliable and safe manner. One major challenge of physiological sensing lies in the variability of biosignals…

Machine Learning · Computer Science 2020-10-28 Mo Han , Ozan Ozdenizci , Ye Wang , Toshiaki Koike-Akino , Deniz Erdogmus

The advancements in disentangled representation learning significantly enhance the accuracy of counterfactual predictions by granting precise control over instrumental variables, confounders, and adjustable variables. An appealing method…

Machine Learning · Computer Science 2024-06-17 Xinshu Li , Mingming Gong , Lina Yao

We deal with the problem of learning the underlying disentangled latent factors that are shared between the paired bi-modal data in cross-modal retrieval. Our assumption is that the data in both modalities are complex, structured, and high…

Machine Learning · Computer Science 2020-12-02 Minyoung Kim , Ricardo Guerrero , Vladimir Pavlovic

We construct an unsupervised learning model that achieves nonlinear disentanglement of underlying factors of variation in naturalistic videos. Previous work suggests that representations can be disentangled if all but a few factors in the…

This paper addresses two crucial problems of learning disentangled image representations, namely controlling the degree of disentanglement during image editing, and balancing the disentanglement strength and the reconstruction quality. To…

Machine Learning · Computer Science 2020-06-23 Zengjie Song , Oluwasanmi Koyejo , Jiangshe Zhang

The focus of disentanglement approaches has been on identifying independent factors of variation in data. However, the causal variables underlying real-world observations are often not statistically independent. In this work, we bridge the…

We combine conditional variational autoencoders (VAE) with adversarial censoring in order to learn invariant representations that are disentangled from nuisance/sensitive variations. In this method, an adversarial network attempts to…

Machine Learning · Computer Science 2018-05-22 Ye Wang , Toshiaki Koike-Akino , Deniz Erdogmus

How can intelligent agents solve a diverse set of tasks in a data-efficient manner? The disentangled representation learning approach posits that such an agent would benefit from separating out (disentangling) the underlying structure of…

Machine Learning · Computer Science 2018-12-07 Irina Higgins , David Amos , David Pfau , Sebastien Racaniere , Loic Matthey , Danilo Rezende , Alexander Lerchner

Learning disentangled representations of data is a fundamental problem in artificial intelligence. Specifically, disentangled latent representations allow generative models to control and compose the disentangled factors in the synthesis…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Yotam Nitzan , Amit Bermano , Yangyan Li , Daniel Cohen-Or

Given the three dimensional complexity of a video signal, training a robust and diverse GAN based video generative model is onerous due to large stochasticity involved in data space. Learning disentangled representations of the data help to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Sai Hemanth Kasaraneni

Reinforcement Learning (RL) environments can produce training data with spurious correlations between features due to the amount of training data or its limited feature coverage. This can lead to RL agents encoding these misleading…

Machine Learning · Computer Science 2023-10-13 Mhairi Dunion , Trevor McInroe , Kevin Sebastian Luck , Josiah P. Hanna , Stefano V. Albrecht

We present new intuitions and theoretical assessments of the emergence of disentangled representation in variational autoencoders. Taking a rate-distortion theory perspective, we show the circumstances under which representations aligned…

The challenge of learning disentangled representation has recently attracted much attention and boils down to a competition using a new real world disentanglement dataset (Gondal et al., 2019). Various methods based on variational…

Machine Learning · Computer Science 2019-12-03 Jie Qiao , Zijian Li , Boyan Xu , Ruichu Cai , Kun Zhang

Recently there has been a significant interest in learning disentangled representations, as they promise increased interpretability, generalization to unseen scenarios and faster learning on downstream tasks. In this paper, we investigate…

Machine Learning · Computer Science 2019-10-30 Francesco Locatello , Gabriele Abbati , Tom Rainforth , Stefan Bauer , Bernhard Schölkopf , Olivier Bachem

We propose an algorithm, guided variational autoencoder (Guided-VAE), that is able to learn a controllable generative model by performing latent representation disentanglement learning. The learning objective is achieved by providing…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Zheng Ding , Yifan Xu , Weijian Xu , Gaurav Parmar , Yang Yang , Max Welling , Zhuowen Tu

Correlations between factors of variation are prevalent in real-world data. Exploiting such correlations may increase predictive performance on noisy data; however, often correlations are not robust (e.g., they may change between domains,…

Machine Learning · Computer Science 2022-12-26 Christina M. Funke , Paul Vicol , Kuan-Chieh Wang , Matthias Kümmerer , Richard Zemel , Matthias Bethge