中文
相关论文

相关论文: Disentanglement as Identifiable Pushforward Factor…

200 篇论文

Disentangling complex data to its latent factors of variation is a fundamental task in representation learning. Existing work on sequential disentanglement mostly provides two factor representations, i.e., it separates the data to…

机器学习 · 计算机科学 2023-03-31 Nimrod Berman , Ilan Naiman , Omri Azencot

Most existing works on disentangled representation learning are solely built upon an marginal independence assumption: all factors in disentangled representations should be statistically independent. This assumption is necessary but…

机器学习 · 计算机科学 2020-07-02 Xiaojiang Yang , Wendong Bi , Yitong Sun , Yu Cheng , Junchi Yan

Disentangled representations, where the higher level data generative factors are reflected in disjoint latent dimensions, offer several benefits such as ease of deriving invariant representations, transferability to other tasks,…

机器学习 · 计算机科学 2018-12-31 Abhishek Kumar , Prasanna Sattigeri , Avinash Balakrishnan

Self-supervised disentangled representation learning is a critical task in sequence modeling. The learnt representations contribute to better model interpretability as well as the data generation, and improve the sample efficiency for…

机器学习 · 计算机科学 2021-10-26 Junwen Bai , Weiran Wang , Carla Gomes

Disentangling the factors of variation in data is a fundamental concept in machine learning and has been studied in various ways by different researchers, leading to a multitude of definitions. Despite the numerous empirical studies, more…

机器学习 · 计算机科学 2024-05-27 Yivan Zhang , Masashi Sugiyama

Learning disentangled representations of real-world data is a challenging open problem. Most previous methods have focused on either supervised approaches which use attribute labels or unsupervised approaches that manipulate the…

计算与语言 · 计算机科学 2021-01-26 Vikash Balasubramanian , Ivan Kobyzev , Hareesh Bahuleyan , Ilya Shapiro , Olga Vechtomova

This paper explores self-supervised disentangled representation learning within sequential data, focusing on separating time-independent and time-varying factors in videos. We propose a new model that breaks the usual independence…

机器学习 · 计算机科学 2024-08-13 Mathieu Cyrille Simon , Pascal Frossard , Christophe De Vleeschouwer

From the intuitive notion of disentanglement, the image variations corresponding to different factors should be distinct from each other, and the disentangled representation should reflect those variations with separate dimensions. To…

计算机视觉与模式识别 · 计算机科学 2022-02-15 Xuanchi Ren , Tao Yang , Yuwang Wang , Wenjun Zeng

Disentanglement is a highly desirable property of representation due to its similarity with human's understanding and reasoning. This improves interpretability, enables the performance of down-stream tasks, and enables controllable…

机器学习 · 计算机科学 2020-10-24 Jiantao Wu , Lin Wang

Disentanglement aims to recover meaningful latent ground-truth factors from the observed distribution solely, and is formalized through the theory of identifiability. The identifiability of independent latent factors is proven to be…

机器学习 · 计算机科学 2024-03-14 Vitória Barin-Pacela , Kartik Ahuja , Simon Lacoste-Julien , Pascal Vincent

Sensory data are often comprised of independent content and transformation factors. For example, face images may have shapes as content and poses as transformation. To infer separately these factors from given data, various…

机器学习 · 计算机科学 2021-01-26 Haruo Hosoya

This paper proposes a Disentangled gEnerative cAusal Representation (DEAR) learning method under appropriate supervised information. Unlike existing disentanglement methods that enforce independence of the latent variables, we consider the…

机器学习 · 计算机科学 2022-10-04 Xinwei Shen , Furui Liu , Hanze Dong , Qing Lian , Zhitang Chen , Tong Zhang

We present a new supervised learning technique for the Variational AutoEncoder (VAE) that allows it to learn a causally disentangled representation and generate causally disentangled outcomes simultaneously. We call this approach Causally…

机器学习 · 统计学 2023-10-10 Seunghwan An , Kyungwoo Song , Jong-June Jeon

Many real-world datasets can be divided into groups according to certain salient features (e.g. grouping images by subject, grouping text by font, etc.). Often, machine learning tasks require that these features be represented separately…

分布式、并行与集群计算 · 计算机科学 2022-02-16 Dan Andrei Iliescu , Aliaksei Mikhailiuk , Damon Wischik , Rafal Mantiuk

Generative modeling and self-supervised learning have in recent years made great strides towards learning from data in a completely unsupervised way. There is still however an open area of investigation into guiding a neural network to…

机器学习 · 计算机科学 2023-05-17 Vaishnavi Patil , Matthew Evanusa , Joseph JaJa

We present a self-supervised variational autoencoder (VAE) to jointly learn disentangled and dependent hidden factors and then enhance disentangled representation learning by a self-supervised classifier to eliminate coupled representations…

机器学习 · 计算机科学 2023-09-26 Zhangkai Wu , Longbing Cao

Recommendation models are typically trained on observational user interaction data, but the interactions between latent factors in users' decision-making processes lead to complex and entangled data. Disentangling these latent factors to…

信息检索 · 计算机科学 2023-04-18 Siyu Wang , Xiaocong Chen , Quan Z. Sheng , Yihong Zhang , Lina Yao

Disentangled representation learning finds compact, independent and easy-to-interpret factors of the data. Learning such has been shown to require an inductive bias, which we explicitly encode in a generative model of images. Specifically,…

计算机视觉与模式识别 · 计算机科学 2019-11-14 Nicki Skafte Detlefsen , Søren Hauberg

Learning interpretable representations with variational autoencoders (VAEs) is a major goal of representation learning. The main challenge lies in obtaining disentangled representations, where each latent dimension corresponds to a distinct…

In recent years, extending variational autoencoder's framework to learn disentangled representations has received much attention. We address this problem by proposing a framework capable of disentangling class-related and class-independent…

机器学习 · 计算机科学 2021-02-02 Sina Hajimiri , Aryo Lotfi , Mahdieh Soleymani Baghshah