English
Related papers

Related papers: Sequential Representation Learning via Static-Dyna…

200 papers

We propose a learning-based framework for disentangling outdoor scenes into temporally-varying illumination and permanent scene factors. Inspired by the classic intrinsic image decomposition, our learning signal builds upon two insights: 1)…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Andrew Liu , Shiry Ginosar , Tinghui Zhou , Alexei A. Efros , Noah Snavely

Learning meaningful and compact representations with disentangled semantic aspects is considered to be of key importance in representation learning. Since real-world data is notoriously costly to collect, many recent state-of-the-art…

In meta-learning and its downstream tasks, many methods rely on implicit adaptation to task variations, where multiple factors are mixed together in a single entangled representation. This makes it difficult to interpret which factors drive…

Robotics · Computer Science 2025-09-03 Seonsoo Kim , Jun-Gill Kang , Taehong Kim , Seongil Hong

The objective of this paper is to learn representations of speaker identity without access to manually annotated data. To do so, we develop a self-supervised learning objective that exploits the natural cross-modal synchrony between faces…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-05 Arsha Nagrani , Joon Son Chung , Samuel Albanie , Andrew Zisserman

The goal of the unsupervised learning of disentangled representations is to separate the independent explanatory factors of variation in the data without access to supervision. In this paper, we summarize the results of Locatello et al.,…

Machine Learning · Computer Science 2020-07-29 Francesco Locatello , Stefan Bauer , Mario Lucic , Gunnar Rätsch , Sylvain Gelly , Bernhard Schölkopf , Olivier Bachem

The idea behind the \emph{unsupervised} learning of \emph{disentangled} representations is that real-world data is generated by a few explanatory factors of variation which can be recovered by unsupervised learning algorithms. In this…

Machine Learning · Computer Science 2020-10-29 Francesco Locatello , Stefan Bauer , Mario Lucic , Gunnar Rätsch , Sylvain Gelly , Bernhard Schölkopf , Olivier Bachem

Reinforcement Learning (RL) environments can produce training data with spurious correlations between features due to the amount of training data or its limited feature coverage. This can lead to RL agents encoding these misleading…

Machine Learning · Computer Science 2023-10-13 Mhairi Dunion , Trevor McInroe , Kevin Sebastian Luck , Josiah P. Hanna , Stefano V. Albrecht

How can intelligent agents solve a diverse set of tasks in a data-efficient manner? The disentangled representation learning approach posits that such an agent would benefit from separating out (disentangling) the underlying structure of…

Machine Learning · Computer Science 2018-12-07 Irina Higgins , David Amos , David Pfau , Sebastien Racaniere , Loic Matthey , Danilo Rezende , Alexander Lerchner

The challenge of learning disentangled representation has recently attracted much attention and boils down to a competition using a new real world disentanglement dataset (Gondal et al., 2019). Various methods based on variational…

Machine Learning · Computer Science 2019-12-03 Jie Qiao , Zijian Li , Boyan Xu , Ruichu Cai , Kun Zhang

Time-series representation learning is a fundamental task for time-series analysis. While significant progress has been made to achieve accurate representations for downstream applications, the learned representations often lack…

Machine Learning · Computer Science 2021-05-24 Yuening Li , Zhengzhang Chen , Daochen Zha , Mengnan Du , Denghui Zhang , Haifeng Chen , Xia Hu

Disentanglement is at the forefront of unsupervised learning, as disentangled representations of data improve generalization, interpretability, and performance in downstream tasks. Current unsupervised approaches remain inapplicable for…

Machine Learning · Computer Science 2020-10-27 Benjamin Estermann , Markus Marks , Mehmet Fatih Yanik

We introduce a method to disentangle controllable and uncontrollable factors of variation by interacting with the world. Disentanglement leads to good representations and is important when applying deep neural networks (DNNs) in fields…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Yoshihide Sawada

We define and address the problem of unsupervised learning of disentangled representations on data generated from independent factors of variation. We propose FactorVAE, a method that disentangles by encouraging the distribution of…

Machine Learning · Statistics 2019-07-10 Hyunjik Kim , Andriy Mnih

Disentangled representation has been widely explored in many fields due to its maximal compactness, interpretability and versatility. Recommendation system also needs disentanglement to make representation more explainable and general for…

Social and Information Networks · Computer Science 2020-10-27 Weiguang Chen , Wenjun Jiang , Xueqi Li , Kenli Li , Albert Zomaya , Guojun Wang

Sequential modelling of high-dimensional data is an important problem that appears in many domains including model-based reinforcement learning and dynamics identification for control. Latent variable models applied to sequential data…

Machine Learning · Computer Science 2023-01-23 Oliver Limoyo , Trevor Ablett , Jonathan Kelly

Learning disentangled representations is a key step towards effectively discovering and modelling the underlying structure of environments. In the natural sciences, physics has found great success by describing the universe in terms of…

Machine Learning · Computer Science 2020-10-27 Robin Quessard , Thomas D. Barrett , William R. Clements

Training visual reinforcement learning (RL) in practical scenarios presents a significant challenge, $\textit{i.e.,}$ RL agents suffer from low sample efficiency in environments with variations. While various approaches have attempted to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Qi Wang , Zhipeng Zhang , Baao Xie , Xin Jin , Yunbo Wang , Shiyu Wang , Liaomo Zheng , Xiaokang Yang , Wenjun Zeng

Unsupervised disentanglement has been shown to be theoretically impossible without inductive biases on the models and the data. As an alternative approach, recent methods rely on limited supervision to disentangle the factors of variation…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Aviv Gabbay , Niv Cohen , Yedid Hoshen

We propose a novel and general framework to disentangle video data into its dynamic motion and static content components. Our proposed method is a self-supervised pipeline with less assumptions and inductive biases than previous works: it…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Xiao Li , Qi Chen , Xiulian Peng , Kai Yu , Xie Chen , Yan Lu

The aim of latent variable disentanglement is to infer the multiple informative latent representations that lie behind a data generation process and is a key factor in controllable data generation. In this paper, we propose a deep neural…

Sound · Computer Science 2023-09-07 Yiming Wu