English
Related papers

Related papers: Towards a Definition of Disentangled Representatio…

200 papers

For visual manipulation tasks, we aim to represent image content with semantically meaningful features. However, learning implicit representations from images often lacks interpretability, especially when attributes are intertwined. We…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Xue Hu , Xinghui Li , Benjamin Busam , Yiren Zhou , Ales Leonardis , Shanxin Yuan

Disentangled representation learning in speech processing has lagged behind other domains, largely due to the lack of datasets with annotated generative factors for robust evaluation. To address this, we propose SynSpeech, a novel…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Yusuf Brima , Ulf Krumnack , Simone Pika , Gunther Heidemann

Deep latent-variable models learn representations of high-dimensional data in an unsupervised manner. A number of recent efforts have focused on learning representations that disentangle statistically independent axes of variation by…

Learning disentangled representations is regarded as a fundamental task for improving the generalization, robustness, and interpretability of generative models. However, measuring disentanglement has been challenging and inconsistent, often…

Machine Learning · Statistics 2021-03-19 Sharon Zhou , Eric Zelikman , Fred Lu , Andrew Y. Ng , Gunnar Carlsson , Stefano Ermon

Face anti-spoofing is crucial to security of face recognition systems. Previous approaches focus on developing discriminative models based on the features extracted from images, which may be still entangled between spoof patterns and real…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Ke-Yue Zhang , Taiping Yao , Jian Zhang , Ying Tai , Shouhong Ding , Jilin Li , Feiyue Huang , Haichuan Song , Lizhuang Ma

As 3D human pose estimation can now be achieved with very high accuracy in the supervised learning scenario, tackling the case where 3D pose annotations are not available has received increasing attention. In particular, several methods…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Krishna Kanth Nakka , Mathieu Salzmann

In this paper, we propose a framework for disentangling the appearance and geometry representations in the face recognition task. To provide supervision for this aim, we generate geometrically identical faces by incorporating spatial…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Ali Dabouei , Fariborz Taherkhani , Sobhan Soleymani , Jeremy Dawson , Nasser M. Nasrabadi

The idea behind the \emph{unsupervised} learning of \emph{disentangled} representations is that real-world data is generated by a few explanatory factors of variation which can be recovered by unsupervised learning algorithms. In this…

Machine Learning · Computer Science 2020-10-29 Francesco Locatello , Stefan Bauer , Mario Lucic , Gunnar Rätsch , Sylvain Gelly , Bernhard Schölkopf , Olivier Bachem

Time-series representation learning is a fundamental task for time-series analysis. While significant progress has been made to achieve accurate representations for downstream applications, the learned representations often lack…

Machine Learning · Computer Science 2021-05-24 Yuening Li , Zhengzhang Chen , Daochen Zha , Mengnan Du , Denghui Zhang , Haifeng Chen , Xia Hu

Learning disentangled representations from visual data, where different high-level generative factors are independently encoded, is of importance for many computer vision tasks. Solving this problem, however, typically requires to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Adria Ruiz , Oriol Martinez , Xavier Binefa , Jakob Verbeek

Disentangled representation learning (DRL) aims to break down observed data into core intrinsic factors for a profound understanding of the data. In real-world scenarios, manually defining and labeling these factors are non-trivial, making…

Machine Learning · Computer Science 2024-11-01 Youngjun Jun , Jiwoo Park , Kyobin Choo , Tae Eun Choi , Seong Jae Hwang

This paper explores self-supervised disentangled representation learning within sequential data, focusing on separating time-independent and time-varying factors in videos. We propose a new model that breaks the usual independence…

Machine Learning · Computer Science 2024-08-13 Mathieu Cyrille Simon , Pascal Frossard , Christophe De Vleeschouwer

Learning visual representations with interpretable features, i.e., disentangled representations, remains a challenging problem. Existing methods demonstrate some success but are hard to apply to large-scale vision datasets like ImageNet. In…

Machine Learning · Computer Science 2023-06-01 Lilian Ngweta , Subha Maity , Alex Gittens , Yuekai Sun , Mikhail Yurochkin

This paper presents a novel theoretical framework for understanding how diffusion models can learn disentangled representations. Within this framework, we establish identifiability conditions for general disentangled latent variable models,…

The study of representations is of fundamental importance to any form of communication, and our ability to exploit them effectively is paramount. This article presents a novel theory -- Representational Systems Theory -- that is designed to…

Artificial Intelligence · Computer Science 2022-06-08 Daniel Raggi , Gem Stapleton , Mateja Jamnik , Aaron Stockdill , Grecia Garcia Garcia , Peter C-H. Cheng

Recent approaches in music generation rely on disentangled representations, often labeled as structure and timbre or local and global, to enable controllable synthesis. Yet the underlying properties of these embeddings remain underexplored.…

One of the main arguments behind studying disentangled representations is the assumption that they can be easily reused in different tasks. At the same time finding a joint, adaptable representation of data is one of the key challenges in…

Machine Learning · Computer Science 2021-10-08 Łukasz Maziarka , Aleksandra Nowak , Maciej Wołczyk , Andrzej Bedychaj

The paper proposes a novel technique for representing templates and instances of concept classes. A template representation refers to the generic representation that captures the characteristics of an entire class. The proposed technique…

Machine Learning · Computer Science 2020-07-08 Graham Spinks , Marie-Francine Moens

Disentangled representation learning finds compact, independent and easy-to-interpret factors of the data. Learning such has been shown to require an inductive bias, which we explicitly encode in a generative model of images. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Nicki Skafte Detlefsen , Søren Hauberg

Learning rich representation from data is an important task for deep generative models such as variational auto-encoder (VAE). However, by extracting high-level abstractions in the bottom-up inference process, the goal of preserving all…

Machine Learning · Computer Science 2020-02-26 Zhiyuan Li , Jaideep Vitthal Murkute , Prashnna Kumar Gyawali , Linwei Wang