English
Related papers

Related papers: Linear Disentangled Representations and Unsupervis…

200 papers

Latent variable models such as the Variational Auto-Encoder (VAE) have become a go-to tool for analyzing biological data, especially in the field of single-cell genomics. One remaining challenge is the interpretability of latent variables…

Genomics · Quantitative Biology 2023-02-20 Romain Lopez , Nataša Tagasovska , Stephen Ra , Kyunghyn Cho , Jonathan K. Pritchard , Aviv Regev

Existing zero-shot skeleton-based action recognition methods utilize projection networks to learn a shared latent space of skeleton features and semantic embeddings. The inherent imbalance in action recognition datasets, characterized by…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Sheng-Wei Li , Zi-Xiang Wei , Wei-Jie Chen , Yi-Hsin Yu , Chih-Yuan Yang , Jane Yung-jen Hsu

We present a framework for learning disentangled and interpretable jointly continuous and discrete representations in an unsupervised manner. By augmenting the continuous latent distribution of variational autoencoders with a relaxed…

Machine Learning · Statistics 2018-10-23 Emilien Dupont

This paper presents a novel approach that leverages domain variability to learn representations that are conditionally invariant to unwanted variability or distractors. Our approach identifies both spurious and invariant latent features…

Machine Learning · Computer Science 2023-07-04 Hananeh Aliee , Ferdinand Kapl , Soroor Hediyeh-Zadeh , Fabian J. Theis

Face images are subject to many different factors of variation, especially in unconstrained in-the-wild scenarios. For most tasks involving such images, e.g. expression recognition from video streams, having enough labeled data is…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Marah Halawa , Manuel Wöllhaf , Eduardo Vellasques , Urko Sánchez Sanz , Olaf Hellwich

In this work we explore the generalization characteristics of unsupervised representation learning by leveraging disentangled VAE's to learn a useful latent space on a set of relational reasoning problems derived from Raven Progressive…

Machine Learning · Computer Science 2018-11-13 Xander Steenbrugge , Sam Leroux , Tim Verbelen , Bart Dhoedt

Video recognition models often learn scene-biased action representation due to the spurious correlation between actions and scenes in the training data. Such models show poor performance when the test data consists of videos with unseen…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Kyungho Bae , Geo Ahn , Youngrae Kim , Jinwoo Choi

We develop a generalisation of disentanglement in VAEs---decomposition of the latent representation---characterising it as the fulfilment of two factors: a) the latent encodings of the data having an appropriate level of overlap, and b) the…

Machine Learning · Statistics 2019-06-13 Emile Mathieu , Tom Rainforth , N. Siddharth , Yee Whye Teh

Disentangling factors of variation has become a very challenging problem on representation learning. Existing algorithms suffer from many limitations, such as unpredictable disentangling factors, poor quality of generated images from…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Taihong Xiao , Jiapeng Hong , Jinwen Ma

This paper presents a novel theoretical framework for understanding how diffusion models can learn disentangled representations. Within this framework, we establish identifiability conditions for general disentangled latent variable models,…

Encoding only the task-related information from the raw data, \ie, disentangled representation learning, can greatly contribute to the robustness and generalizability of models. Although significant advances have been made by regularizing…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Zhuohang Dang , Minnan Luo , Chengyou Jia , Guang Dai , Jihong Wang , Xiaojun Chang , Jingdong Wang

Learning disentangled representations leads to interpretable models and facilitates data generation with style transfer, which has been extensively studied on static data such as images in an unsupervised learning framework. However, only a…

Machine Learning · Computer Science 2021-01-20 Jun Han , Martin Renqiang Min , Ligong Han , Li Erran Li , Xuan Zhang

Deep representation learning offers a powerful paradigm for mapping input data onto an organized embedding space and is useful for many music information retrieval tasks. Two central methods for representation learning include deep metric…

Sound · Computer Science 2020-08-14 Jongpil Lee , Nicholas J. Bryan , Justin Salamon , Zeyu Jin , Juhan Nam

Combining Generative Adversarial Networks (GANs) with encoders that learn to encode data points has shown promising results in learning data representations in an unsupervised way. We propose a framework that combines an encoder and a…

Computer Vision and Pattern Recognition · Computer Science 2018-03-08 Tobias Hinz , Stefan Wermter

Disentanglement is at the forefront of unsupervised learning, as disentangled representations of data improve generalization, interpretability, and performance in downstream tasks. Current unsupervised approaches remain inapplicable for…

Machine Learning · Computer Science 2020-10-27 Benjamin Estermann , Markus Marks , Mehmet Fatih Yanik

Recently, generative graph models have shown promising results in learning graph representations through self-supervised methods. However, most existing generative graph representation learning (GRL) approaches rely on random masking across…

Machine Learning · Computer Science 2026-05-08 Xinyue Hu , Zhibin Duan , Xinyang Liu , Yuxin Li , Bo Chen , Chaojie Wang , Yilin He , Hongwei Liu , Mingyuan Zhou

Learning discriminative powerful representations is a crucial step for machine learning systems. Introducing invariance against arbitrary nuisance or sensitive attributes while performing well on specific tasks is an important problem in…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Mhd Hasan Sarhan , Nassir Navab , Abouzar Eslami , Shadi Albarqouni

With the growing interest in the machine learning community to solve real-world problems, it has become crucial to uncover the hidden reasoning behind their decisions by focusing on the fairness and auditing the predictions made by these…

Machine Learning · Computer Science 2021-10-15 Akshita Jha , Bhanukiran Vinzamuri , Chandan K. Reddy

This paper explores self-supervised disentangled representation learning within sequential data, focusing on separating time-independent and time-varying factors in videos. We propose a new model that breaks the usual independence…

Machine Learning · Computer Science 2024-08-13 Mathieu Cyrille Simon , Pascal Frossard , Christophe De Vleeschouwer

Learning a disentangled, interpretable, and structured latent representation in 3D generative models of faces and bodies is still an open problem. The problem is particularly acute when control over identity features is required. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Simone Foti , Bongjin Koo , Danail Stoyanov , Matthew J. Clarkson