English
Related papers

Related papers: Unsupervised Disentanglement without Autoencoding:…

200 papers

In representation learning and non-linear dimension reduction, there is a huge interest to learn the 'disentangled' latent variables, where each sub-coordinate almost uniquely controls a facet of the observed data. While many regularization…

Machine Learning · Statistics 2019-09-09 Yue Bai , Leo L. Duan

Learning precise representations of users and items to fit observed interaction data is the fundamental task of collaborative filtering. Existing studies usually infer entangled representations to fit such interaction data, neglecting to…

Information Retrieval · Computer Science 2024-01-11 Zhiqiang Guo , Guohui Li , Jianjun Li , Chaoyang Wang , Si Shi

We propose a method to disentangle linear-encoded facial semantics from StyleGAN without external supervision. The method derives from linear regression and sparse representation learning concepts to make the disentangled latent…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Yutong Zheng , Yu-Kai Huang , Ran Tao , Zhiqiang Shen , Marios Savvides

Representation learning is the foundation for the recent success of neural network models. However, the distributed representations generated by neural networks are far from ideal. Due to their highly entangled nature, they are di cult to…

Machine Learning · Computer Science 2016-02-09 William Whitney

Unsupervised learning enables modeling complex images without the need for annotations. The representation learned by such models can facilitate any subsequent analysis of large image datasets. However, some generative factors that cause…

Image and Video Processing · Electrical Eng. & Systems 2020-08-27 Maxime W. Lafarge , Josien P. W. Pluim , Mitko Veta

Deep Learning based methods have emerged as the indisputable leaders for virtually all image restoration tasks. Especially in the domain of microscopy images, various content-aware image restoration (CARE) approaches are now used to improve…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Mangal Prakash , Alexander Krull , Florian Jug

Given a dataset of images containing different objects with different features such as shape, size, rotation, and x-y position; and a Variational Autoencoder (VAE); creating a disentangled encoding of these features in the hidden space…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Mohammad Haghir Ebrahimabadi

Disentangled representation learning (DRL) aims to identify and decompose underlying factors behind observations, thus facilitating data perception and generation. However, current DRL approaches often rely on the unrealistic assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Baao Xie , Qiuyu Chen , Yunnan Wang , Zequn Zhang , Xin Jin , Wenjun Zeng

We define and address the problem of unsupervised learning of disentangled representations on data generated from independent factors of variation. We propose FactorVAE, a method that disentangles by encouraging the distribution of…

Machine Learning · Statistics 2019-07-10 Hyunjik Kim , Andriy Mnih

Exemplar learning of visual similarities in an unsupervised manner is a problem of paramount importance to Computer Vision. In this context, however, the recent breakthrough in deep learning could not yet unfold its full potential. With…

Computer Vision and Pattern Recognition · Computer Science 2018-02-26 Artsiom Sanakoyeu , Miguel A. Bautista , Björn Ommer

Disentanglement learning is crucial for obtaining disentangled representations and controllable generation. Current disentanglement methods face several inherent limitations: difficulty with high-resolution images, primarily focusing on…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Weili Nie , Tero Karras , Animesh Garg , Shoubhik Debnath , Anjul Patney , Ankit B. Patel , Anima Anandkumar

Traditional supervised learning methods are hitting a bottleneck because of their dependency on expensive manually labeled data and their weaknesses such as limited generalization ability and vulnerability to adversarial attacks. A…

Machine Learning · Computer Science 2021-06-08 Ran Liu

We address the problem of discovering part segmentations of articulated objects without supervision. In contrast to keypoints, part segmentations provide information about part localizations on the level of individual pixels. Capturing both…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Sandro Braun , Patrick Esser , Björn Ommer

Learning disentangled representations is considered a cornerstone problem in representation learning. Recently, Locatello et al. (2019) demonstrated that unsupervised disentanglement learning without inductive biases is theoretically…

Machine Learning · Computer Science 2020-02-17 Francesco Locatello , Michael Tschannen , Stefan Bauer , Gunnar Rätsch , Bernhard Schölkopf , Olivier Bachem

This paper addresses two crucial problems of learning disentangled image representations, namely controlling the degree of disentanglement during image editing, and balancing the disentanglement strength and the reconstruction quality. To…

Machine Learning · Computer Science 2020-06-23 Zengjie Song , Oluwasanmi Koyejo , Jiangshe Zhang

A generative model with a disentangled representation allows for independent control over different aspects of the output. Learning disentangled representations has been a recent topic of great interest, but it remains poorly understood. We…

Machine Learning · Statistics 2019-02-07 Aditya Ramesh , Youngduck Choi , Yann LeCun

Contrastive self-supervised learning has outperformed supervised pretraining on many downstream tasks like segmentation and object detection. However, current methods are still primarily applied to curated datasets like ImageNet. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Luc Van Gool

Modeling trajectories generated by robot joints is complex and required for high level activities like trajectory generation, clustering, and classification. Disentagled representation learning promises advances in unsupervised learning,…

Robotics · Computer Science 2021-12-07 Matias Valdenegro-Toro , Daniel Harnack , Hendrik Wöhrle

$\beta$-VAE is a follow-up technique to variational autoencoders that proposes special weighting of the KL divergence term in the VAE loss to obtain disentangled representations. Unsupervised learning is known to be brittle even on toy…

Machine Learning · Computer Science 2022-01-03 Miroslav Fil , Munib Mesinovic , Matthew Morris , Jonas Wildberger

Representation learning with small labeled data have emerged in many problems, since the success of deep neural networks often relies on the availability of a huge amount of labeled data that is expensive to collect. To address it, many…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Guo-Jun Qi , Jiebo Luo