English
Related papers

Related papers: Disentangled Representation Learning for Controlla…

200 papers

3D representation and reconstruction of human bodies have been studied for a long time in computer vision. Traditional methods rely mostly on parametric statistical linear models, limiting the space of possible bodies to linear…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Sandro Lombardi , Bangbang Yang , Tianxing Fan , Hujun Bao , Guofeng Zhang , Marc Pollefeys , Zhaopeng Cui

How can intelligent agents solve a diverse set of tasks in a data-efficient manner? The disentangled representation learning approach posits that such an agent would benefit from separating out (disentangling) the underlying structure of…

Machine Learning · Computer Science 2018-12-07 Irina Higgins , David Amos , David Pfau , Sebastien Racaniere , Loic Matthey , Danilo Rezende , Alexander Lerchner

We present a framework for training GANs with explicit control over generated images. We are able to control the generated image by settings exact attributes such as age, pose, expression, etc. Most approaches for editing GAN-generated…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Alon Shoshan , Nadav Bhonker , Igor Kviatkovsky , Gerard Medioni

Disentangled representation has been widely explored in many fields due to its maximal compactness, interpretability and versatility. Recommendation system also needs disentanglement to make representation more explainable and general for…

Social and Information Networks · Computer Science 2020-10-27 Weiguang Chen , Wenjun Jiang , Xueqi Li , Kenli Li , Albert Zomaya , Guojun Wang

We propose a method to disentangle linear-encoded facial semantics from StyleGAN without external supervision. The method derives from linear regression and sparse representation learning concepts to make the disentangled latent…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Yutong Zheng , Yu-Kai Huang , Ran Tao , Zhiqiang Shen , Marios Savvides

From the intuitive notion of disentanglement, the image variations corresponding to different factors should be distinct from each other, and the disentangled representation should reflect those variations with separate dimensions. To…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Xuanchi Ren , Tao Yang , Yuwang Wang , Wenjun Zeng

We present a deformable generator model to disentangle the appearance and geometric information for both image and video data in a purely unsupervised manner. The appearance generator network models the information related to appearance,…

Machine Learning · Computer Science 2023-10-09 Xianglei Xing , Ruiqi Gao , Tian Han , Song-Chun Zhu , Ying Nian Wu

In this work, we propose a disentangled latent optimization-based method for parameterizing grouped deforming 3D objects into shape and deformation factors in an unsupervised manner. Our approach involves the joint optimization of a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Mostofa Rafid Uddin , Jana Armouti , Umong Sain , Md Asib Rahman , Xingjian Li , Min Xu

We study the problem of learning disentangled representations for data across multiple domains and its applications in human retargeting. Our goal is to map an input image to an identity-invariant latent representation that captures…

Computer Vision and Pattern Recognition · Computer Science 2019-12-16 Chao Yang , Xiaofeng Liu , Qingming Tang , C. -C. Jay Kuo

Learning disentangled representations of natural language is essential for many NLP tasks, e.g., conditional text generation, style transfer, personalized dialogue systems, etc. Similar problems have been studied extensively for other forms…

Machine Learning · Computer Science 2022-01-13 Pengyu Cheng , Martin Renqiang Min , Dinghan Shen , Christopher Malon , Yizhe Zhang , Yitong Li , Lawrence Carin

To learn disentangled representations of facial images, we present a Dual Encoder-Decoder based Generative Adversarial Network (DED-GAN). In the proposed method, both the generator and discriminator are designed with deep encoder-decoder…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Cong Hu , Zhen-Hua Feng , Xiao-Jun Wu , Josef Kittler

In this work we introduce Deforming Autoencoders, a generative model for images that disentangles shape from appearance in an unsupervised manner. As in the deformable template paradigm, shape is represented as a deformation between a…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Zhixin Shu , Mihir Sahasrabudhe , Alp Guler , Dimitris Samaras , Nikos Paragios , Iasonas Kokkinos

It is extremely challenging to create an animatable clothed human avatar from RGB videos, especially for loose clothes due to the difficulties in motion modeling. To address this problem, we introduce a novel representation on the basis of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zerong Zheng , Han Huang , Tao Yu , Hongwen Zhang , Yandong Guo , Yebin Liu

We introduce a convolutional neural network for inferring a compact disentangled graphical description of objects from 2D images that can be used for volumetric reconstruction. The network comprises an encoder and a twin-tailed decoder. The…

Computer Vision and Pattern Recognition · Computer Science 2016-10-13 Edward Grant , Pushmeet Kohli , Marcel van Gerven

Scalable 6D pose estimation for rigid objects from RGB images aims at handling multiple objects and generalizing to novel objects. Building on a well-known auto-encoding framework to cope with object symmetry and the lack of labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Yilin Wen , Xiangyu Li , Hao Pan , Lei Yang , Zheng Wang , Taku Komura , Wenping Wang

State-of-the-art methods in generative representation learning yield semantic disentanglement, but typically do not consider physical scene parameters, such as geometry, albedo, lighting, or camera. We posit that inverse rendering, a way to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Tzofi Klinghoffer , Kushagra Tiwary , Arkadiusz Balata , Vivek Sharma , Ramesh Raskar

This study builds on the architecture of the Disentangler of Visual Priors (DVP), a type of autoencoder that learns to interpret scenes by decomposing the perceived objects into independent visual aspects of shape, size, orientation, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Antoni Nowinowski , Krzysztof Krawiec

In recent years, the role of image generative models in facial reenactment has been steadily increasing. Such models are usually subject-agnostic and trained on domain-wide datasets. The appearance of the reenacted individual is learned…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Ariel Elazary , Yotam Nitzan , Daniel Cohen-Or

Human pose transfer synthesizes new view(s) of a person for a given pose. Recent work achieves this via self-reconstruction, which disentangles a person's pose and texture information by breaking the person down into parts, then recombines…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Nannan Li , Kevin J. Shih , Bryan A. Plummer

Although Generative Adversarial Networks (GANs) have made significant progress in face synthesis, there lacks enough understanding of what GANs have learned in the latent representation to map a random code to a photo-realistic image. In…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Yujun Shen , Ceyuan Yang , Xiaoou Tang , Bolei Zhou