English
Related papers

Related papers: Rethinking Content and Style: Exploring Bias for U…

200 papers

Disentangling complex data to its latent factors of variation is a fundamental task in representation learning. Existing work on sequential disentanglement mostly provides two factor representations, i.e., it separates the data to…

Machine Learning · Computer Science 2023-03-31 Nimrod Berman , Ilan Naiman , Omri Azencot

We propose a novel approach to disentangle the generative factors of variation underlying a given set of observations. Our method builds upon the idea that the (unknown) low-dimensional manifold underlying the data space can be explicitly…

Machine Learning · Computer Science 2021-10-05 Marco Fumero , Luca Cosmo , Simone Melzi , Emanuele Rodolà

Image denoising is a fundamental task in low-level computer vision. While recent deep learning-based image denoising methods have achieved impressive performance, they are black-box models and the underlying denoising principle remains…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Jingwei Niu , Jun Cheng , Shan Tan

Deep image translation methods have recently shown excellent results, outputting high-quality images covering multiple modes of the data distribution. There has also been increased interest in disentangling the internal representations…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Abel Gonzalez-Garcia , Joost van de Weijer , Yoshua Bengio

This paper explores self-supervised disentangled representation learning within sequential data, focusing on separating time-independent and time-varying factors in videos. We propose a new model that breaks the usual independence…

Machine Learning · Computer Science 2024-08-13 Mathieu Cyrille Simon , Pascal Frossard , Christophe De Vleeschouwer

As Diffusion Models have shown promising performance, a lot of efforts have been made to improve the controllability of Diffusion Models. However, how to train Diffusion Models to have the disentangled latent spaces and how to naturally…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Wonwoong Cho , Hareesh Ravi , Midhun Harikumar , Vinh Khuc , Krishna Kumar Singh , Jingwan Lu , David I. Inouye , Ajinkya Kale

Vision-language co-embedding networks, such as CLIP, provide a latent embedding space with semantic information that is useful for downstream tasks. We hypothesize that the embedding space can be disentangled to separate the information on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Zhi Li , Hau Phan , Matthew Emigh , Austin J. Brockmeier

Generative models have been widely studied in computer vision. Recently, diffusion models have drawn substantial attention due to the high quality of their generated images. A key desired property of image generative models is the ability…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Qiucheng Wu , Yujian Liu , Handong Zhao , Ajinkya Kale , Trung Bui , Tong Yu , Zhe Lin , Yang Zhang , Shiyu Chang

Recent text-to-image models produce high-quality images, yet text ambiguity hinders precise control when specific styles or objects are required. There have been a number of recent works dealing with learning and composing multiple objects…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Sonali Godavarthy , Matthias Neuwirth-Trapp , Tim-Felix Faasch , Maarten Bieshaar , Michael Moeller , Danda Pani Paudel

In disentangled representation learning, a model is asked to tease apart a dataset's underlying sources of variation and represent them independently of one another. Since the model is provided with no ground truth information about these…

Machine Learning · Computer Science 2023-10-24 Kyle Hsu , Will Dorrell , James C. R. Whittington , Jiajun Wu , Chelsea Finn

Scene text images contain not only style information (font, background) but also content information (character, texture). Different scene text tasks need different information, but previous representation learning methods use tightly…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Boqiang Zhang , Hongtao Xie , Zuan Gao , Yuxin Wang

Unsupervised image-to-image translation aims to learn the mapping between two visual domains with unpaired samples. Existing works focus on disentangling domain-invariant content code and domain-specific style code individually for…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Yunfei Liu , Haofei Wang , Yang Yue , Feng Lu

To highlight the challenges of achieving representation disentanglement for text domain in an unsupervised setting, in this paper we select a representative set of successfully applied models from the image domain. We evaluate these models…

Computation and Language · Computer Science 2021-06-08 Lan Zhang , Victor Prokhorov , Ehsan Shareghi

Image harmonization aims to achieve visual consistency in composite images by adapting a foreground to make it compatible with a background. However, existing methods always only use the real image as the positive sample to guide the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Yucheng Hang , Bin Xia , Wenming Yang , Qingmin Liao

Image deblurring aims to restore the latent sharp images from the corresponding blurred ones. In this paper, we present an unsupervised method for domain-specific single-image deblurring based on disentangled representations. The…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Boyu Lu , Jun-Cheng Chen , Rama Chellappa

From the intuitive notion of disentanglement, the image variations corresponding to different factors should be distinct from each other, and the disentangled representation should reflect those variations with separate dimensions. To…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Xuanchi Ren , Tao Yang , Yuwang Wang , Wenjun Zeng

Multi-view (or -modality) representation learning aims to understand the relationships between different view representations. Existing methods disentangle multi-view representations into consistent and view-specific representations by…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Guanzhou Ke , Yang Yu , Guoqing Chao , Xiaoli Wang , Chenyang Xu , Shengfeng He

Causal disentanglement has great potential for capturing complex situations. However, there is a lack of practical and efficient approaches. It is already known that most unsupervised disentangling methods are unable to produce identifiable…

Machine Learning · Computer Science 2023-11-14 Heejeong Nam

Recommender systems play important roles in various applications such as e-commerce, social media, etc. Conventional recommendation methods usually model the collaborative signals within the tabular representation space. Despite the…

Information Retrieval · Computer Science 2024-06-05 Kounianhua Du , Jizheng Chen , Jianghao Lin , Yunjia Xi , Hangyu Wang , Xinyi Dai , Bo Chen , Ruiming Tang , Weinan Zhang

In this work we address disentanglement of style and content in speech signals. We propose a fully convolutional variational autoencoder employing two encoders: a content encoder and a style encoder. To foster disentanglement, we propose…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-12 Janek Ebbers , Michael Kuhlmann , Tobias Cord-Landwehr , Reinhold Haeb-Umbach