English
Related papers

Related papers: Scaling-up Disentanglement for Image Translation

200 papers

Multimodal representation learning seeks to relate and decompose information inherent in multiple modalities. By disentangling modality-specific information from information that is shared across modalities, we can improve interpretability…

Machine Learning · Computer Science 2025-03-18 Chenyu Wang , Sharut Gupta , Xinyi Zhang , Sana Tonekaboni , Stefanie Jegelka , Tommi Jaakkola , Caroline Uhler

One of the biggest challenges for deep learning algorithms in medical image analysis is the indiscriminate mixing of image properties, e.g. artifacts and anatomy. These entangled image properties lead to a semantically redundant feature…

Machine Learning · Computer Science 2019-08-22 Qingjie Meng , Nick Pawlowski , Daniel Rueckert , Bernhard Kainz

Reinforcement Learning (RL) agents are often unable to generalise well to environment variations in the state space that were not observed during training. This issue is especially problematic for image-based RL, where a change in just one…

Machine Learning · Computer Science 2023-02-28 Mhairi Dunion , Trevor McInroe , Kevin Sebastian Luck , Josiah P. Hanna , Stefano V. Albrecht

Recently there has been a significant interest in learning disentangled representations, as they promise increased interpretability, generalization to unseen scenarios and faster learning on downstream tasks. In this paper, we investigate…

Machine Learning · Computer Science 2019-10-30 Francesco Locatello , Gabriele Abbati , Tom Rainforth , Stefan Bauer , Bernhard Schölkopf , Olivier Bachem

For visual manipulation tasks, we aim to represent image content with semantically meaningful features. However, learning implicit representations from images often lacks interpretability, especially when attributes are intertwined. We…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Xue Hu , Xinghui Li , Benjamin Busam , Yiren Zhou , Ales Leonardis , Shanxin Yuan

Learning meaningful representations that disentangle the underlying structure of the data generating process is considered to be of key importance in machine learning. While disentangled representations were found to be useful for diverse…

Domain adaptation aims to mitigate the domain gap when transferring knowledge from an existing labeled domain to a new domain. However, existing disentanglement-based methods do not fully consider separation between domain-invariant and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Youshan Zhang , Brian D. Davison

This paper introduces a novel framework named D-LORD (Double Latent Optimization for Representation Disentanglement), which is designed for motion stylization (motion style transfer and motion retargeting). The primary objective of this…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Meenakshi Gupta , Mingyuan Lei , Tat-Jen Cham , Hwee Kuan Lee

Training visual reinforcement learning (RL) in practical scenarios presents a significant challenge, $\textit{i.e.,}$ RL agents suffer from low sample efficiency in environments with variations. While various approaches have attempted to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Qi Wang , Zhipeng Zhang , Baao Xie , Xin Jin , Yunbo Wang , Shiyu Wang , Liaomo Zheng , Xiaokang Yang , Wenjun Zeng

Learning to disentangle the hidden factors of variations within a set of observations is a key task for artificial intelligence. We present a unified formulation for class and content disentanglement and use it to illustrate the limitations…

Machine Learning · Computer Science 2020-02-19 Aviv Gabbay , Yedid Hoshen

Multi-view (or -modality) representation learning aims to understand the relationships between different view representations. Existing methods disentangle multi-view representations into consistent and view-specific representations by…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Guanzhou Ke , Yang Yu , Guoqing Chao , Xiaoli Wang , Chenyang Xu , Shengfeng He

Image-to-image translation aims to learn a mapping between different groups of visually distinguishable images. While recent methods have shown impressive ability to change even intricate appearance of images, they still rely on domain…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Hanbit Lee , Jinseok Seol , Sang-goo Lee

Recent studies have shown how disentangling images into content and feature spaces can provide controllable image translation/ manipulation. In this paper, we propose a framework to enable utilizing discrete multi-labels to control which…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Guanqi Zhan , Yihao Zhao , Bingchan Zhao , Haoqi Yuan , Baoquan Chen , Hao Dong

Deep learning models trained on audio-visual data have been successfully used to achieve state-of-the-art performance for emotion recognition. In particular, models trained with multitask learning have shown additional performance…

Image and Video Processing · Electrical Eng. & Systems 2021-02-15 Raghuveer Peri , Srinivas Parthasarathy , Charles Bradshaw , Shiva Sundaram

The problem of feature disentanglement has been explored in the literature, for the purpose of image and video processing and text analysis. State-of-the-art methods for disentangling feature representations rely on the presence of many…

Machine Learning · Computer Science 2017-11-28 Ershad Banijamali , Amir-Hossein Karimi , Alexander Wong , Ali Ghodsi

In this paper, we present DRANet, a network architecture that disentangles image representations and transfers the visual attributes in a latent space for unsupervised cross-domain adaptation. Unlike the existing domain adaptation methods…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Seunghun Lee , Sunghyun Cho , Sunghoon Im

Intelligent agents should be able to learn useful representations by observing changes in their environment. We model such observations as pairs of non-i.i.d. images sharing at least one of the underlying factors of variation. First, we…

Machine Learning · Computer Science 2020-10-21 Francesco Locatello , Ben Poole , Gunnar Rätsch , Bernhard Schölkopf , Olivier Bachem , Michael Tschannen

Disentangled Representation Learning aims to improve the explainability of deep learning methods by training a data encoder that identifies semantically meaningful latent variables in the data generation process. Nevertheless, there is no…

Machine Learning · Computer Science 2024-10-08 Ruoyu Wang , Lina Yao

We propose an approach to learn image representations that consist of disentangled factors of variation without exploiting any manual labeling or data domain knowledge. A factor of variation corresponds to an image attribute that can be…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Qiyang Hu , Attila Szabó , Tiziano Portenier , Matthias Zwicker , Paolo Favaro

Disentangled representation is a powerful technique to tackle domain shift problem in medical image analysis in unsupervised domain adaptation setting.However, previous methods only focus on exacting domain-invariant feature and ignore…

Image and Video Processing · Electrical Eng. & Systems 2023-03-07 Shuai Wang , Rui Li