English
Related papers

Related papers: Symbolic Disentangled Representations for Images

200 papers

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for this task: 1) lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Hsin-Ying Lee , Hung-Yu Tseng , Qi Mao , Jia-Bin Huang , Yu-Ding Lu , Maneesh Singh , Ming-Hsuan Yang

Representation disentanglement aims at learning interpretable features, so that the output can be recovered or manipulated accordingly. While existing works like infoGAN and AC-GAN exist, they choose to derive disjoint attribute code for…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Shang-Fu Chen , Jia-Wei Yan , Ya-Fan Su , Yu-Chiang Frank Wang

Variational Autoencoders(VAEs) have already achieved great results on image generation and recently made promising progress on music generation. However, the generation process is still quite difficult to control in the sense that the…

Sound · Computer Science 2019-04-19 Ruihan Yang , Tianyao Chen , Yiyi Zhang , Gus Xia

This paper explains a neural network for image generation from a new perspective, i.e., explaining representation structures for image generation. We propose a set of desirable properties to define the representation structure of a neural…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zhengting Chen , Lei Cheng , Lianghui Ding , Liang Lin , Quanshi Zhang

Effective speech representations for spoken language models must balance semantic relevance with acoustic fidelity for high-quality reconstruction. However, existing approaches struggle to achieve both simultaneously. To address this, we…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Amir Hussein , Sameer Khurana , Gordon Wichern , Francois G. Germain , Jonathan Le Roux

Visual data can be understood at different levels of granularity, where global features correspond to semantic-level information and local features correspond to texture patterns. In this work, we propose a framework, called SPLIT, which…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Rujikorn Charakorn , Yuttapong Thawornwattana , Sirawaj Itthipuripat , Nick Pawlowski , Poramate Manoonpong , Nat Dilokthanakul

A crucial problem in learning disentangled image representations is controlling the degree of disentanglement during image editing, while preserving the identity of objects. In this work, we propose a simple yet effective model with the…

Machine Learning · Computer Science 2019-12-30 Zengjie Song , Oluwasanmi Koyejo , Jiangshe Zhang

Representation learning focused on disentangling the underlying factors of variation in given data has become an important area of research in machine learning. However, most of the studies in this area have relied on datasets from the…

Machine Learning · Computer Science 2020-07-31 Ashis Pati , Siddharth Gururani , Alexander Lerch

Mechanistic interpretability aims to understand how models store representations by breaking down neural networks into interpretable units. However, the occurrence of polysemantic neurons, or neurons that respond to multiple unrelated…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Laura O'Mahony , Vincent Andrearczyk , Henning Muller , Mara Graziani

Automated discovery of early visual concepts from raw image data is a major open challenge in AI research. Addressing this problem, we propose an unsupervised approach for learning disentangled representations of the underlying factors of…

Deep-embedding methods aim to discover representations of a domain that make explicit the domain's class structure and thereby support few-shot learning. Disentangling methods aim to make explicit compositional or factorial structure. We…

Machine Learning · Computer Science 2018-05-22 Karl Ridgeway , Michael C. Mozer

To evaluate disentangled representations several metrics have been proposed. However, theoretical guarantees for conventional metrics of disentanglement are missing. Moreover, conventional metrics do not have a consistent correlation with…

Machine Learning · Computer Science 2021-03-25 Anna Sepliarskaia , Julia Kiseleva , Maarten de Rijke

Recent years have seen growing interest in learning disentangled representations, in which distinct features, such as size or shape, are represented by distinct neurons. Quantifying the extent to which a given representation is disentangled…

Machine Learning · Computer Science 2023-04-06 Louis Mahon , Lei Shah , Thomas Lukasiewicz

The key idea behind the unsupervised learning of disentangled representations is that real-world data is generated by a few explanatory factors of variation which can be recovered by unsupervised learning algorithms. In this paper, we…

Machine Learning · Computer Science 2019-06-19 Francesco Locatello , Stefan Bauer , Mario Lucic , Gunnar Rätsch , Sylvain Gelly , Bernhard Schölkopf , Olivier Bachem

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for many applications: 1) the lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Hsin-Ying Lee , Hung-Yu Tseng , Jia-Bin Huang , Maneesh Kumar Singh , Ming-Hsuan Yang

We investigate the task of retrieving information from compositional distributed representations formed by Hyperdimensional Computing/Vector Symbolic Architectures and present novel techniques which achieve new information rate bounds.…

Neural and Evolutionary Computing · Computer Science 2023-05-29 Denis Kleyko , Connor Bybee , Ping-Chen Huang , Christopher J. Kymn , Bruno A. Olshausen , E. Paxon Frady , Friedrich T. Sommer

Item representations in recommendation systems are expected to reveal the properties of items. Collaborative recommender methods usually represent an item as one single latent vector. Nowadays the e-commercial platforms provide various…

Information Retrieval · Computer Science 2021-04-02 Zeyu Cui , Feng Yu , Shu Wu , Qiang Liu , Liang Wang

We consider the novel task of learning disentangled representations of object shape and appearance across multiple domains (e.g., dogs and cars). The goal is to learn a generative model that learns an intermediate distribution, which…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Utkarsh Ojha , Krishna Kumar Singh , Yong Jae Lee

Learning rich representation from data is an important task for deep generative models such as variational auto-encoder (VAE). However, by extracting high-level abstractions in the bottom-up inference process, the goal of preserving all…

Machine Learning · Computer Science 2020-02-26 Zhiyuan Li , Jaideep Vitthal Murkute , Prashnna Kumar Gyawali , Linwei Wang

Deep generative models allow for photorealistic image synthesis at high resolutions. But for many applications, this is not enough: content creation also needs to be controllable. While several recent works investigate how to disentangle…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Michael Niemeyer , Andreas Geiger