English
Related papers

Related papers: Object-centric architectures enable efficient caus…

200 papers

Biased attributes, spuriously correlated with target labels in a dataset, can problematically lead to neural networks that learn improper shortcuts for classifications and limit their capabilities for out-of-distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jinyung Hong , Eun Som Jeon , Changhoon Kim , Keun Hee Park , Utkarsh Nath , Yezhou Yang , Pavan Turaga , Theodore P. Pavlic

Causal representation learning seeks to uncover causal relationships among high-level latent variables from low-level, entangled, and noisy observations. Existing approaches often either rely on deep neural networks, which lack…

Methodology · Statistics 2026-03-27 Wenjin Zhang , Yixin Wang , Yuqi Gu

The process of generating data such as images is controlled by independent and unknown factors of variation. The retrieval of these variables has been studied extensively in the disentanglement, causal representation learning, and…

Machine Learning · Computer Science 2023-09-26 Gaël Gendron , Michael Witbrock , Gillian Dobbie

Object-centric learning (OCL) aspires general and compositional understanding of scenes by representing a scene as a collection of object-centric representations. OCL has also been extended to multi-view image and video datasets to apply…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Jinwoo Kim , Janghyuk Choi , Ho-Jin Choi , Seon Joo Kim

When perceiving the world from multiple viewpoints, humans have the ability to reason about the complete objects in a compositional manner even when an object is completely occluded from certain viewpoints. Meanwhile, humans are able to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Chengmin Gao , Bin Li

Object-centric representations have recently enabled significant progress in tackling relational reasoning tasks. By building a strong object-centric inductive bias into neural architectures, recent efforts have improved generalization and…

Machine Learning · Computer Science 2021-04-20 Wenling Shang , Lasse Espeholt , Anton Raichuk , Tim Salimans

We describe a method to train a generative model with latent factors that are (approximately) independent and localized. This means that perturbing the latent variables affects only local regions of the synthesized image, corresponding to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yanchao Yang , Yutong Chen , Stefano Soatto

Causal disentanglement seeks a representation of data involving latent variables that relate to one another via a causal model. A representation is identifiable if both the latent model and the transformation from latent to observed…

Machine Learning · Statistics 2023-06-13 Chandler Squires , Anna Seigal , Salil Bhate , Caroline Uhler

We introduce a conditional generative model for learning to disentangle the hidden factors of variation within a set of labeled observations, and separate them into complementary codes. One code summarizes the specified factors of variation…

Machine Learning · Computer Science 2016-11-11 Michael Mathieu , Junbo Zhao , Pablo Sprechmann , Aditya Ramesh , Yann LeCun

Generative models that learn disentangled representations for different factors of variation in an image can be very useful for targeted data augmentation. By sampling from the disentangled latent subspace of interest, we can efficiently…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Ananya Harsh Jha , Saket Anand , Maneesh Singh , V. S. R. Veeravasarapu

Representation learners that disentangle factors of variation have already proven to be important in addressing various real world concerns such as fairness and interpretability. Initially consisting of unsupervised models with independence…

Machine Learning · Computer Science 2021-12-13 Abbavaram Gowtham Reddy , Benin Godfrey L , Vineeth N Balasubramanian

Large intra-class variation is the result of changes in multiple object characteristics. Images, however, only show the superposition of different variable factors such as appearance or shape. Therefore, learning to disentangle and…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Dominik Lorenz , Leonard Bereska , Timo Milbich , Björn Ommer

We propose a probabilistic generative model for unsupervised learning of structured, interpretable, object-based representations of visual scenes. We use amortized variational inference to train the generative model end-to-end. The learned…

Machine Learning · Computer Science 2019-09-30 Andrea Dittadi , Ole Winther

Compositional representations are thought to enable humans to generalize across combinatorially vast state spaces. Models with learnable object slots, which encode information about objects in separate latent codes, have shown promise for…

Machine Learning · Computer Science 2024-10-08 Tankred Saanum , Luca M. Schulze Buschoff , Peter Dayan , Eric Schulz

Intelligent perception and interaction with the world hinges on internal representations that capture its underlying structure (''disentangled'' or ''abstract'' representations). Disentangled representations serve as world models, isolating…

Machine Learning · Computer Science 2025-03-04 Pantelis Vafidis , Aman Bhargava , Antonio Rangel

Causal representation learning aims at identifying high-level causal variables from perceptual data. Most methods assume that all latent causal variables are captured in the high-dimensional observations. We instead consider a partially…

Latent traversal is a popular approach to visualize the disentangled latent representations. Given a bunch of variations in a single unit of the latent representation, it is expected that there is a change in a single factor of variation of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Xinqi Zhu , Chang Xu , Dacheng Tao

Existing methods for multi-modal time series representation learning aim to disentangle the modality-shared and modality-specific latent variables. Although achieving notable performances on downstream tasks, they usually assume an…

Machine Learning · Computer Science 2024-05-28 Ruichu Cai , Zhifang Jiang , Zijian Li , Weilin Chen , Xuexin Chen , Zhifeng Hao , Yifan Shen , Guangyi Chen , Kun Zhang

Causal representation learning aims to unveil latent high-level causal representations from observed low-level data. One of its primary tasks is to provide reliable assurance of identifying these latent causal models, known as…

Machine Learning · Computer Science 2024-12-02 Yuhang Liu , Zhen Zhang , Dong Gong , Mingming Gong , Biwei Huang , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

The goal of object-centric representation learning is to decompose visual scenes into a structured representation that isolates the entities. Recent successes have shown that object-centric representation learning can be scaled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Aniket Didolkar , Andrii Zadaianchuk , Anirudh Goyal , Mike Mozer , Yoshua Bengio , Georg Martius , Maximilian Seitzer