English
Related papers

Related papers: Interpreting Equivariant Representations

200 papers

Deep directed generative models have attracted much attention recently due to their expressive representation power and the ability of ancestral sampling. One major difficulty of learning directed models with many latent variables is the…

Machine Learning · Computer Science 2015-06-16 Siqi Nie , Qiang Ji

Learning representations that capture the underlying data generating process is a key problem for data efficient and robust use of neural networks. One key property for robustness which the learned representation should capture and which…

Machine Learning · Computer Science 2022-06-24 Mathieu Chevalley , Charlotte Bunne , Andreas Krause , Stefan Bauer

Estimating treatment effects from observational data is challenging due to two main reasons: (a) hidden confounding, and (b) covariate mismatch (control and treatment groups not having identical distributions). Long lines of works exist…

Machine Learning · Computer Science 2025-04-30 Praharsh Nanavati , Ranjitha Prasad , Karthikeyan Shanmugam

Recent self-supervised contrastive methods have been able to produce impressive transferable visual representations by learning to be invariant to different data augmentations. However, these methods implicitly assume a particular set of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Tete Xiao , Xiaolong Wang , Alexei A. Efros , Trevor Darrell

Self-supervised representation learning (SSRL) methods have shown great success in computer vision. In recent studies, augmentation-based contrastive learning methods have been proposed for learning representations that are invariant or…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Xia Xu , Jochen Triesch

In this work, we evaluate the effectiveness of representation learning approaches for decision making in visually complex environments. Representation learning is essential for effective reinforcement learning (RL) from high-dimensional…

Machine Learning · Computer Science 2022-04-26 Jun Yamada , Karl Pertsch , Anisha Gunjal , Joseph J. Lim

Navigation is crucial for animal behavior and is assumed to require an internal representation of the external environment, termed a cognitive map. The precise form of this representation is often considered to be a metric representation of…

Neurons and Cognition · Quantitative Biology 2020-02-10 Tie Xu , Omri Barak

Neural networks that process the parameters of other neural networks find applications in domains as diverse as classifying implicit neural representations, generating neural network weights, and predicting generalization errors. However,…

Equivariance of linear neural network layers is well studied. In this work, we relax the equivariance condition to only be true in a projective sense. We propose a way to construct a projectively equivariant neural network through building…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Georg Bökman , Axel Flinth , Fredrik Kahl

A prominent goal of representation learning research is to achieve representations which are factorized in a useful manner with respect to the ground truth factors of variation. The fields of disentangled and equivariant representation…

Machine Learning · Computer Science 2023-09-26 Yue Song , T. Anderson Keller , Nicu Sebe , Max Welling

Most efforts in interpretability in deep learning have focused on (1) extracting explanations of a specific downstream task in relation to the input features and (2) imposing constraints on the model, often at the expense of predictive…

Machine Learning · Computer Science 2022-02-22 Marco Bertolini , Djork-Arné Clevert , Floriane Montanari

Interpreting how does deep neural networks (DNNs) make predictions is a vital field in artificial intelligence, which hinders wide applications of DNNs. Visualization of learned representations helps we humans understand the vision of DNNs.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Chen Li , Jinzhe Jiang , Xin Zhang , Tonghuan Zhang , Yaqian Zhao , Dongdong Jiang , RenGang Li

State-of-the-art deep learning systems often require large amounts of data and computation. For this reason, leveraging known or unknown structure of the data is paramount. Convolutional neural networks (CNNs) are successful examples of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Carlos Esteves

Autoencoders exhibit impressive abilities to embed the data manifold into a low-dimensional latent space, making them a staple of representation learning methods. However, without explicit supervision, which is often unavailable, the…

Machine Learning · Computer Science 2023-01-12 Felix Leeb , Stefan Bauer , Michel Besserve , Bernhard Schölkopf

Recent breakthroughs in AI have shown the remarkable power of deep learning and deep reinforcement learning. These developments, however, have been tied to specific tasks, and progress in out-of-distribution generalization has been limited.…

Artificial Intelligence · Computer Science 2021-11-30 Hector Geffner

We investigate graph representation learning approaches that enable models to generalize across graphs: given a model trained using the representations from one graph, our goal is to apply inference using those same model parameters when…

Machine Learning · Computer Science 2023-02-20 Anton Amirov , Chris Quirk , Jennifer Neville

In causal models, a given mechanism is assumed to be invariant to changes of other mechanisms. While this principle has been utilized for inference in settings where the causal variables are observed, theoretical insights when the variables…

Machine Learning · Statistics 2023-12-07 Simon Bing , Jonas Wahl , Urmi Ninad , Jakob Runge

In many real-world applications of regression, conditional probability estimation, and uncertainty quantification, exploiting symmetries rooted in physics or geometry can dramatically improve generalization and sample efficiency. While…

Machine Learning · Computer Science 2025-05-28 Daniel Ordoñez-Apraez , Vladimir Kostić , Alek Fröhlich , Vivien Brandt , Karim Lounici , Massimiliano Pontil

Models for image representation learning are typically designed for either recognition or generation. Various forms of contrastive learning help models learn to convert images to embeddings that are useful for classification, detection, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Matthew Gwilliam , Xiao Wang , Xuefeng Hu , Zhenheng Yang

Latent variable models like the Variational Auto-Encoder (VAE) are commonly used to learn representations of images. However, for downstream tasks like semantic classification, the representations learned by VAE are less competitive than…

Machine Learning · Statistics 2022-05-31 Mingtian Zhang , Tim Z. Xiao , Brooks Paige , David Barber