English
Related papers

Related papers: Robust Representation Learning through Explicit En…

200 papers

Learning effective representations in image-based environments is crucial for sample efficient Reinforcement Learning (RL). Unfortunately, in RL, representation learning is confounded with the exploratory experience of the agent -- learning…

Machine Learning · Computer Science 2021-07-21 Denis Yarats , Rob Fergus , Alessandro Lazaric , Lerrel Pinto

Learning high-level causal representations together with a causal model from unstructured low-level data such as pixels is impossible from observational data alone. We prove under mild assumptions that this representation is however…

Machine Learning · Statistics 2022-10-12 Johann Brehmer , Pim de Haan , Phillip Lippe , Taco Cohen

Humans are remarkably good at understanding and reasoning about complex visual scenes. The capability to decompose low-level observations into discrete objects allows us to build a grounded abstract representation and identify the…

Machine Learning · Computer Science 2022-10-12 Ruixiang Zhang , Tong Che , Boris Ivanovic , Renhao Wang , Marco Pavone , Yoshua Bengio , Liam Paull

Causal representation learning promises to extend causal models to hidden causal variables from raw entangled measurements. However, most progress has focused on proving identifiability results in different settings, and we are not aware of…

Machine Learning · Computer Science 2025-02-04 Dingling Yao , Caroline Muller , Francesco Locatello

It has been reported that deep learning models are extremely vulnerable to small but intentionally chosen perturbations of its input. In particular, a deep network, despite its near-optimal accuracy on the clean images, often mis-classifies…

Machine Learning · Computer Science 2022-03-16 A. Tuan Nguyen , Ser Nam Lim , Philip Torr

Domain generalization refers to the problem where we aim to train a model on data from a set of source domains so that the model can generalize to unseen target domains. Naively training a model on the aggregate set of data (pooled from all…

Machine Learning · Computer Science 2022-02-16 A. Tuan Nguyen , Toan Tran , Yarin Gal , Atılım Güneş Baydin

The problem of domain generalization concerns learning predictive models that are robust to distribution shifts when deployed in new, previously unseen environments. Existing methods typically require labeled data from multiple training…

Visual model-based RL methods typically encode image observations into low-dimensional representations in a manner that does not eliminate redundant information. This leaves them susceptible to spurious variations -- changes in…

Machine Learning · Computer Science 2023-10-26 Chuning Zhu , Max Simchowitz , Siri Gadipudi , Abhishek Gupta

We present a unified framework for studying the identifiability of representations learned from simultaneously observed views, such as different data modalities. We allow a partially observed setting in which each view constitutes a…

Many sequential decision-making problems that are currently automated, such as those in manufacturing or recommender systems, operate in an environment where there is either little uncertainty, or zero risk of catastrophe. As companies and…

Machine Learning · Computer Science 2023-04-04 Marc Rigter

Neural networks leverage robust internal representations in order to generalise. Learning them is difficult, and often requires a large training set that covers the data distribution densely. We study a common setting where our task is not…

Empirical risk minimization often performs poorly when the distribution of the target domain differs from those of source domains. To address such potential distribution shifts, we develop an unsupervised domain adaptation approach that…

Machine Learning · Statistics 2025-03-25 Zhenyu Wang , Peter Bühlmann , Zijian Guo

Large pretrained language models are critical components of modern NLP pipelines. Yet, they suffer from spurious correlations, poor out-of-domain generalization, and biases. Inspired by recent progress in causal machine learning, in…

Computation and Language · Computer Science 2022-11-16 Maxime Peyrard , Sarvjeet Singh Ghotra , Martin Josifoski , Vidhan Agarwal , Barun Patra , Dean Carignan , Emre Kiciman , Robert West

We study the problem of learning robust acoustic models in adverse environments, characterized by a significant mismatch between training and test conditions. This problem is of paramount importance for the deployment of speech recognition…

Sound · Computer Science 2022-06-30 Dino Oglic , Zoran Cvetkovic , Peter Sollich , Steve Renals , Bin Yu

Human beings learn causal models and constantly use them to transfer knowledge between similar environments. We use this intuition to design a transfer-learning framework using object-oriented representations to learn the causal…

Machine Learning · Computer Science 2020-07-21 Purva Pruthi , Javier González , Xiaoyu Lu , Madalina Fiterau

Most machine learning theory and practice is concerned with learning a single task. In this thesis it is argued that in general there is insufficient information in a single task for a learner to generalise well and that what is required…

Machine Learning · Computer Science 2019-11-25 Jonathan Baxter

With the resurgence of interest in neural networks, representation learning has re-emerged as a central focus in artificial intelligence. Representation learning refers to the discovery of useful encodings of data that make domain-relevant…

Machine Learning · Computer Science 2016-12-19 Karl Ridgeway

Visual reinforcement learning has proven effective in solving control tasks with high-dimensional observations. However, extracting reliable and generalizable representations from vision-based observations remains a central challenge.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Xiaobo Hu , Youfang Lin , Yue Liu , Jinwen Wang , Shuo Wang , Hehe Fan , Kai Lv

Reinforcement learning (RL) agents make decisions using nothing but observations from the environment, and consequently, heavily rely on the representations of those observations. Though some recent breakthroughs have used vector-based…

Machine Learning · Computer Science 2024-07-16 Edan Meyer , Adam White , Marlos C. Machado

In this work, we evaluate the effectiveness of representation learning approaches for decision making in visually complex environments. Representation learning is essential for effective reinforcement learning (RL) from high-dimensional…

Machine Learning · Computer Science 2022-04-26 Jun Yamada , Karl Pertsch , Anisha Gunjal , Joseph J. Lim