English
Related papers

Related papers: Robust agents learn causal world models

200 papers

Current pre-trained language models have enabled remarkable improvements in downstream tasks, but it remains difficult to distinguish effects of statistical correlation from more systematic logical reasoning grounded on understanding of the…

Computation and Language · Computer Science 2022-12-08 Jiaxuan Li , Lang Yu , Allyson Ettinger

Studies show that the representations learned by deep neural networks can be transferred to similar prediction tasks in other domains for which we do not have enough labeled data. However, as we transition to higher layers in the model, the…

Machine Learning · Computer Science 2019-10-29 Raha Moraffah , Kai Shu , Adrienne Raglin , Huan Liu

Efficient and robust policy transfer remains a key challenge for reinforcement learning to become viable for real-wold robotics. Policy transfer through warm initialization, imitation, or interacting over a large set of agents with…

Machine Learning · Computer Science 2021-05-12 Girish Joshi , Girish Chowdhary

Progress in probabilistic generative models has accelerated, developing richer models with neural architectures, implicit densities, and with scalable algorithms for their Bayesian inference. However, there has been limited progress in…

Machine Learning · Statistics 2017-10-31 Dustin Tran , David M. Blei

A key feature of human theory-of-mind is the ability to attribute beliefs to other agents as mentalistic explanations for their behavior. But given the wide variety of beliefs that agents may hold about the world and the rich language we…

Computation and Language · Computer Science 2025-05-27 Lance Ying , Almog Hillel , Ryan Truong , Vikash K. Mansinghka , Joshua B. Tenenbaum , Tan Zhi-Xuan

Training sophisticated agents for optimal decision-making under uncertainty has been key to the rapid development of modern autonomous systems across fields. Notably, model-free reinforcement learning (RL) has enabled decision-making agents…

Machine Learning · Computer Science 2025-07-21 Thomas Banker , Ali Mesbah

We study the problem of agent selection in causal strategic learning under multiple decision makers and address two key challenges that come with it. Firstly, while much of prior work focuses on studying a fixed pool of agents that remains…

Artificial Intelligence · Computer Science 2024-02-06 Kiet Q. H. Vo , Muneeb Aadil , Siu Lun Chau , Krikamol Muandet

We provide explicit, finite-sample guarantees for learning causal representations from data with a sublinear number of environments. Causal representation learning seeks to provide a rigourous foundation for the general representation…

Machine Learning · Statistics 2026-03-30 Inbeom Lee , Tongtong Jin , Bryon Aragam

We consider the problem of multiple agents sensing and acting in environments with the goal of maximising their shared utility. In these environments, agents must learn communication protocols in order to share information that is needed to…

Artificial Intelligence · Computer Science 2016-05-25 Jakob N. Foerster , Yannis M. Assael , Nando de Freitas , Shimon Whiteson

While reinforcement learning has achieved remarkable successes in several domains, its real-world application is limited due to many methods failing to generalise to unfamiliar conditions. In this work, we consider the problem of…

Artificial Intelligence · Computer Science 2023-10-26 Michael Beukman , Devon Jarvis , Richard Klein , Steven James , Benjamin Rosman

Model explainability is crucial for human users to be able to interpret how a proposed classifier assigns labels to data based on its feature values. We study generalized linear models constructed using sets of feature value rules, which…

Machine Learning · Statistics 2023-11-06 Sanjeeb Dash , Soumyadip Ghosh , Joao Goncalves , Mark S. Squillante

Causal inference is capable of estimating the treatment effect (i.e., the causal effect of treatment on the outcome) to benefit the decision making in various domains. One fundamental challenge in this research is that the treatment…

Machine Learning · Computer Science 2021-12-28 Qian Li , Zhichao Wang , Shaowu Liu , Gang Li , Guandong Xu

Understanding the predictions made by deep learning models remains a central challenge, especially in high-stakes applications. A promising approach is to equip models with the ability to answer counterfactual questions -- hypothetical…

Machine Learning · Computer Science 2025-10-28 Inwoo Hwang , Yushu Pan , Elias Bareinboim

We study the design of information acquisition games-environments where a designer contracts their action on Sender's choice of experiment and the realized signals about some state-and identify which predictions can be made absent knowledge…

Theoretical Economics · Economics 2026-01-22 Eric Gao , Daniel Luo

We propose a framework which generalizes "decision making with structured observations" by allowing robust (i.e. multivalued) models. In this framework, each model associates each decision with a convex set of probability distributions over…

Machine Learning · Computer Science 2025-06-27 Alexander Appel , Vanessa Kosoy

The capability of imagining internally with a mental model of the world is vitally important for human cognition. If a machine intelligent agent can learn a world model to create a "dream" environment, it can then internally ask what-if…

Machine Learning · Computer Science 2020-12-29 Minne Li , Mengyue Yang , Furui Liu , Xu Chen , Zhitang Chen , Jun Wang

Predictive models that generalize well under distributional shift are often desirable and sometimes crucial to building robust and reliable machine learning applications. We focus on distributional shift that arises in causal inference from…

Machine Learning · Statistics 2018-02-27 Fredrik D. Johansson , Nathan Kallus , Uri Shalit , David Sontag

An agent who interacts with a wide population of other agents needs to be aware that there may be variations in their understanding of the world. Furthermore, the machinery which they use to perceive may be inherently different, as is the…

Artificial Intelligence · Computer Science 2019-11-20 Rodolfo Corona , Stephan Alaniz , Zeynep Akata

When learning a task as a team, some agents in Multi-Agent Reinforcement Learning (MARL) may fail to understand their true impact in the performance of the team. Such agents end up learning sub-optimal policies, demonstrating undesired lazy…

Artificial Intelligence · Computer Science 2023-03-28 Rafael Pina , Varuna De Silva , Corentin Artaud

With the increasing impact of algorithmic decision-making on human lives, the interpretability of models has become a critical issue in machine learning. Counterfactual explanation is an important method in the field of interpretable…

Machine Learning · Computer Science 2024-07-17 Ao Xu , Tieru Wu