English
Related papers

Related papers: Explainable Reinforcement Learning Through a Causa…

200 papers

Reinforcement Learning (RL) agents often exhibit learning behaviors that are not intuitively interpretable by human observers, which can result in suboptimal feedback in collaborative teaching settings. Yet, how humans perceive and…

Human-Computer Interaction · Computer Science 2025-06-17 Bernhard Hilpert , Muhan Hou , Kim Baraka , Joost Broekens

Structural causal models describe how the components of a robotic system interact. They provide both structural and functional information about the relationships that are present in the system. The structural information outlines the…

Robotics · Computer Science 2025-08-12 Alejandro Murillo-Gonzalez , Junhong Xu , Lantao Liu

World modelling, i.e. building a representation of the rules that govern the world so as to predict its evolution, is an essential ability for any agent interacting with the physical world. Despite their impressive performance, many…

Machine Learning · Computer Science 2025-05-06 Francesco Petri , Luigi Asprino , Aldo Gangemi

With the increasing presence of robotic systems and human-robot environments in today's society, understanding the reasoning behind actions taken by a robot is becoming more important. To increase this understanding, users are provided with…

Robotics · Computer Science 2022-11-24 Niclas Schroeter , Francisco Cruz , Stefan Wermter

Many reinforcement learning (RL) environments consist of independent entities that interact sparsely. In such environments, RL agents have only limited influence over other entities in any particular situation. Our idea in this work is that…

Machine Learning · Computer Science 2021-12-03 Maximilian Seitzer , Bernhard Schölkopf , Georg Martius

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts, however, their behavior is…

Machine Learning · Computer Science 2023-09-20 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

Modelling the behaviours of other agents is essential for understanding how agents interact and making effective decisions. Existing methods for agent modelling commonly assume knowledge of the local observations and chosen actions of the…

Machine Learning · Computer Science 2021-11-10 Georgios Papoudakis , Filippos Christianos , Stefano V. Albrecht

We show that it is possible to understand and identify a decision maker's subjective causal judgements by observing her preferences over interventions. Following Pearl [2000], we represent causality using causal models (also called…

Theoretical Economics · Economics 2024-01-23 Joseph Y. Halpern , Evan Piermont

Causal reasoning is the main learning and explanation tool used by humans. AI systems should possess causal reasoning capabilities to be deployed in the real world with trust and reliability. Introducing the ideas of causality to machine…

Machine Learning · Computer Science 2021-06-11 Abbavaram Gowtham Reddy

The act of explaining across two parties is a feedback loop, where one provides information on what needs to be explained and the other provides an explanation relevant to this information. We apply a reinforcement learning framework which…

Machine Learning · Computer Science 2020-07-20 Arnold YS Yeung , Shalmali Joshi , Joseph Jay Williams , Frank Rudzicz

Learning efficiently a causal model of the environment is a key challenge of model-based RL agents operating in POMDPs. We consider here a scenario where the learning agent has the ability to collect online experiences through direct…

Machine Learning · Computer Science 2021-06-29 Maxime Gasse , Damien Grasset , Guillaume Gaudron , Pierre-Yves Oudeyer

Reinforcement learning agents can achieve super-human performance in complex decision-making tasks, but their behaviour is often difficult to understand and explain. This lack of explanation limits deployment, especially in safety-critical…

Machine Learning · Computer Science 2025-08-01 Daniel Beechey , Thomas M. S. Smith , Özgür Şimşek

Inspired by a novel action-theoretic formalization of actual cause, Khan and Lesp\'erance (2021) recently proposed a first account of causal knowledge that supports epistemic effects, models causal knowledge dynamics, and allows sensing…

Artificial Intelligence · Computer Science 2022-05-17 Shakil M. Khan

Reinforcement learning (RL) is a powerful tool for solving complex decision-making problems, but its lack of transparency and interpretability has been a major challenge in domains where decisions have significant real-world consequences.…

Artificial Intelligence · Computer Science 2023-09-12 Muzhe Guo , Feixu Yu , Tian Lan , Fang Jin

Understanding emerging behaviors of reinforcement learning (RL) agents may be difficult since such agents are often trained in complex environments using highly complex decision making procedures. This has given rise to a variety of…

Artificial Intelligence · Computer Science 2022-12-02 Mira Finkelstein , Lucy Liu , Nitsan Levy Schlot , Yoav Kolumbus , David C. Parkes , Jeffrey S. Rosenshein , Sarah Keren

As machine learning systems become more powerful they also become increasingly unpredictable and opaque. Yet, finding human-understandable explanations of how they work is essential for their safe deployment. This technical report…

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts; however, their behavior is…

Machine Learning · Computer Science 2023-12-01 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

To make effective decisions, it is important to have a thorough understanding of the causal relationships among actions, environments, and outcomes. This review aims to surface three crucial aspects of decision-making through a causal lens:…

Machine Learning · Statistics 2026-04-22 Lin Ge , Hengrui Cai , Runzhe Wan , Yang Xu , Rui Song

Observational learning is a type of learning that occurs as a function of observing, retaining and possibly replicating or imitating the behaviour of another agent. It is a core mechanism appearing in various instances of social learning…

Machine Learning · Computer Science 2017-06-22 Diana Borsa , Bilal Piot , Rémi Munos , Olivier Pietquin

Learning representations purely from observations concerns the problem of learning a low-dimensional, compact representation which is beneficial to prediction models. Under the hypothesis that the intrinsic latent factors follow some casual…

Machine Learning · Computer Science 2023-10-24 Mengyue Yang , Xinyu Cai , Furui Liu , Weinan Zhang , Jun Wang