English
Related papers

Related papers: Causal Question Answering with Reinforcement Learn…

200 papers

We study the problem of experiment design to learn causal structures from interventional data. We consider an active learning setting in which the experimenter decides to intervene on one of the variables in the system in each step and uses…

Artificial Intelligence · Computer Science 2020-09-09 Amir Amirinezhad , Saber Salehkaleybar , Matin Hashemi

It is evidence that representation learning can improve model's performance over multiple downstream tasks in many real-world scenarios, such as image classification and recommender systems. Existing learning approaches rely on establishing…

Machine Learning · Computer Science 2022-02-18 Mengyue Yang , Xinyu Cai , Furui Liu , Xu Chen , Zhitang Chen , Jianye Hao , Jun Wang

Complex adaptive agents consistently achieve their goals by solving problems that seem to require an understanding of causal information, information pertaining to the causal relationships that exist among elements of combined…

Artificial Intelligence · Computer Science 2024-07-02 Filippo Torresan , Manuel Baltieri

It is a long-standing question to discover causal relations among a set of variables in many empirical sciences. Recently, Reinforcement Learning (RL) has achieved promising results in causal discovery from observational data. However,…

Machine Learning · Computer Science 2021-09-16 Xiaoqiang Wang , Yali Du , Shengyu Zhu , Liangjun Ke , Zhitang Chen , Jianye Hao , Jun Wang

Reinforcement learning (RL) is used in various robotic applications. RL enables agents to learn tasks autonomously by interacting with the environment. The more critical the tasks are, the higher the demand for the robustness of the RL…

Machine Learning · Computer Science 2023-06-06 Tom He , Jasmina Gajcin , Ivana Dusparic

Causal discovery is a major task with the utmost importance for machine learning since causal structures can enable models to go beyond pure correlation-based inference and significantly boost their performance. However, finding causal…

Machine Learning · Computer Science 2023-02-22 Andreas Sauter , Erman Acar , Vincent François-Lavet

In this paper we introduce and evaluate a distal explanation model for model-free reinforcement learning agents that can generate explanations for `why' and `why not' questions. Our starting point is the observation that causal models can…

Artificial Intelligence · Computer Science 2020-09-15 Prashan Madumal , Tim Miller , Liz Sonenberg , Frank Vetere

Humans use causality and hypothetical retrospection in their daily decision-making, planning, and understanding of life events. The human mind, while retrospecting a given situation, think about questions such as "What was the cause of the…

Artificial Intelligence · Computer Science 2022-01-12 Utkarshani Jaimini , Amit Sheth

This paper investigates causal influences between agents linked by a social graph and interacting over time. In particular, the work examines the dynamics of social learning models and distributed decision-making protocols, and derives…

Social and Information Networks · Computer Science 2026-05-19 Mert Kayaalp , Ali H. Sayed

Causal world models are systems that can answer counterfactual questions about an environment of interest, i.e. predict how it would have evolved if an arbitrary subset of events had been realized differently. It requires understanding the…

Artificial Intelligence · Computer Science 2025-05-21 Gaël Gendron , Jože M. Rožanec , Michael Witbrock , Gillian Dobbie

Inferring the abstract relational and causal structure of the world is a major challenge for reinforcement-learning (RL) agents. For humans, language--particularly in the form of explanations--plays a considerable role in overcoming this…

Understanding how events in a scenario causally connect with each other is important for effectively modeling and reasoning about events. But event reasoning remains a difficult challenge, and despite recent advances, Large Language Models…

Artificial Intelligence · Computer Science 2025-06-10 Mahnaz Koupaee , Xueying Bai , Mudan Chen , Greg Durrett , Nathanael Chambers , Niranjan Balasubramanian

Conversational question answering (ConvQA) over law knowledge bases (KBs) involves answering multi-turn natural language questions about law and hope to find answers in the law knowledge base. Despite many methods have been proposed.…

Artificial Intelligence · Computer Science 2024-01-17 Mi Wu

Discovering causal structure among a set of variables is a fundamental problem in many empirical sciences. Traditional score-based casual discovery methods rely on various local heuristics to search for a Directed Acyclic Graph (DAG)…

Machine Learning · Computer Science 2020-06-09 Shengyu Zhu , Ignavier Ng , Zhitang Chen

While LLMs exhibit impressive fluency and factual recall, they struggle with robust causal reasoning, often relying on spurious correlations and brittle patterns. Similarly, traditional Reinforcement Learning agents also lack causal…

Machine Learning · Computer Science 2025-09-26 Abi Aryan , Zac Liu

Using causal relations to guide decision making has become an essential analytical task across various domains, from marketing and medicine to education and social science. While powerful statistical models have been developed for inferring…

Human-Computer Interaction · Computer Science 2020-09-08 Xiao Xie , Fan Du , Yingcai Wu

Explanations for AI models in high-stakes domains like medicine often lack verifiability, which can hinder trust. To address this, we propose an interactive agent that produces explanations through an auditable sequence of actions. The…

Artificial Intelligence · Computer Science 2025-11-04 Yuhang Huang , Zekai Lin , Fan Zhong , Lei Liu

Graph data is becoming increasingly prevalent due to the growing demand for relational insights in AI across various domains. Organizations regularly use graph data to solve complex problems involving relationships and connections. Causal…

Machine Learning · Computer Science 2026-02-23 Simi Job , Xiaohui Tao , Taotao Cai , Haoran Xie , Jianming Yong , Xin Wang

Agents are systems that optimize an objective function in an environment. Together, the goal and the environment induce secondary objectives, incentives. Modeling the agent-environment interaction using causal influence diagrams, we can…

Artificial Intelligence · Computer Science 2022-01-21 Tom Everitt , Pedro A. Ortega , Elizabeth Barnes , Shane Legg

Interpreting the inner function of neural networks is crucial for the trustworthy development and deployment of these black-box models. Prior interpretability methods focus on correlation-based measures to attribute model decisions to…

Machine Learning · Computer Science 2023-06-21 Ola Ahmad , Nicolas Bereux , Loïc Baret , Vahid Hashemi , Freddy Lecue