English
Related papers

Related papers: Causal Discovery with Reinforcement Learning

200 papers

It is a long-standing question to discover causal relations among a set of variables in many empirical sciences. Recently, Reinforcement Learning (RL) has achieved promising results in causal discovery from observational data. However,…

Machine Learning · Computer Science 2021-09-16 Xiaoqiang Wang , Yali Du , Shengyu Zhu , Liangjun Ke , Zhitang Chen , Jianye Hao , Jun Wang

Recently, reinforcement learning (RL) has proved a promising alternative for conventional local heuristics in score-based approaches to learning directed acyclic causal graphs (DAGs) from observational data. However, the intricate…

Machine Learning · Computer Science 2025-06-02 Bao Duong , Hung Le , Biwei Huang , Thin Nguyen

Learning directed acyclic graph (DAG) that describes the causality of observed data is a very challenging but important task. Due to the limited quantity and quality of observed data, and non-identifiability of causal graph, it is almost…

Machine Learning · Computer Science 2022-11-23 Dezhi Yang , Guoxian Yu , Jun Wang , Zhengtian Wu , Maozu Guo

Reinforcement Learning (RL) faces significant challenges in adaptive healthcare interventions, such as dementia care, where data is scarce, decisions require interpretability, and underlying patient-state dynamic are complex and causal in…

Robotics · Computer Science 2025-12-02 Wenzheng Zhao , Ran Zhang , Ruth Palan Lopez , Shu-Fen Wung , Fengpei Yuan

Uncovering causal structures from observational data is crucial for understanding complex systems and making informed decisions. While reinforcement learning (RL) has shown promise in identifying these structures in the form of a directed…

Machine Learning · Computer Science 2026-03-24 Dong Li , Zhengzhang Chen , Xujiang Zhao , Linlin Yu , Zhong Chen , Yi He , Haifeng Chen , Chen Zhao

Causal discovery aims to uncover causal structure among a set of variables. Score-based approaches mainly focus on searching for the best Directed Acyclic Graph (DAG) based on a predefined score function. However, most of them are not…

Machine Learning · Computer Science 2023-03-13 Wenqian Li , Yinchuan Li , Shengyu Zhu , Yunfeng Shao , Jianye Hao , Yan Pang

Discovering causal structure among a set of variables is a fundamental problem in many domains. However, state-of-the-art methods seldom consider the possibility that the observational data has missing values (incomplete data), which is…

Machine Learning · Computer Science 2020-06-11 Xiaoshui Huang , Fujin Zhu , Lois Holloway , Ali Haidar

In many domains of empirical sciences, discovering the causal structure within variables remains an indispensable task. Recently, to tackle with unoriented edges or latent assumptions violation suffered by conventional methods, researchers…

Machine Learning · Computer Science 2024-12-30 Shixuan Liu , Yanghe Feng , Keyu Wu , Guangquan Cheng , Jincai Huang , Zhong Liu

To represent the causal relationships between variables, a directed acyclic graph (DAG) is widely utilized in many areas, such as social sciences, epidemics, and genetics. Many causal structure learning approaches are developed to learn the…

Machine Learning · Statistics 2025-01-14 Jianian Wang , Rui Song

As a pivotal component to attaining generalizable solutions in human intelligence, reasoning provides great potential for reinforcement learning (RL) agents' generalization towards varied goals by summarizing part-to-whole arguments and…

Machine Learning · Computer Science 2023-05-18 Wenhao Ding , Haohong Lin , Bo Li , Ding Zhao

Since the advent of autonomous driving technology, it has experienced remarkable progress over the last decade. However, most existing research still struggles to address the challenges posed by environments where multiple vehicles have to…

Multiagent Systems · Computer Science 2025-08-01 Jing Wang , Yan Jin , Fei Ding , Chongfeng Wei

Learning the structure of causal directed acyclic graphs (DAGs) is useful in many areas of machine learning and artificial intelligence, with wide applications. However, in the high-dimensional setting, it is challenging to obtain good…

Machine Learning · Statistics 2024-05-27 Stephen Smith , Qing Zhou

Meta Reinforcement Learning (RL) methods focus on automating the design of RL algorithms that generalize to a wide range of environments. The framework introduced in (Anonymous, 2020) addresses the problem by representing different RL…

Machine Learning · Computer Science 2021-01-19 Juan Jose Garau Luis

Learning DAG structures from purely observational data remains a long-standing challenge across scientific domains. An emerging line of research leverages the score of the data distribution to initially identify a topological order of the…

Machine Learning · Computer Science 2026-01-27 Vy Vo , He Zhao , Trung Le , Edwin V. Bonilla , Dinh Phung

Identifying causal structure is central to many fields ranging from strategic decision-making to biology and economics. In this work, we propose CD-UCT, a model-based reinforcement learning method for causal discovery based on tree search…

Machine Learning · Computer Science 2024-02-14 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

Causal models seek to unravel the cause-effect relationships among variables from observed data, as opposed to mere mappings among them, as traditional regression models do. This paper introduces a novel causal discovery algorithm designed…

Machine Learning · Computer Science 2024-10-03 Saeed Mohseni-Sehdeh , Walid Saad

We propose a novel score-based approach to learning a directed acyclic graph (DAG) from observational data. We adapt a recently proposed continuous constrained optimization formulation to allow for nonlinear relationships between variables…

Machine Learning · Computer Science 2020-02-19 Sébastien Lachapelle , Philippe Brouillard , Tristan Deleu , Simon Lacoste-Julien

Discovering the underlying Directed Acyclic Graph (DAG) from time series observational data is highly challenging due to the dynamic nature and complex nonlinear interactions between variables. Existing methods typically search for the…

Machine Learning · Computer Science 2025-03-21 Jiajun Zhang , Boyang Qiang , Xiaoyu Guo , Weiwei Xing , Yue Cheng , Witold Pedrycz

Causal discovery aims to infer causal relationships among variables from observational data, typically represented by a directed acyclic graph (DAG). Most existing methods assume independent and identically distributed observations, an…

Methodology · Statistics 2026-03-27 Alex Chen , Qing Zhou

Existing score-based methods for directed acyclic graph (DAG) learning from observational data struggle to recover the causal graph accurately and sample-efficiently. To overcome this, in this study, we propose DrBO (DAG recovery via…

Machine Learning · Computer Science 2025-01-28 Bao Duong , Sunil Gupta , Thin Nguyen
‹ Prev 1 2 3 10 Next ›