English
Related papers

Related papers: Causal Discovery with Reinforcement Learning

200 papers

Reinforcement learning (RL), in conjunction with attack graphs and cyber terrain, are used to develop reward and state associated with determination of optimal paths for exfiltration of data in enterprise networks. This work builds on…

Cryptography and Security · Computer Science 2022-04-26 Tyler Cody , Abdul Rahman , Christopher Redino , Lanxiao Huang , Ryan Clark , Akshay Kakkar , Deepak Kushwaha , Paul Park , Peter Beling , Edward Bowen

Structural learning, which aims to learn directed acyclic graphs (DAGs) from observational data, is foundational to causal reasoning and scientific discovery. Recent advancements formulate structural learning into a continuous optimization…

Machine Learning · Computer Science 2023-04-18 Song Wei , Yao Xie

Causal relationships among a set of variables are commonly represented by a directed acyclic graph. The orientations of some edges in the causal DAG can be discovered from observational/interventional data. Further edges can be oriented by…

Machine Learning · Computer Science 2022-05-30 Ramin Safaeian , Saber Salehkaleybar , Mahmoud Tabandeh

We present a generalized linear structural causal model, coupled with a novel data-adaptive linear regularization, to recover causal directed acyclic graphs (DAGs) from time series. By leveraging a recently developed stochastic monotone…

Machine Learning · Computer Science 2023-01-31 Song Wei , Yao Xie , Christopher S. Josef , Rishikesan Kamaleswaran

We present a generalized linear structural causal model, coupled with a novel data-adaptive linear regularization, to recover causal directed acyclic graphs (DAGs) from time series. By leveraging a recently developed stochastic monotone…

Machine Learning · Computer Science 2023-09-27 Song Wei , Yao Xie , Christopher S. Josef , Rishikesan Kamaleswaran

The number of artificial intelligence algorithms for learning causal models from data is growing rapidly. Most ``causal discovery'' or ``causal structure learning'' algorithms are primarily validated through simulation studies. However, no…

Methodology · Statistics 2024-05-24 Bryan Andrews , Erich Kummerfeld

Assuming a directed acyclic graph (DAG) that represents prior knowledge of causal relationships between variables is a common starting point for cause-effect estimation. Existing literature typically invokes hypothetical domain expert…

Machine Learning · Statistics 2025-03-11 Kirtan Padh , Zhufeng Li , Cecilia Casolo , Niki Kilbertus

Causal discovery aims to uncover cause-and-effect relationships encoded in causal graphs by leveraging observational, interventional data, or their combination. The majority of existing causal discovery methods are developed assuming…

Machine Learning · Computer Science 2024-06-25 Muhammad Qasim Elahi , Lai Wei , Murat Kocaoglu , Mahsa Ghasemi

This paper addresses the problem of estimating causal directed acyclic graphs in linear non-Gaussian acyclic models with latent confounders (LvLiNGAM). Existing methods assume mutually independent latent confounders or cannot properly…

Machine Learning · Computer Science 2025-10-17 Ming Cai , Penggang Gao , Hisayuki Hara

Traditional causal discovery methods often depend on strong, untestable assumptions, making them unreliable in real-world applications. In this context, Large Language Models (LLMs) have emerged as a promising alternative for extracting…

Artificial Intelligence · Computer Science 2026-03-31 Federico Baldo , Simon Ferreira , Charles K. Assaad

A directed acyclic graph (DAG) provides valuable prior knowledge that is often discarded in regression tasks in machine learning. We show that the independences arising from the presence of collider structures in DAGs provide meaningful…

Machine Learning · Statistics 2023-06-22 Shahine Bouabid , Jake Fawkes , Dino Sejdinovic

This work addresses the problem of learning directed acyclic graphs (DAGs) from nodal observations generated by a linear structural equation model. DAG learning is a central task in signal processing, machine learning, and causal inference,…

Machine Learning · Computer Science 2026-05-20 Samuel Rey , Madeline navarro , Gonzalo Mateos

Causal structure discovery from observational data is fundamental to the causal understanding of autonomous systems such as medical decision support systems, advertising campaigns and self-driving cars. This is essential to solve well-known…

We introduce a new method to estimate the Markov equivalence class of a directed acyclic graph (DAG) in the presence of hidden variables, in settings where the underlying DAG among the observed variables is sparse, and there are a few…

Methodology · Statistics 2018-08-07 Benjamin Frot , Preetam Nandy , Marloes H. Maathuis

Faced with data-driven policies, individuals will manipulate their features to obtain favorable decisions. While earlier works cast these manipulations as undesirable gaming, recent works have adopted a more nuanced causal framing in which…

Machine Learning · Computer Science 2023-02-22 Tom Yan , Shantanu Gupta , Zachary Lipton

Inverse reinforcement learning (IRL) aims to explicitly infer an underlying reward function based on collected expert demonstrations. Considering that obtaining expert demonstrations can be costly, the focus of current IRL techniques is on…

Machine Learning · Computer Science 2023-10-16 Lu Li , Yuxin Pan , Ruobing Chen , Jie Liu , Zilin Wang , Yu Liu , Zhiheng Li

We study the problem of learning control policies for complex tasks given by logical specifications. Recent approaches automatically generate a reward function from a given specification and use a suitable reinforcement learning algorithm…

Machine Learning · Computer Science 2021-12-28 Kishor Jothimurugan , Suguman Bansal , Osbert Bastani , Rajeev Alur

In reinforcement learning (RL), it is easier to solve a task if given a good representation. While deep RL should automatically acquire such good representations, prior work often finds that learning representations in an end-to-end fashion…

Machine Learning · Computer Science 2023-02-21 Benjamin Eysenbach , Tianjun Zhang , Ruslan Salakhutdinov , Sergey Levine

We consider a a collection of categorical random variables. Of special interest is the causal effect on an outcome variable following an intervention on another variable. Conditionally on a Directed Acyclic Graph (DAG), we assume that the…

Methodology · Statistics 2023-06-29 Federico Castelletti , Guido Consonni , Marco Luigi Della Vedova

Inferring the structure of directed acyclic graphs (DAGs) from data is a central challenge in causal discovery, particularly in modern high-dimensional settings where large-scale interventional data are increasingly available. While…

‹ Prev 1 3 4 5 6 7 10 Next ›