English
Related papers

Related papers: DAG-aware Transformer for Causal Effect Estimation

200 papers

Learning the causal structure that underlies data is a crucial step towards robust real-world decision making. The majority of existing work in causal inference focuses on determining a single directed acyclic graph (DAG) or a Markov…

Machine Learning · Computer Science 2021-06-15 Yashas Annadani , Jonas Rothfuss , Alexandre Lacoste , Nino Scherrer , Anirudh Goyal , Yoshua Bengio , Stefan Bauer

Discovering causal structures from data is a challenging inference problem of fundamental importance in all areas of science. The appealing properties of neural networks have recently led to a surge of interest in differentiable neural…

We introduce a novel framework for temporal causal discovery and inference that addresses two key challenges: complex nonlinear dependencies and spurious correlations. Our approach employs a multi-layer Transformer-based time-series…

Machine Learning · Computer Science 2025-08-25 Jihua Huang , Yi Yao , Ajay Divakaran

Causal structure learning has long been the central task of inferring causal insights from data. Despite the abundance of real-world processes exhibiting higher-order mechanisms, however, an explicit treatment of interactions in causal…

Machine Learning · Computer Science 2025-11-07 James Enouen , Yujia Zheng , Ignavier Ng , Yan Liu , Kun Zhang

Bayesian causal discovery offers the power to quantify epistemic uncertainties among a broad range of structurally diverse causal theories potentially explaining the data, represented in forms of directed acyclic graphs (DAGs). However,…

Machine Learning · Computer Science 2024-08-30 Nu Hoang , Bao Duong , Thin Nguyen

Causal models seek to unravel the cause-effect relationships among variables from observed data, as opposed to mere mappings among them, as traditional regression models do. This paper introduces a novel causal discovery algorithm designed…

Machine Learning · Computer Science 2024-10-03 Saeed Mohseni-Sehdeh , Walid Saad

Temporal causal analysis means understanding the underlying causes behind observed variables over time. Deep learning based methods such as transformers are increasingly used to capture temporal dynamics and causal relationships beyond mere…

Machine Learning · Computer Science 2024-11-21 Riya Mahesh , Rahul Vashisht , Chandrashekar Lakshminarayanan

Bayesian causal discovery aims to infer the posterior distribution over causal models from observed data, quantifying epistemic uncertainty and benefiting downstream tasks. However, computational challenges arise due to joint inference over…

Machine Learning · Computer Science 2023-12-11 Yashas Annadani , Nick Pawlowski , Joel Jennings , Stefan Bauer , Cheng Zhang , Wenbo Gong

Causal processes in biomedicine may contain cycles, evolve over time or differ between populations. However, many graphical models cannot accommodate these conditions. We propose to model causation using a mixture of directed cyclic graphs…

Machine Learning · Statistics 2020-09-08 Eric V. Strobl

Social science theories often postulate causal relationships among a set of variables or events. Although directed acyclic graphs (DAGs) are increasingly used to represent these theories, their full potential has not yet been realized in…

Machine Learning · Statistics 2024-01-17 Sourabh Balgi , Adel Daoud , Jose M. Peña , Geoffrey T. Wodtke , Jesse Zhou

The recent works on causal discovery have followed a similar trend of learning partial ancestral graphs (PAGs) since observational data constrain the true causal directed acyclic graph (DAG) only up to a Markov equivalence class. This…

Machine Learning · Computer Science 2026-03-03 Tingrui Huang , Devendra Singh Dhami

An acyclic causal structure can be described with directed acyclic graph (DAG), where arrows indicate the possibility of direct causation. The task of learning this structure from data is known as "causal discovery." Diverse populations or…

Machine Learning · Computer Science 2024-10-17 Bijan Mazaheri , Spencer Gordon , Yuval Rabani , Leonard Schulman

Causal DAGs(Directed Acyclic Graphs) are usually considered in a 2D plane. Edges indicate causal effects' directions and imply their corresponding time-passings. Due to the natural restriction of statistical models, effect estimation is…

Machine Learning · Computer Science 2023-09-26 Jia Li , Xiang Li , Xiaowei Jia , Michael Steinbach , Vipin Kumar

Directed acyclic graph (DAG) learning is a central task in structure discovery and causal inference. Although the field has witnessed remarkable advances over the past few years, it remains statistically and computationally challenging to…

Machine Learning · Statistics 2026-02-09 Ryan Thompson , Edwin V. Bonilla , Robert Kohn

Causal inference is capable of estimating the treatment effect (i.e., the causal effect of treatment on the outcome) to benefit the decision making in various domains. One fundamental challenge in this research is that the treatment…

Machine Learning · Computer Science 2021-12-28 Qian Li , Zhichao Wang , Shaowu Liu , Gang Li , Guandong Xu

We focus on the extension of bivariate causal learning methods into multivariate problem settings in a systematic manner via a novel framework. It is purposive to augment the scale to which bivariate causal discovery approaches can be…

Methodology · Statistics 2023-05-29 Hongyi Chen , Maurits Kaptein

Directed acyclic graphs (DAGs) are commonly used to model causal relationships among random variables. In general, learning the DAG structure is both computationally and statistically challenging. Moreover, without additional information,…

Machine Learning · Statistics 2024-03-26 Ali Shojaie , Wenyu Chen

Causal discovery aims to infer causal relationships among variables from observational data, typically represented by a directed acyclic graph (DAG). Most existing methods assume independent and identically distributed observations, an…

Methodology · Statistics 2026-03-27 Alex Chen , Qing Zhou

This paper explores the potential of the transformer models for learning Granger causality in networks with complex nonlinear dynamics at every node, as in neurobiological and biophysical networks. Our study primarily focuses on a…

Machine Learning · Computer Science 2025-10-21 Ziyu Lu , Anika Tabassum , Shruti Kulkarni , Lu Mi , J. Nathan Kutz , Eric Shea-Brown , Seung-Hwan Lim

This paper studies the causal representation learning problem when the latent causal variables are observed indirectly through an unknown linear transformation. The objectives are: (i) recovering the unknown linear transformation (up to…

Machine Learning · Statistics 2023-05-02 Burak Varici , Emre Acarturk , Karthikeyan Shanmugam , Abhishek Kumar , Ali Tajer