English
Related papers

Related papers: Reinforcement Learning for Causal Discovery withou…

200 papers

Policy gradient reinforcement learning (RL) algorithms have achieved impressive performance in challenging learning tasks such as continuous control, but suffer from high sample complexity. Experience replay is a commonly used approach to…

Machine Learning · Statistics 2020-02-19 Saad Mohamad , Giovanni Montana

Finding cause-effect relationships is of key importance in science. Causal discovery aims to recover a graph from data that succinctly describes these cause-effect relationships. However, current methods face several challenges, especially…

Machine Learning · Computer Science 2026-01-21 Jan Marco Ruiz de Vargas , Kirtan Padh , Niki Kilbertus

The combinatorial problem of learning directed acyclic graphs (DAGs) from data was recently framed as a purely continuous optimization problem by leveraging a differentiable acyclicity characterization of DAGs based on the trace of a matrix…

Machine Learning · Computer Science 2023-01-18 Kevin Bello , Bryon Aragam , Pradeep Ravikumar

Directed acyclic graphs (DAGs) are commonly used to model causal relationships among random variables. In general, learning the DAG structure is both computationally and statistically challenging. Moreover, without additional information,…

Machine Learning · Statistics 2024-03-26 Ali Shojaie , Wenyu Chen

Bayesian network is a frequently-used method for fault detection and diagnosis in industrial processes. The basis of Bayesian network is structure learning which learns a directed acyclic graph (DAG) from data. However, the search space…

Artificial Intelligence · Computer Science 2023-02-07 Zhichao Chen , Zhiqiang Ge

In many application areas---lending, education, and online recommenders, for example---fairness and equity concerns emerge when a machine learning system interacts with a dynamically changing environment to produce both immediate and…

Machine Learning · Computer Science 2020-07-07 Elliot Creager , David Madras , Toniann Pitassi , Richard Zemel

Directed Acyclic Graphs (DAGs) are a standard tool in causal modeling, but their suitability for capturing the complexity of large-scale multimodal data is questionable. In practice, real-world multimodal datasets are often collected from…

Machine Learning · Computer Science 2026-03-03 Yuhang Liu , Zhen Zhang , Dong Gong , Erdun Gao , Biwei Huang , Mingming Gong , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

We present a generalized linear structural causal model, coupled with a novel data-adaptive linear regularization, to recover causal directed acyclic graphs (DAGs) from time series. By leveraging a recently developed stochastic monotone…

Machine Learning · Computer Science 2023-01-31 Song Wei , Yao Xie , Christopher S. Josef , Rishikesan Kamaleswaran

We present a generalized linear structural causal model, coupled with a novel data-adaptive linear regularization, to recover causal directed acyclic graphs (DAGs) from time series. By leveraging a recently developed stochastic monotone…

Machine Learning · Computer Science 2023-09-27 Song Wei , Yao Xie , Christopher S. Josef , Rishikesan Kamaleswaran

Continuous-time nonlinear optimal control problems hold great promise in real-world applications. After decades of development, reinforcement learning (RL) has achieved some of the greatest successes as a general nonlinear control design…

Systems and Control · Electrical Eng. & Systems 2023-07-19 Brent A. Wallace , Jennie Si

We address the problem of learning the topology of directed acyclic graphs (DAGs) from nodal observations, which adhere to a linear structural equation model. Recent advances framed the combinatorial DAG structure learning task as a…

Machine Learning · Computer Science 2024-09-13 Samuel Rey , Seyed Saman Saboksayr , Gonzalo Mateos

In recent years, deep Reinforcement Learning (RL) has been successful in various combinatorial search domains, such as two-player games and scientific discovery. However, directly applying deep RL in planning domains is still challenging.…

Artificial Intelligence · Computer Science 2022-09-21 Dieqiao Feng , Carla P. Gomes , Bart Selman

Deep reinforcement learning (DRL) policies have been shown to be deceived by perturbations (e.g., random noise or intensional adversarial attacks) on state observations that appear at test time but are unknown during training. To increase…

Machine Learning · Computer Science 2020-12-25 Xinghua Qu , Yew-Soon Ong , Abhishek Gupta , Zhu Sun

Respondent-driven sampling (RDS) is widely used to study hidden or hard-to-reach populations by incentivizing study participants to recruit their social connections. The success and efficiency of RDS can depend critically on the nature of…

Methodology · Statistics 2025-01-06 Justin Weltz , Angela Yoon , Yichi Zhang , Alexander Volfovsky , Eric Laber

Reinforcement Learning (RL) and Deep Reinforcement Learning (DRL) have advanced rapidly in recent years and have been successfully applied to e-learning environments like intelligent tutoring systems (ITSs). Despite great success, the…

Machine Learning · Computer Science 2026-02-25 Md Mirajul Islam , Xi Yang , Adittya Soukarjya Saha , Rajesh Debnath , Min Chi

Social science theories often postulate causal relationships among a set of variables or events. Although directed acyclic graphs (DAGs) are increasingly used to represent these theories, their full potential has not yet been realized in…

Machine Learning · Statistics 2024-01-17 Sourabh Balgi , Adel Daoud , Jose M. Peña , Geoffrey T. Wodtke , Jesse Zhou

Directed Acyclic Graphs (DAGs) provide a powerful framework to model causal relationships among variables in multivariate settings; in addition, through the do-calculus theory, they allow for the identification and estimation of causal…

Machine Learning · Statistics 2022-01-31 Federico Castelletti , Alessandro Mascaro

Deep learning (DL) has recently drawn much attention in image analysis, natural language process, and high-dimensional medical data analysis. Under the causal direct acyclic graph (DAG) interpretation, the input variables without incoming…

Applications · Statistics 2022-03-22 Jong-Hyeon Jeong , Yichen Jia

Deep Learning has become overly complicated and has enjoyed stellar success in solving several classical problems like image classification, object detection, etc. Several methods for explaining these decisions have been proposed. Black-box…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Siddhant Agarwal , Owais Iqbal , Sree Aditya Buridi , Madda Manjusha , Abir Das

Recent progress in large language models has renewed interest in how multi-step reasoning is represented internally. While prior work often treats reasoning as a linear chain, many reasoning problems are more naturally modeled as directed…

Computation and Language · Computer Science 2026-04-07 Tianjun Zhong , Linyang He , Nima Mesgarani