English
Related papers

Related papers: Exploiting Non-Negativity in DAG Structure Learnin…

200 papers

Directed acyclic graph (DAG) learning is a central task in structure discovery and causal inference. Although the field has witnessed remarkable advances over the past few years, it remains statistically and computationally challenging to…

Machine Learning · Statistics 2026-02-09 Ryan Thompson , Edwin V. Bonilla , Robert Kohn

Directed acyclic graph (DAG) has been widely employed to represent directional relationships among a set of collected nodes. Yet, the available data in one single study is often limited for accurate DAG reconstruction, whereas heterogeneous…

Machine Learning · Statistics 2023-10-17 Mingyang Ren , Xin He , Junhui Wang

Structural learning, which aims to learn directed acyclic graphs (DAGs) from observational data, is foundational to causal reasoning and scientific discovery. Recent advancements formulate structural learning into a continuous optimization…

Machine Learning · Computer Science 2023-04-18 Song Wei , Yao Xie

Due to its human-interpretability and invariance properties, Directed Acyclic Graph (DAG) has been a foundational tool across various areas of AI research, leading to significant advancements. However, DAG learning remains highly…

Machine Learning · Computer Science 2025-06-24 Naiyu Yin , Tian Gao , Yue Yu

This paper investigates in which cases continuous optimization for directed acyclic graph (DAG) structure learning can and cannot perform well and why this happens, and suggests possible directions to make the search procedure more…

Machine Learning · Computer Science 2024-08-20 Ignavier Ng , Biwei Huang , Kun Zhang

We study a family of regularized score-based estimators for learning the structure of a directed acyclic graph (DAG) for a multivariate normal distribution from high-dimensional data with $p\gg n$. Our main results establish support…

Statistics Theory · Mathematics 2017-10-03 Bryon Aragam , Arash A. Amini , Qing Zhou

We present a novel perspective and algorithm for learning directed acyclic graphs (DAGs) from data generated by a linear structural equation model (SEM). First, we show that a linear SEM can be viewed as a linear transform that, in prior…

Machine Learning · Computer Science 2024-06-21 Panagiotis Misiakos , Chris Wendler , Markus Püschel

We study the problem of reducing test-time acquisition costs in classification systems. Our goal is to learn decision rules that adaptively select sensors for each example as necessary to make a confident prediction. We model our system as…

Machine Learning · Statistics 2015-10-27 Joseph Wang , Kirill Trapeznikov , Venkatesh Saligrama

Mainly motivated by the problem of modelling directional dependence relationships for multivariate count data in high-dimensional settings, we present a new algorithm, called learnDAG, for learning the structure of directed acyclic graphs…

Methodology · Statistics 2024-06-10 Thi Kim Hue Nguyen , Monica Chiogna , Davide Risso

Directed Acyclic Graphs (DAGs) are central to uncovering causal structure in complex systems, yet learning a single DAG from data is often challenging: model uncertainty, finite samples, and a combinatorially large search space frequently…

Methodology · Statistics 2026-05-19 Yunan Wu , Yue Wang , Chunlin Li , Chenglong Ye

We develop a framework for learning sparse nonparametric directed acyclic graphs (DAGs) from data. Our approach is based on a recent algebraic characterization of DAGs that led to a fully continuous program for score-based learning of DAG…

Machine Learning · Statistics 2020-03-25 Xun Zheng , Chen Dan , Bryon Aragam , Pradeep Ravikumar , Eric P. Xing

The combinatorial search space presents a significant challenge to learning causality from data. Recently, the problem has been formulated into a continuous optimization framework with an acyclicity constraint, allowing for the exploration…

Machine Learning · Computer Science 2022-04-04 Hristo Petkov , Colin Hanley , Feng Dong

We establish a new framework for statistical estimation of directed acyclic graphs (DAGs) when data are generated from a linear, possibly non-Gaussian structural equation model. Our framework consists of two parts: (1) inferring the…

Machine Learning · Statistics 2013-11-15 Po-Ling Loh , Peter Bühlmann

Conventional methods for causal structure learning from data face significant challenges due to combinatorial search space. Recently, the problem has been formulated into a continuous optimization framework with an acyclicity constraint to…

Machine Learning · Computer Science 2022-06-06 Hristo Petkov , Colin Hanley , Feng Dong

The combinatorial problem of learning directed acyclic graphs (DAGs) from data was recently framed as a purely continuous optimization problem by leveraging a differentiable acyclicity characterization of DAGs based on the trace of a matrix…

Machine Learning · Computer Science 2023-01-18 Kevin Bello , Bryon Aragam , Pradeep Ravikumar

A directed acyclic graph (DAG) provides valuable prior knowledge that is often discarded in regression tasks in machine learning. We show that the independences arising from the presence of collider structures in DAGs provide meaningful…

Machine Learning · Statistics 2023-06-22 Shahine Bouabid , Jake Fawkes , Dino Sejdinovic

Learning the underlying Bayesian Networks (BNs), represented by directed acyclic graphs (DAGs), of the concerned events from purely-observational data is a crucial part of evidential reasoning. This task remains challenging due to the large…

Machine Learning · Statistics 2023-02-20 Danru Xu , Erdun Gao , Wei Huang , Menghan Wang , Andy Song , Mingming Gong

We propose a continuous optimization framework for discovering a latent directed acyclic graph (DAG) from observational data. Our approach optimizes over the polytope of permutation vectors, the so-called Permutahedron, to learn a…

Machine Learning · Computer Science 2023-02-14 Valentina Zantedeschi , Luca Franceschi , Jean Kaddour , Matt J. Kusner , Vlad Niculae

Recovering underlying Directed Acyclic Graph (DAG) structures from observational data is highly challenging due to the combinatorial nature of the DAG-constrained optimization problem. Recently, DAG learning has been cast as a continuous…

Machine Learning · Computer Science 2022-12-23 Zhen Zhang , Ignavier Ng , Dong Gong , Yuhang Liu , Ehsan M Abbasnejad , Mingming Gong , Kun Zhang , Javen Qinfeng Shi

Assuming a directed acyclic graph (DAG) that represents prior knowledge of causal relationships between variables is a common starting point for cause-effect estimation. Existing literature typically invokes hypothetical domain expert…

Machine Learning · Statistics 2025-03-11 Kirtan Padh , Zhufeng Li , Cecilia Casolo , Niki Kilbertus