English
Related papers

Related papers: Learning Sparse Nonparametric DAGs

200 papers

Due to its human-interpretability and invariance properties, Directed Acyclic Graph (DAG) has been a foundational tool across various areas of AI research, leading to significant advancements. However, DAG learning remains highly…

Machine Learning · Computer Science 2025-06-24 Naiyu Yin , Tian Gao , Yue Yu

Recently continuous relaxations have been proposed in order to learn Directed Acyclic Graphs (DAGs) from data by backpropagation, instead of using combinatorial optimization. However, a number of techniques for fully discrete…

Machine Learning · Computer Science 2022-10-28 Andrew J. Wren , Pasquale Minervini , Luca Franceschi , Valentina Zantedeschi

Causal representation learning aims to recover the latent causal variables and their causal relations, typically represented by directed acyclic graphs (DAGs), from low-level observations such as image pixels. A prevailing line of research…

Machine Learning · Computer Science 2026-04-28 Ignavier Ng , Shaoan Xie , Xinshuai Dong , Peter Spirtes , Kun Zhang

Estimating the structure of directed acyclic graphs (DAGs) of features (variables) plays a vital role in revealing the latent data generation process and providing causal insights in various applications. Although there have been many…

Machine Learning · Computer Science 2024-03-06 Shaohua Fan , Shuyang Zhang , Xiao Wang , Chuan Shi

We present a graph-based technique for estimating sparse covariance matrices and their inverses from high-dimensional data. The method is based on learning a directed acyclic graph (DAG) and estimating parameters of a multivariate Gaussian…

Methodology · Statistics 2010-01-18 Philipp Rütimann , Peter Bühlmann

Bayesian networks represent relations between variables using a directed acyclic graph (DAG). Learning the DAG is an NP-hard problem and exact learning algorithms are feasible only for small sets of variables. We propose two scalable…

Machine Learning · Computer Science 2021-07-02 Pierre Gillot , Pekka Parviainen

A recent approach to building consensus protocols on top of Directed Acyclic Graphs (DAGs) shows much promise due to its simplicity and stable throughput. However, as each node in the DAG typically includes a linear number of references to…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-03 Michael Anoprenko , Andrei Tonkikh , Alexander Spiegelman , Petr Kuznetsov , Anatoliy Zinovyev , Konstantin Shprenger

The recent works on causal discovery have followed a similar trend of learning partial ancestral graphs (PAGs) since observational data constrain the true causal directed acyclic graph (DAG) only up to a Markov equivalence class. This…

Machine Learning · Computer Science 2026-03-03 Tingrui Huang , Devendra Singh Dhami

The problem of learning a directed acyclic graph (DAG) up to Markov equivalence is equivalent to the problem of finding a permutation of the variables that induces the sparsest graph. Without additional assumptions, this task is known to be…

Methodology · Statistics 2020-11-10 Chandler Squires , Joshua Amaniampong , Caroline Uhler

Recently directed acyclic graph (DAG) structure learning is formulated as a constrained continuous optimization problem with continuous acyclicity constraints and was solved iteratively through subproblem optimization. To further improve…

Machine Learning · Computer Science 2021-06-15 Yue Yu , Tian Gao , Naiyu Yin , Qiang Ji

We study the problem of reducing test-time acquisition costs in classification systems. Our goal is to learn decision rules that adaptively select sensors for each example as necessary to make a confident prediction. We model our system as…

Machine Learning · Statistics 2015-10-27 Joseph Wang , Kirill Trapeznikov , Venkatesh Saligrama

Directed acyclic graph (DAG) learning is a central task in structure discovery and causal inference. Although the field has witnessed remarkable advances over the past few years, it remains statistically and computationally challenging to…

Machine Learning · Statistics 2026-02-09 Ryan Thompson , Edwin V. Bonilla , Robert Kohn

Directed acyclic graphs (DAGs) are a class of graphs commonly used in practice, with examples that include electronic circuits, Bayesian networks, and neural architectures. While many effective encoders exist for DAGs, it remains…

Machine Learning · Computer Science 2025-05-30 Michael Sun , Orion Foo , Gang Liu , Wojciech Matusik , Jie Chen

This paper investigates in which cases continuous optimization for directed acyclic graph (DAG) structure learning can and cannot perform well and why this happens, and suggests possible directions to make the search procedure more…

Machine Learning · Computer Science 2024-08-20 Ignavier Ng , Biwei Huang , Kun Zhang

Learning directed acyclic graphs (DAGs) from data is a challenging task both in theory and in practice, because the number of possible DAGs scales superexponentially with the number of nodes. In this paper, we study the problem of learning…

Machine Learning · Computer Science 2019-04-25 Hasan Manzour , Simge Küçükyavuz , Ali Shojaie

Motivated by distributed machine learning settings such as Federated Learning, we consider the problem of fitting a statistical model across a distributed collection of heterogeneous data sets whose similarity structure is encoded by a…

Statistics Theory · Mathematics 2021-11-30 Dominic Richards , Sahand N. Negahban , Patrick Rebeschini

We consider the problem of inferring the causal structure from observational data, especially when the structure is sparse. This type of problem is usually formulated as an inference of a directed acyclic graph (DAG) model. The linear…

Machine Learning · Statistics 2025-08-21 Kazuharu Harada , Hironori Fujisawa

Directed acyclic graph (DAG) models are widely used to represent causal relationships among random variables in many application domains. This paper studies a special class of non-Gaussian DAG models, where the conditional variance of each…

Machine Learning · Statistics 2021-11-03 Wei Zhou , Xin He , Wei Zhong , Junhui Wang

Causal inference is a crucial goal of science, enabling researchers to arrive at meaningful conclusions regarding the predictions of hypothetical interventions using observational data. Path models, Structural Equation Models (SEMs), and,…

Machine Learning · Statistics 2024-01-11 Matthew J. Vowels

Structural learning of directed acyclic graphs (DAGs) or Bayesian networks has been studied extensively under the assumption that data are independent. We propose a new Gaussian DAG model for dependent data which assumes the observations…

Machine Learning · Statistics 2021-07-30 Hangjian Li , Oscar Hernan Madrid Padilla , Qing Zhou