English
Related papers

Related papers: DAGs with NO TEARS: Continuous Optimization for St…

200 papers

We present a method to generate directed acyclic graphs (DAGs) using deep reinforcement learning, specifically deep Q-learning. Generating graphs with specified structures is an important and challenging task in various application fields,…

Machine Learning · Computer Science 2019-06-07 Laura D'Arcy , Padraig Corcoran , Alun Preece

Conventional methods for causal structure learning from data face significant challenges due to combinatorial search space. Recently, the problem has been formulated into a continuous optimization framework with an acyclicity constraint to…

Machine Learning · Computer Science 2022-06-06 Hristo Petkov , Colin Hanley , Feng Dong

Due to its human-interpretability and invariance properties, Directed Acyclic Graph (DAG) has been a foundational tool across various areas of AI research, leading to significant advancements. However, DAG learning remains highly…

Machine Learning · Computer Science 2025-06-24 Naiyu Yin , Tian Gao , Yue Yu

Recently, an intriguing class of non-convex optimization problems has emerged in the context of learning directed acyclic graphs (DAGs). These problems involve minimizing a given loss or score function, subject to a non-convex continuous…

Machine Learning · Statistics 2023-05-30 Chang Deng , Kevin Bello , Bryon Aragam , Pradeep Ravikumar

The feed-forward relationship naturally observed in time-dependent processes and in a diverse number of real systems -such as some food-webs and electronic and neural wiring- can be described in terms of so-called directed acyclic graphs…

Physics and Society · Physics 2015-05-19 Joaquín Goñi , Bernat Corominas-Murtra , Ricard V. Solé , Carlos Rodríguez-Caso

Learning the directed acyclic graph (DAG) structure of a Bayesian network from observational data is a notoriously difficult problem for which many hardness results are known. In this paper we propose a provably polynomial-time algorithm…

Machine Learning · Computer Science 2019-06-04 Asish Ghoshal , Jean Honorio

We develop a framework for learning sparse nonparametric directed acyclic graphs (DAGs) from data. Our approach is based on a recent algebraic characterization of DAGs that led to a fully continuous program for score-based learning of DAG…

Machine Learning · Statistics 2020-03-25 Xun Zheng , Chen Dan , Bryon Aragam , Pradeep Ravikumar , Eric P. Xing

Directed acyclic graphical models (DAGs) are often used to describe common structural properties in a family of probability distributions. This paper addresses the question of classifying DAGs up to an isomorphism. By considering Gaussian…

Information Theory · Computer Science 2014-12-24 Hajir Roozbehani , Yury Polyanskiy

In the context of inferring a Bayesian network structure (directed acyclic graph, DAG for short), we devise a non-reversible continuous time Markov chain, the ``Causal Zig-Zag sampler'', that targets a probability distribution over classes…

Machine Learning · Statistics 2024-09-12 Moritz Schauer , Marcel Wienöbst

A DAG compression of a (typically dense) graph is a simple data structure that stores how vertex clusters are connected, where the clusters are described indirectly as sets of reachable sinks in a directed acyclic graph (DAG). They…

Data Structures and Algorithms · Computer Science 2026-03-24 Florian Chudigiewitsch , Till Tantau , Felix Winkler

The combinatorial problem of learning directed acyclic graphs (DAGs) from data was recently framed as a purely continuous optimization problem by leveraging a differentiable acyclicity characterization of DAGs based on the trace of a matrix…

Machine Learning · Computer Science 2023-01-18 Kevin Bello , Bryon Aragam , Pradeep Ravikumar

Bayesian networks are a widely-used class of probabilistic graphical models capable of representing symmetric conditional independence between variables of interest using the topology of the underlying graph. For categorical variables, they…

Machine Learning · Statistics 2022-10-07 Gherardo Varando , Federico Carli , Manuele Leonelli

Directed acyclic graphs (DAGs) encode a lot of information about a particular distribution in their structure. However, compute required to infer these structures is typically super-exponential in the number of variables, as inference…

Machine Learning · Computer Science 2023-06-13 Jeroen Berrevoets , Nabeel Seedat , Fergus Imrie , Mihaela van der Schaar

Bayesian Networks (BNs) represent conditional probability relations among a set of random variables (nodes) in the form of a directed acyclic graph (DAG), and have found diverse applications in knowledge discovery. We study the problem of…

Optimization and Control · Mathematics 2022-05-10 Simge Kucukyavuz , Ali Shojaie , Hasan Manzour , Linchuan Wei , Hao-Hsiang Wu

We propose a continuous optimization framework for discovering a latent directed acyclic graph (DAG) from observational data. Our approach optimizes over the polytope of permutation vectors, the so-called Permutahedron, to learn a…

Machine Learning · Computer Science 2023-02-14 Valentina Zantedeschi , Luca Franceschi , Jean Kaddour , Matt J. Kusner , Vlad Niculae

Graph-structured data ubiquitously appears in science and engineering. Graph neural networks (GNNs) are designed to exploit the relational inductive bias exhibited in graphs; they have been shown to outperform other forms of neural networks…

Machine Learning · Computer Science 2021-02-03 Veronika Thost , Jie Chen

Directed Acyclic Graphs (DAGs) are solid structures used to describe and infer the dependencies among variables in multivariate scenarios. Having a thorough comprehension of the accurate DAG-generating model is crucial for causal discovery…

Methodology · Statistics 2024-09-09 S. Nazari , M. Arashi , A. Sadeghkhani

We consider the problem of structure learning for bow-free acyclic path diagrams (BAPs). BAPs can be viewed as a generalization of linear Gaussian DAG models that allow for certain hidden variables. We present a first method for this…

Machine Learning · Statistics 2017-12-05 Christopher Nowzohour , Marloes H. Maathuis , Robin J. Evans , Peter Bühlmann

We deal with the combinatorial problem of learning directed acyclic graph (DAG) structure from observational data adhering to a linear structural equation model (SEM). Leveraging advances in differentiable, nonconvex characterizations of…

Machine Learning · Computer Science 2024-03-14 Seyed Saman Saboksayr , Gonzalo Mateos , Mariano Tepper

A structural equation model (SEM) is an effective framework to reason over causal relationships represented via a directed acyclic graph (DAG). Recent advances have enabled effective maximum-likelihood point estimation of DAGs from…

Machine Learning · Computer Science 2021-12-07 Chris Cundy , Aditya Grover , Stefano Ermon