English
Related papers

Related papers: From graphs to DAGs: a low-complexity model and a …

200 papers

Learning graphical structures based on Directed Acyclic Graphs (DAGs) is a challenging problem, partly owing to the large search space of possible graphs. A recent line of work formulates the structure learning problem as a continuous…

Machine Learning · Computer Science 2021-01-12 Ignavier Ng , AmirEmad Ghassami , Kun Zhang

We deal with the combinatorial problem of learning directed acyclic graph (DAG) structure from observational data adhering to a linear structural equation model (SEM). Leveraging advances in differentiable, nonconvex characterizations of…

Machine Learning · Computer Science 2024-03-14 Seyed Saman Saboksayr , Gonzalo Mateos , Mariano Tepper

We explore if it is possible to learn a directed acyclic graph (DAG) from data without imposing explicitly the acyclicity constraint. In particular, for Gaussian distributions, we frame structural learning as a sparse matrix factorization…

Machine Learning · Statistics 2020-06-05 Gherardo Varando

Learning directed acyclic graphs (DAGs) from data is a challenging task both in theory and in practice, because the number of possible DAGs scales superexponentially with the number of nodes. In this paper, we study the problem of learning…

Machine Learning · Computer Science 2019-04-25 Hasan Manzour , Simge Küçükyavuz , Ali Shojaie

Recently, an intriguing class of non-convex optimization problems has emerged in the context of learning directed acyclic graphs (DAGs). These problems involve minimizing a given loss or score function, subject to a non-convex continuous…

Machine Learning · Statistics 2023-05-30 Chang Deng , Kevin Bello , Bryon Aragam , Pradeep Ravikumar

Learning causal relationships between variables is a well-studied problem in statistics, with many important applications in science. However, modeling real-world systems remain challenging, as most existing algorithms assume that the…

We establish a new framework for statistical estimation of directed acyclic graphs (DAGs) when data are generated from a linear, possibly non-Gaussian structural equation model. Our framework consists of two parts: (1) inferring the…

Machine Learning · Statistics 2013-11-15 Po-Ling Loh , Peter Bühlmann

Adaptive gradient methods like Adagrad and its variants are widespread in large-scale optimization. However, their use of diagonal preconditioning matrices limits the ability to capture parameter correlations. Full-matrix adaptive methods,…

Machine Learning · Computer Science 2025-09-01 Tatyana Matveeva , Aleksandr Katrutsa , Evgeny Frolov

Discovering the causal relationship via recovering the directed acyclic graph (DAG) structure from the observed data is a well-known challenging combinatorial problem. When there are latent variables, the problem becomes even more…

Machine Learning · Statistics 2023-11-02 Yunfeng Cai , Xu Li , Minging Sun , Ping Li

Recent progress in large language models has renewed interest in how multi-step reasoning is represented internally. While prior work often treats reasoning as a linear chain, many reasoning problems are more naturally modeled as directed…

Computation and Language · Computer Science 2026-04-07 Tianjun Zhong , Linyang He , Nima Mesgarani

Simulations are ubiquitous in machine learning. Especially in graph learning, simulations of Directed Acyclic Graphs (DAG) are being deployed for evaluating new algorithms. In the literature, it was recently argued that…

Machine Learning · Computer Science 2022-06-16 Jonas Seng , Matej Zečević , Devendra Singh Dhami , Kristian Kersting

Recently continuous relaxations have been proposed in order to learn Directed Acyclic Graphs (DAGs) from data by backpropagation, instead of using combinatorial optimization. However, a number of techniques for fully discrete…

Machine Learning · Computer Science 2022-10-28 Andrew J. Wren , Pasquale Minervini , Luca Franceschi , Valentina Zantedeschi

New biological assays like Perturb-seq link highly parallel CRISPR interventions to a high-dimensional transcriptomic readout, providing insight into gene regulatory networks. Causal gene regulatory networks can be represented by directed…

Machine Learning · Statistics 2024-02-22 Albert Xue , Jingyou Rao , Sriram Sankararaman , Harold Pimentel

We introduce a novel class of labeled directed acyclic graph (LDAG) models for finite sets of discrete variables. LDAGs generalize earlier proposals for allowing local structures in the conditional probability distribution of a node, such…

Machine Learning · Statistics 2014-11-12 Johan Pensar , Henrik Nyman , Timo Koski , Jukka Corander

Directed acyclic graphs (DAGs) are commonly used to represent causal relationships among random variables in graphical models. Applications of these models arise in the study of physical, as well as biological systems, where directed edges…

Machine Learning · Statistics 2009-12-01 Ali Shojaie , George Michailidis

Recovering underlying Directed Acyclic Graph (DAG) structures from observational data is highly challenging due to the combinatorial nature of the DAG-constrained optimization problem. Recently, DAG learning has been cast as a continuous…

Machine Learning · Computer Science 2022-12-23 Zhen Zhang , Ignavier Ng , Dong Gong , Yuhang Liu , Ehsan M Abbasnejad , Mingming Gong , Kun Zhang , Javen Qinfeng Shi

Bayesian networks represent relations between variables using a directed acyclic graph (DAG). Learning the DAG is an NP-hard problem and exact learning algorithms are feasible only for small sets of variables. We propose two scalable…

Machine Learning · Computer Science 2021-07-02 Pierre Gillot , Pekka Parviainen

To date, most directed acyclic graphs (DAGs) structure learning approaches require data to be stored in a central server. However, due to the consideration of privacy protection, data owners gradually refuse to share their personalized raw…

Machine Learning · Computer Science 2023-01-18 Erdun Gao , Junjia Chen , Li Shen , Tongliang Liu , Mingming Gong , Howard Bondell

We study the problem of reducing test-time acquisition costs in classification systems. Our goal is to learn decision rules that adaptively select sensors for each example as necessary to make a confident prediction. We model our system as…

Machine Learning · Statistics 2015-10-27 Joseph Wang , Kirill Trapeznikov , Venkatesh Saligrama

Recovering the underlying Directed Acyclic Graph (DAG) structures from observational data presents a formidable challenge, partly due to the combinatorial nature of the DAG-constrained optimization problem. Recently, researchers have…

Machine Learning · Computer Science 2025-03-26 Zhen Zhang , Ignavier Ng , Dong Gong , Yuhang Liu , Mingming Gong , Biwei Huang , Kun Zhang , Anton van den Hengel , Javen Qinfeng Shi