English
Related papers

Related papers: CoLiDE: Concomitant Linear DAG Estimation

200 papers

Learning directed acyclic graphs (DAGs) from data is a challenging task both in theory and in practice, because the number of possible DAGs scales superexponentially with the number of nodes. In this paper, we study the problem of learning…

Machine Learning · Computer Science 2019-04-25 Hasan Manzour , Simge Küçükyavuz , Ali Shojaie

This paper studies causal discovery for a directed acyclic graph under a structural equation model with additive heteroscedastic errors. We first establish new identifiability results for location-scale noise models, showing that…

Methodology · Statistics 2026-05-27 Xintao Xia , Li Chen , Yue Hu , Chunlin Li

The constraints arising from DAG models with latent variables can be naturally represented by means of acyclic directed mixed graphs (ADMGs). Such graphs contain directed and bidirected arrows, and contain no directed cycles. DAGs with…

Machine Learning · Statistics 2012-07-24 Ilya Shpitser , Thomas S. Richardson , James M. Robins , Robin Evans

We consider the problem of learning causal directed acyclic graphs from an observational joint distribution. One can use these graphs to predict the outcome of interventional experiments, from which data are often not available. We show…

Machine Learning · Statistics 2016-08-18 Jonas Peters , Joris Mooij , Dominik Janzing , Bernhard Schölkopf

We analyze the landscape and training dynamics of diagonal linear networks in a linear regression task, with the network parameters being perturbed by small isotropic normal noise. The addition of such noise may be interpreted as a…

Machine Learning · Computer Science 2025-03-18 Gabriel Clara , Sophie Langer , Johannes Schmidt-Hieber

Recently, structure learning of directed acyclic graphs (DAGs) has been formulated as a continuous optimization problem by leveraging an algebraic characterization of acyclicity. The constrained problem is solved using the augmented…

Machine Learning · Computer Science 2022-04-12 Ignavier Ng , Sébastien Lachapelle , Nan Rosemary Ke , Simon Lacoste-Julien , Kun Zhang

The ability of deep neural networks to learn hierarchical features is widely regarded as a key mechanism underlying their success in high-dimensional learning. Existing theory partially supports this view by establishing approximation rates…

Machine Learning · Statistics 2026-05-26 Shuo Huang , Lorenzo Fiorito , Lorenzo Rosasco , Tomaso Poggio

Learning DAG or Bayesian network models is an important problem in multi-variate causal inference. However, a number of challenges arises in learning large-scale DAG models including model identifiability and computational complexity since…

Machine Learning · Statistics 2017-05-01 Gunwoong Park , Garvesh Raskutti

We consider the problem of estimating differences in two multi-attribute Gaussian graphical models (GGMs) which are known to have similar structure, using a penalized D-trace loss function with non-convex penalties. The GGM structure is…

Machine Learning · Statistics 2025-05-16 Jitendra K Tugnait

Directed acyclic graphs (DAGs) are commonly used to model causal relationships among random variables. In general, learning the DAG structure is both computationally and statistically challenging. Moreover, without additional information,…

Machine Learning · Statistics 2024-03-26 Ali Shojaie , Wenyu Chen

Directed Acyclic Graphical (DAG) models efficiently formulate causal relationships in complex systems. Traditional DAGs assume nodes to be scalar variables, characterizing complex systems under a facile and oversimplified form. This paper…

Methodology · Statistics 2024-04-23 Tian Lan , Ziyue Li , Junpeng Lin , Zhishuai Li , Lei Bai , Man Li , Fugee Tsung , Rui Zhao , Chen Zhang

The paper explores the use of dynamic adaptation gain/step size (DAG) for improving the adaptation transient performance of variable step-size LMS (VS-LMS) adaptation algorithms. A generic form for the implementation of the DAG within the…

Optimization and Control · Mathematics 2024-04-22 Ioan Doré Landau , Dariusz Bismor , Tudor-Bogdan Airimitoaie , Bernard Vau , Gabriel Buche

Causal discovery, the learning of causality in a data mining scenario, has been of strong scientific and theoretical interest as a starting point to identify "what causes what?" Contingent on assumptions and a proper learning algorithm, it…

Methodology · Statistics 2022-05-23 Gabriel Ruiz , Oscar Hernan Madrid Padilla , Qing Zhou

Leveraging labelled data from multiple domains to enable prediction in another domain without labels is a significant, yet challenging problem. To address this problem, we introduce the framework DAPDAG (\textbf{D}omain \textbf{A}daptation…

Machine Learning · Computer Science 2022-08-03 Yanke Li , Hatt Tobias , Ioana Bica , Mihaela van der Schaar

Fitting nonlinear dynamical models to sparse and noisy observations is fundamentally challenging. Identifying dynamics requires data assimilation (DA) to estimate system states, but DA requires an accurate dynamical model. To break this…

Machine Learning · Computer Science 2024-09-12 Vadim Zinchenko , David S. Greenberg

This paper discusses algorithms for learning causal DAGs. The PC algorithm makes no assumptions other than the faithfulness to the causal model and can identify only up to the Markov equivalence class. LiNGAM assumes linearity and…

Machine Learning · Computer Science 2026-05-08 Ming Cai , Penggang Gao , Hisayuki Hara

This paper demonstrates how to recover causal graphs from the score of the data distribution in non-linear additive (Gaussian) noise models. Using score matching algorithms as a building block, we show how to design a new generation of…

Directed Acyclic Graphs (DAGs) are a standard tool in causal modeling, but their suitability for capturing the complexity of large-scale multimodal data is questionable. In practice, real-world multimodal datasets are often collected from…

Machine Learning · Computer Science 2026-03-03 Yuhang Liu , Zhen Zhang , Dong Gong , Erdun Gao , Biwei Huang , Mingming Gong , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

We propose a continuous optimization framework for discovering a latent directed acyclic graph (DAG) from observational data. Our approach optimizes over the polytope of permutation vectors, the so-called Permutahedron, to learn a…

Machine Learning · Computer Science 2023-02-14 Valentina Zantedeschi , Luca Franceschi , Jean Kaddour , Matt J. Kusner , Vlad Niculae

We propose a joint order-based scoring framework for causal structure learning of directed acyclic graph (DAG) models under heterogeneous data settings. We show that leveraging heterogeneity improves the accuracy of causal ordering…

Methodology · Statistics 2026-05-18 Hyunwoong Chang , Fariha Taskin