English
Related papers

Related papers: Penalized Likelihood Methods for Estimation of Spa…

200 papers

Learning graphical structures based on Directed Acyclic Graphs (DAGs) is a challenging problem, partly owing to the large search space of possible graphs. A recent line of work formulates the structure learning problem as a continuous…

Machine Learning · Computer Science 2021-01-12 Ignavier Ng , AmirEmad Ghassami , Kun Zhang

We give methods for Bayesian inference of directed acyclic graphs, DAGs, and the induced causal effects from passively observed complete data. Our methods build on a recent Markov chain Monte Carlo scheme for learning Bayesian networks,…

Machine Learning · Computer Science 2020-11-19 Jussi Viinikka , Antti Hyttinen , Johan Pensar , Mikko Koivisto

The feed-forward relationship naturally observed in time-dependent processes and in a diverse number of real systems -such as some food-webs and electronic and neural wiring- can be described in terms of so-called directed acyclic graphs…

Physics and Society · Physics 2015-05-19 Joaquín Goñi , Bernat Corominas-Murtra , Ricard V. Solé , Carlos Rodríguez-Caso

Learning the structure of causal directed acyclic graphs (DAGs) is useful in many areas of machine learning and artificial intelligence, with wide applications. However, in the high-dimensional setting, it is challenging to obtain good…

Machine Learning · Statistics 2024-05-27 Stephen Smith , Qing Zhou

Estimating the structure of directed acyclic graphs (DAGs) of features (variables) plays a vital role in revealing the latent data generation process and providing causal insights in various applications. Although there have been many…

Machine Learning · Computer Science 2024-03-06 Shaohua Fan , Shuyang Zhang , Xiao Wang , Chuan Shi

We introduce a new method to estimate the Markov equivalence class of a directed acyclic graph (DAG) in the presence of hidden variables, in settings where the underlying DAG among the observed variables is sparse, and there are a few…

Methodology · Statistics 2018-08-07 Benjamin Frot , Preetam Nandy , Marloes H. Maathuis

We present a graph-based technique for estimating sparse covariance matrices and their inverses from high-dimensional data. The method is based on learning a directed acyclic graph (DAG) and estimating parameters of a multivariate Gaussian…

Methodology · Statistics 2010-01-18 Philipp Rütimann , Peter Bühlmann

We consider the problem of regularized maximum likelihood estimation for the structure and parameters of a high-dimensional, sparse directed acyclic graphical (DAG) model with Gaussian distribution, or equivalently, of a Gaussian structural…

Statistics Theory · Mathematics 2013-05-10 Sara van de Geer , Peter Bühlmann

Random directed acyclic graphs (DAGs) based on imposing an order on Erd\H{o}s-R\'enyi and scale free random graphs are widely used for evaluating causal discovery algorithms. We show that in such DAGs, the set of nodes reachable via open…

Methodology · Statistics 2026-05-08 Alexander G. Reisach , Antoine Chambaz , Gilles Blanchard , Sebastian Weichwald

Directed acyclic graphical (DAG) models are a powerful tool for representing causal relationships among jointly distributed random variables, especially concerning data from across different experimental settings. However, it is not always…

Machine Learning · Statistics 2026-04-03 Francisco Madaleno , Pratik Misra , Alex Markham

Recently continuous relaxations have been proposed in order to learn Directed Acyclic Graphs (DAGs) from data by backpropagation, instead of using combinatorial optimization. However, a number of techniques for fully discrete…

Machine Learning · Computer Science 2022-10-28 Andrew J. Wren , Pasquale Minervini , Luca Franceschi , Valentina Zantedeschi

Directed acyclic graph (DAG) learning is a central task in structure discovery and causal inference. Although the field has witnessed remarkable advances over the past few years, it remains statistically and computationally challenging to…

Machine Learning · Statistics 2026-02-09 Ryan Thompson , Edwin V. Bonilla , Robert Kohn

We propose a novel algorithm for efficiently computing a sparse directed adjacency matrix from a group of time series following a causal graph process. Our solution is scalable for both dense and sparse graphs and automatically selects the…

Machine Learning · Statistics 2019-11-19 Théophile Griveau-Billion , Ben Calderhead

Directed Acyclic Graphs (DAGs) are central to uncovering causal structure in complex systems, yet learning a single DAG from data is often challenging: model uncertainty, finite samples, and a combinatorially large search space frequently…

Methodology · Statistics 2026-05-19 Yunan Wu , Yue Wang , Chunlin Li , Chenglong Ye

We consider the problem of inferring the conditional independence graph (CIG) of high-dimensional Gaussian vectors from multi-attribute data. Most existing methods for graph estimation are based on single-attribute models where one…

Machine Learning · Statistics 2025-05-20 Jitendra K Tugnait

Directed acyclic graph (DAG) models are widely used to represent causal relationships among random variables in many application domains. This paper studies a special class of non-Gaussian DAG models, where the conditional variance of each…

Machine Learning · Statistics 2021-11-03 Wei Zhou , Xin He , Wei Zhong , Junhui Wang

Causal discovery, the learning of causality in a data mining scenario, has been of strong scientific and theoretical interest as a starting point to identify "what causes what?" Contingent on assumptions and a proper learning algorithm, it…

Methodology · Statistics 2022-05-23 Gabriel Ruiz , Oscar Hernan Madrid Padilla , Qing Zhou

We establish a new framework for statistical estimation of directed acyclic graphs (DAGs) when data are generated from a linear, possibly non-Gaussian structural equation model. Our framework consists of two parts: (1) inferring the…

Machine Learning · Statistics 2013-11-15 Po-Ling Loh , Peter Bühlmann

Assuming a directed acyclic graph (DAG) that represents prior knowledge of causal relationships between variables is a common starting point for cause-effect estimation. Existing literature typically invokes hypothetical domain expert…

Machine Learning · Statistics 2025-03-11 Kirtan Padh , Zhufeng Li , Cecilia Casolo , Niki Kilbertus

Penalized logistic regression is extremely useful for binary classification with large number of covariates (higher than the sample size), having several real life applications, including genomic disease classification. However, the…

Methodology · Statistics 2023-04-10 Ayanendranath Basu , Abhik Ghosh , María Jaenada , Leandro Pardo