English
Related papers

Related papers: Structure Learning with Continuous Optimization: A…

200 papers

Bayesian networks are a class of popular graphical models that encode causal and conditional independence relations among variables by directed acyclic graphs (DAGs). We propose a novel structure learning method, annealing on regularized…

Machine Learning · Statistics 2020-05-04 Qiaoling Ye , Arash A. Amini , Qing Zhou

We present a novel perspective and algorithm for learning directed acyclic graphs (DAGs) from data generated by a linear structural equation model (SEM). First, we show that a linear SEM can be viewed as a linear transform that, in prior…

Machine Learning · Computer Science 2024-06-21 Panagiotis Misiakos , Chris Wendler , Markus Püschel

Although many algorithms have been designed to construct Bayesian network structures using different approaches and principles, they all employ only two methods: those based on independence criteria, and those based on a scoring function…

Artificial Intelligence · Computer Science 2011-07-04 S. Acid , L. M. de Campos

Recently, an intriguing class of non-convex optimization problems has emerged in the context of learning directed acyclic graphs (DAGs). These problems involve minimizing a given loss or score function, subject to a non-convex continuous…

Machine Learning · Statistics 2023-05-30 Chang Deng , Kevin Bello , Bryon Aragam , Pradeep Ravikumar

We develop a novel convolutional architecture tailored for learning from data defined over directed acyclic graphs (DAGs). DAGs can be used to model causal relationships among variables, but their nilpotent adjacency matrices pose unique…

Machine Learning · Computer Science 2024-05-07 Samuel Rey , Hamed Ajorlou , Gonzalo Mateos

Directed acyclic graph (DAG) models are widely used to represent causal relationships among random variables in many application domains. This paper studies a special class of non-Gaussian DAG models, where the conditional variance of each…

Machine Learning · Statistics 2021-11-03 Wei Zhou , Xin He , Wei Zhong , Junhui Wang

Generalization analyses of deep learning typically assume that the training converges to a fixed point. But, recent results indicate that in practice, the weights of deep neural networks optimized with stochastic gradient descent often…

Machine Learning · Computer Science 2022-08-22 Nisha Chandramoorthy , Andreas Loukas , Khashayar Gatmiry , Stefanie Jegelka

We consider the problem of learning the underlying causal structure among a set of variables, which are assumed to follow a Bayesian network or, more specifically, a linear recursive structural equation model (SEM) with the associated…

Statistics Theory · Mathematics 2025-08-05 Anamitra Chaudhuri , Anirban Bhattacharya , Yang Ni

In this article, the optimal sample complexity of learning the underlying interactions or dependencies of a Linear Dynamical System (LDS) over a Directed Acyclic Graph (DAG) is studied. We call such a DAG underlying an LDS as dynamical DAG…

Machine Learning · Statistics 2024-04-02 Mishfad Shaikh Veedu , Deepjyoti Deka , Murti V. Salapaka

Simulations are ubiquitous in machine learning. Especially in graph learning, simulations of Directed Acyclic Graphs (DAG) are being deployed for evaluating new algorithms. In the literature, it was recently argued that…

Machine Learning · Computer Science 2022-06-16 Jonas Seng , Matej Zečević , Devendra Singh Dhami , Kristian Kersting

Heretofore, learning the directed acyclic graphs (DAGs) that encode the cause-effect relationships embedded in observational data is a computationally challenging problem. A recent trend of studies has shown that it is possible to recover…

Machine Learning · Computer Science 2023-07-18 Bao Duong , Thin Nguyen

We describe computationally efficient methods for learning mixtures in which each component is a directed acyclic graphical model (mixtures of DAGs or MDAGs). We argue that simple search-and-score algorithms are infeasible for a variety of…

Machine Learning · Computer Science 2015-05-19 Bo Thiesson , Christopher Meek , David Maxwell Chickering , David Heckerman

Structured learning is appropriate when predicting structured outputs such as trees, graphs, or sequences. Most prior work requires the training set to consist of complete trees, graphs or sequences. Specifying such detailed ground truth…

Machine Learning · Computer Science 2012-07-03 Xinghua Lou , Fred Hamprecht

We study the problem of learning directed acyclic graphs from continuous observational data, generated according to a linear Gaussian structural equation model. State-of-the-art structure learning methods for this setting have at least one…

Methodology · Statistics 2025-04-03 Tong Xu , Armeen Taeb , Simge Küçükyavuz , Ali Shojaie

Mappings to structured output spaces (strings, trees, partitions, etc.) are typically learned using extensions of classification algorithms to simple graphical structures (eg., linear chains) in which search and parameter estimation can be…

Machine Learning · Computer Science 2009-07-07 Hal Daumé , Daniel Marcu

Directed acyclic graphs (DAGs) are a class of graphs commonly used in practice, with examples that include electronic circuits, Bayesian networks, and neural architectures. While many effective encoders exist for DAGs, it remains…

Machine Learning · Computer Science 2025-05-30 Michael Sun , Orion Foo , Gang Liu , Wojciech Matusik , Jie Chen

Learning directed acyclic graphs (DAGs) from data is a challenging task both in theory and in practice, because the number of possible DAGs scales superexponentially with the number of nodes. In this paper, we study the problem of learning…

Machine Learning · Computer Science 2019-04-25 Hasan Manzour , Simge Küçükyavuz , Ali Shojaie

Graph-structured data ubiquitously appears in science and engineering. Graph neural networks (GNNs) are designed to exploit the relational inductive bias exhibited in graphs; they have been shown to outperform other forms of neural networks…

Machine Learning · Computer Science 2021-02-03 Veronika Thost , Jie Chen

The constraints arising from DAG models with latent variables can be naturally represented by means of acyclic directed mixed graphs (ADMGs). Such graphs contain directed and bidirected arrows, and contain no directed cycles. DAGs with…

Machine Learning · Statistics 2012-07-24 Ilya Shpitser , Thomas S. Richardson , James M. Robins , Robin Evans

Estimating the causal structure of observational data is a challenging combinatorial search problem that scales super-exponentially with graph size. Existing methods use continuous relaxations to make this problem computationally tractable…

Machine Learning · Computer Science 2024-02-20 Hamidreza Kamkari , Vahid Balazadeh , Vahid Zehtab , Rahul G. Krishnan