English
Related papers

Related papers: Order-based Structure Learning without Score Equiv…

200 papers

In this work, we present, analyze, and implement a class of Multi-Level Markov chain Monte Carlo (ML-MCMC) algorithms based on independent Metropolis-Hastings proposals for Bayesian inverse problems. In this context, the likelihood function…

Numerical Analysis · Mathematics 2021-05-06 Juan Pablo Madrigal-Cianci , Fabio Nobile , Raul Tempone

We study the Bayesian model averaging approach to learning Bayesian network structures (DAGs) from data. We develop new algorithms including the first algorithm that is able to efficiently sample DAGs according to the exact structure…

Artificial Intelligence · Computer Science 2015-01-20 Ru He , Jin Tian , Huaiqing Wu

Gaussian graphical models are useful tools for conditional independence structure inference of multivariate random variables. Unfortunately, Bayesian inference of latent graph structures is challenging due to exponential growth of…

This paper studies the fundamental problem of learning deep generative models that consist of multiple layers of latent variables organized in top-down architectures. Such models have high expressivity and allow for learning hierarchical…

Machine Learning · Statistics 2020-07-21 Erik Nijkamp , Bo Pang , Tian Han , Linqi Zhou , Song-Chun Zhu , Ying Nian Wu

Public attitudes toward artificial intelligence are heterogeneous, ordinally measured, and poorly captured by any single dependency graph. Existing ordinal structure learners assume a shared directed acyclic graph (DAG) across all…

Machine Learning · Statistics 2026-05-07 Amir Rafe , Subasish Das

Directed acyclic graph (DAG) has been widely employed to represent directional relationships among a set of collected nodes. Yet, the available data in one single study is often limited for accurate DAG reconstruction, whereas heterogeneous…

Machine Learning · Statistics 2023-10-17 Mingyang Ren , Xin He , Junhui Wang

The assumption that data samples are independently identically distributed is the backbone of many learning algorithms. Nevertheless, datasets often exhibit rich structure in practice, and we argue that there exist some unknown order within…

Machine Learning · Computer Science 2019-03-06 Yao-Hung Hubert Tsai , Han Zhao , Ruslan Salakhutdinov , Nebojsa Jojic

We study the problem of learning directed acyclic graphs from continuous observational data, generated according to a linear Gaussian structural equation model. State-of-the-art structure learning methods for this setting have at least one…

Methodology · Statistics 2025-04-03 Tong Xu , Armeen Taeb , Simge Küçükyavuz , Ali Shojaie

Bayesian networks are a powerful framework for studying the dependency structure of variables in a complex system. The problem of learning Bayesian networks is tightly associated with the given data type. Ordinal data, such as stages of…

Methodology · Statistics 2021-11-15 Xiang Ge Luo , Giusi Moffa , Jack Kuipers

Learning the structure of a causal graphical model using both observational and interventional data is a fundamental problem in many scientific fields. A promising direction is continuous optimization for score-based methods, which,…

Machine Learning · Computer Science 2022-02-28 Phillip Lippe , Taco Cohen , Efstratios Gavves

A major problem of causal inference is the arrangement of dependent nodes in a directed acyclic graph (DAG) with path coefficients and observed confounders. Path coefficients do not provide the units to measure the strength of information…

Artificial Intelligence · Computer Science 2015-09-17 Pramod Kumar Parida , Tshilidzi Marwala , Snehashish Chakraverty

Recent works on machine learning for combinatorial optimization have shown that learning based approaches can outperform heuristic methods in terms of speed and performance. In this paper, we consider the problem of finding an optimal…

We study the computational complexity of Markov chain Monte Carlo (MCMC) methods for high-dimensional Bayesian linear regression under sparsity constraints. We first show that a Bayesian approach can achieve variable-selection consistency…

Statistics Theory · Mathematics 2015-06-01 Yun Yang , Martin J. Wainwright , Michael I. Jordan

The posteriors over neural network weights are high dimensional and multimodal. Each mode typically characterizes a meaningfully different representation of the data. We develop Cyclical Stochastic Gradient MCMC (SG-MCMC) to automatically…

Machine Learning · Computer Science 2020-05-13 Ruqi Zhang , Chunyuan Li , Jianyi Zhang , Changyou Chen , Andrew Gordon Wilson

We deal with the combinatorial problem of learning directed acyclic graph (DAG) structure from observational data adhering to a linear structural equation model (SEM). Leveraging advances in differentiable, nonconvex characterizations of…

Machine Learning · Computer Science 2024-03-14 Seyed Saman Saboksayr , Gonzalo Mateos , Mariano Tepper

We extend the decomposition approach for learning Bayesian networks (BNs) proposed by (Xie et. al.) to learning multivariate regression chain graphs (MVR CGs), which include BNs as a special case. The same advantages of this decomposition…

Artificial Intelligence · Computer Science 2020-02-26 Mohammad Ali Javidian , Marco Valtorta

Causal structure learning from observational data remains a non-trivial task due to various factors such as finite sampling, unobserved confounding factors, and measurement errors. Constraint-based and score-based methods tend to suffer…

Machine Learning · Computer Science 2022-11-09 Rezaur Rashid , Jawad Chowdhury , Gabriel Terejanu

Recent advances have established the identifiability of a directed acyclic graph (DAG) under additive noise models (ANMs), spurring the development of various causal discovery methods. However, most existing methods make restrictive model…

Machine Learning · Statistics 2026-04-24 Stella Huang , Qing Zhou

Precise knowledge of causal directed acyclic graphs (DAGs) is assumed for standard approaches towards valid adjustment set selection for unbiased estimation, but in practice, the DAG is often inferred from data or expert knowledge,…

Statistics Theory · Mathematics 2025-11-14 Zhongyi Hu , Stéphanie van der Pas

In the algorithm Intersort, Chevalley et al. (2024) proposed a score-based method to discover the causal order of variables in a Directed Acyclic Graph (DAG) model, leveraging interventional data to outperform existing methods. However, as…

Machine Learning · Computer Science 2024-10-14 Mathieu Chevalley , Arash Mehrjou , Patrick Schwab