English
Related papers

Related papers: Partition MCMC for inference on acyclic digraphs

200 papers

Score-based approaches in the structure learning task are thriving because of their scalability. Continuous relaxation has been the key reason for this advancement. Despite achieving promising outcomes, most of these methods are still…

Machine Learning · Computer Science 2023-09-07 Quang-Duy Tran , Phuoc Nguyen , Bao Duong , Thin Nguyen

In many applications, data often arise from multiple groups that may share similar characteristics. A joint estimation method that models several groups simultaneously can be more efficient than estimating parameters in each group…

Methodology · Statistics 2020-08-17 Kyoungjae Lee , Xuan Cao

MCMC methods for sampling from the space of DAGs can mix poorly due to the local nature of the proposals that are commonly used. It has been shown that sampling from the space of node orders yields better results [FK03, EW06]. Recently,…

Machine Learning · Computer Science 2012-06-26 Daniel Eaton , Kevin Murphy

When working with multimodal Bayesian posterior distributions, Markov chain Monte Carlo (MCMC) algorithms have difficulty moving between modes, and default variational or mode-based approximate inferences will understate posterior…

Methodology · Statistics 2021-11-19 Yuling Yao , Aki Vehtari , Andrew Gelman

We give methods for Bayesian inference of directed acyclic graphs, DAGs, and the induced causal effects from passively observed complete data. Our methods build on a recent Markov chain Monte Carlo scheme for learning Bayesian networks,…

Machine Learning · Computer Science 2020-11-19 Jussi Viinikka , Antti Hyttinen , Johan Pensar , Mikko Koivisto

Bayesian network is a frequently-used method for fault detection and diagnosis in industrial processes. The basis of Bayesian network is structure learning which learns a directed acyclic graph (DAG) from data. However, the search space…

Artificial Intelligence · Computer Science 2023-02-07 Zhichao Chen , Zhiqiang Ge

We present clustering methods for multivariate data exploiting the underlying geometry of the graphical structure between variables. As opposed to standard approaches that assume known graph structures, we first estimate the edge structure…

Methodology · Statistics 2015-09-28 Sayantan Banerjee , Rehan Akbani , Veerabhadran Baladandayuthapani

We consider a a collection of categorical random variables. Of special interest is the causal effect on an outcome variable following an intervention on another variable. Conditionally on a Directed Acyclic Graph (DAG), we assume that the…

Methodology · Statistics 2023-06-29 Federico Castelletti , Guido Consonni , Marco Luigi Della Vedova

The posteriors over neural network weights are high dimensional and multimodal. Each mode typically characterizes a meaningfully different representation of the data. We develop Cyclical Stochastic Gradient MCMC (SG-MCMC) to automatically…

Machine Learning · Computer Science 2020-05-13 Ruqi Zhang , Chunyuan Li , Jianyi Zhang , Changyou Chen , Andrew Gordon Wilson

Directed Acyclic Graphs (DAGs) are solid structures used to describe and infer the dependencies among variables in multivariate scenarios. Having a thorough comprehension of the accurate DAG-generating model is crucial for causal discovery…

Methodology · Statistics 2024-09-09 S. Nazari , M. Arashi , A. Sadeghkhani

Bayesian inference of Bayesian network structures is often performed by sampling directed acyclic graphs along an appropriately constructed Markov chain. We present two techniques to improve sampling. First, we give an efficient…

Machine Learning · Computer Science 2025-10-30 Daniele Nikzad , Alexander Zhilkin , Juha Harviainen , Jack Kuipers , Giusi Moffa , Mikko Koivisto

We present a sequential sampling methodology for weakly structural Markov laws, arising naturally in a Bayesian structure learning context for decomposable graphical models. As a key component of our suggested approach, we show that the…

Statistics Theory · Mathematics 2019-09-04 Jimmy Olsson , Tetyana Pavlenko , Felix L. Rios

Structural learning of directed acyclic graphs (DAGs) or Bayesian networks has been studied extensively under the assumption that data are independent. We propose a new Gaussian DAG model for dependent data which assumes the observations…

Machine Learning · Statistics 2021-07-30 Hangjian Li , Oscar Hernan Madrid Padilla , Qing Zhou

Gaussian graphical models are useful tools for conditional independence structure inference of multivariate random variables. Unfortunately, Bayesian inference of latent graph structures is challenging due to exponential growth of…

Learning the structure of dependence relations between variables is a pervasive issue in the statistical literature. A directed acyclic graph (DAG) can represent a set of conditional independences, but different DAGs may encode the same set…

Methodology · Statistics 2021-02-15 Federico Castelletti , Stefano Peluso

In many domains, we are interested in analyzing the structure of the underlying distribution, e.g., whether one variable is a direct parent of the other. Bayesian model-selection attempts to find the MAP model and use its structure to…

Machine Learning · Computer Science 2013-01-18 Nir Friedman , Daphne Koller

Estimating the structure of Bayesian networks as directed acyclic graphs (DAGs) from observational data is a fundamental challenge, particularly in causal discovery. Bayesian approaches excel by quantifying uncertainty and addressing…

Machine Learning · Computer Science 2026-02-17 Edwin V. Bonilla , Pantelis Elinas , He Zhao , Maurizio Filippone , Vassili Kitsios , Terry O'Kane

We consider the simulation of Bayesian statistical inverse problems governed by large-scale linear and nonlinear partial differential equations (PDEs). Markov chain Monte Carlo (MCMC) algorithms are standard techniques to solve such…

Numerical Analysis · Mathematics 2021-02-09 Harbir Antil , Howard C Elman , Akwum Onwunta , Deepanshu Verma

Uncertainty estimation in deep models is essential in many real-world applications and has benefited from developments over the last several years. Recent evidence suggests that existing solutions dependent on simple Gaussian formulations…

Machine Learning · Computer Science 2022-05-11 Jurijs Nazarovs , Ronak R. Mehta , Vishnu Suresh Lokhande , Vikas Singh

Bayesian inference promises to ground and improve the performance of deep neural networks. It promises to be robust to overfitting, to simplify the training procedure and the space of hyperparameters, and to provide a calibrated measure of…

Machine Learning · Computer Science 2019-08-12 Jonathan Heek , Nal Kalchbrenner