English
Related papers

Related papers: Scaling Up Bayesian DAG Sampling

200 papers

In Bayesian structure learning, we are interested in inferring a distribution over the directed acyclic graph (DAG) structure of Bayesian networks, from data. Defining such a distribution is very challenging, due to the combinatorially…

Machine Learning · Computer Science 2022-06-30 Tristan Deleu , António Góis , Chris Emezue , Mansi Rankawat , Simon Lacoste-Julien , Stefan Bauer , Yoshua Bengio

This paper proposes Bayesian mosaic, a parallelizable composite posterior, for scalable Bayesian inference on a broad class of multivariate discrete data models. Sampling is embarrassingly parallel since Bayesian mosaic is a multiplication…

Methodology · Statistics 2018-04-03 Ye Wang , David Dunson

We consider the problem of learning causal Directed Acyclic Graphs (DAGs) using combinations of observational and interventional experimental data. Current methods tailored to this setting assume that interventions either destroy…

Methodology · Statistics 2023-12-04 Alessandro Mascaro , Federico Castelletti

The adaptive processing of structured data is a long-standing research topic in machine learning that investigates how to automatically learn a mapping from a structured input to outputs of various nature. Recently, there has been an…

Machine Learning · Computer Science 2022-02-28 Federico Errica

We develop a new method to sample from posterior distributions in hierarchical models without using Markov chain Monte Carlo. This method, which is a variant of importance sampling ideas, is generally applicable to high-dimensional models…

Computation · Statistics 2015-03-19 Michael Braun , Paul Damien

We develop Bayesian predictive stacking for geostatistical models, where the primary inferential objective is to provide inference on the latent spatial random field and conduct spatial predictions at arbitrary locations. We exploit…

Methodology · Statistics 2025-09-25 Lu Zhang , Wenpin Tang , Sudipto Banerjee

Advances in sampling schemes for Markov jump processes have recently enabled multiple inferential tasks. However, in statistical and machine learning applications, we often require that these continuous-time models find support on…

Computation · Statistics 2018-06-08 Iker Perez , Lax Chan , Mercedes Torres Torres , James Goulding , Theodore Kypraios

Bayesian model selection provides a powerful framework for objectively comparing models directly from observed data, without reference to ground truth data. However, Bayesian model selection requires the computation of the marginal…

Methodology · Statistics 2024-01-17 Xiaohao Cai , Jason D. McEwen , Marcelo Pereyra

Learning the causal structure that underlies data is a crucial step towards robust real-world decision making. The majority of existing work in causal inference focuses on determining a single directed acyclic graph (DAG) or a Markov…

Machine Learning · Computer Science 2021-06-15 Yashas Annadani , Jonas Rothfuss , Alexandre Lacoste , Nino Scherrer , Anirudh Goyal , Yoshua Bengio , Stefan Bauer

A new methodology for model determination in decomposable graphical Gaussian models is developed. The Bayesian paradigm is used and, for each given graph, a hyper inverse Wishart prior distribution on the covariance matrix is considered.…

Computation · Statistics 2015-03-13 Sophie Donnet , Jean-Michel Marin

Performing exact inference on Bayesian networks is known to be #P-hard. Typically approximate inference techniques are used instead to sample from the distribution on query variables given the values $e$ of evidence variables. Classically,…

Quantum Physics · Physics 2014-10-02 Guang Hao Low , Theodore J. Yoder , Isaac L. Chuang

We introduce and characterise the performance of the Markov chain Monte Carlo (MCMC) inference method Prune Sampling for discrete and deterministic Bayesian networks (BNs). We developed a procedure to obtain the performance of a MCMC…

Computation · Statistics 2019-08-20 Frank Phillipson , Jurriaan Parie , Ron Weikamp

State-of-the-art neural network-based methods for learning summary statistics have delivered promising results for simulation-based likelihood-free parameter inference. Existing approaches require density estimation as a post-processing…

Machine learning provides algorithms that can learn from data and make inferences or predictions on data. Bayesian networks are a class of graphical models that allow to represent a collection of random variables and their condititional…

Artificial Intelligence · Computer Science 2019-01-08 Robert Leppert , Karl-Heinz Zimmermann

Attack graphs are commonly used to analyse the security of medium-sized to large networks. Based on a scan of the network and likelihood information of vulnerabilities, attack graphs can be transformed into Bayesian Attack Graphs (BAGs).…

Cryptography and Security · Computer Science 2021-03-18 Isaac Matthews , John Mace , Sadegh Soudjani , Aad van Moorsel

Often, due to prohibitively large size or to limits to data collecting APIs, it is not possible to work with a complete network dataset and sampling is required. A type of sampling which is consistent with Twitter API restrictions is…

Social and Information Networks · Computer Science 2023-06-27 Naomi A. Arnold , Raul J. Mondragon , Richard G. Clegg

In the modern age of social media and networks, graph representations of real-world phenomena have become an incredibly useful source to mine insights. Often, we are interested in understanding how entities in a graph are interconnected.…

Machine Learning · Computer Science 2021-12-16 Aneesh Komanduri , Justin Zhan

A fundamental task in machine learning and related fields is to perform inference on Bayesian networks. Since exact inference takes exponential time in general, a variety of approximate methods are used. Gibbs sampling is one of the most…

Machine Learning · Computer Science 2015-11-23 Daniel Seita , Haoyu Chen , John Canny

Score-based algorithms that learn the structure of Bayesian networks can be used for both exact and approximate solutions. While approximate learning scales better with the number of variables, it can be computationally expensive in the…

Machine Learning · Computer Science 2022-02-22 Zhigao Guo , Anthony C. Constantinou

In this paper, we study the Bayesian multi-task variable selection problem, where the goal is to select activated variables for multiple related data sets simultaneously. Our proposed method generalizes the spike-and-slab prior to multiple…

Methodology · Statistics 2023-08-15 Guanxun Li , Quan Zhou