English
Related papers

Related papers: Improving parameter learning of Bayesian nets from…

200 papers

Comparing competing mathematical models of complex natural processes is a shared goal among many branches of science. The Bayesian probabilistic framework offers a principled way to perform model comparison and extract useful metrics for…

We compare the accuracy, precision and reliability of different methods for estimating key system parameters for two-level systems subject to Hamiltonian evolution and decoherence. It is demonstrated that the use of Bayesian modelling and…

Quantum Physics · Physics 2019-10-15 Sophie Schirmer , Frank Langbein

Bayesian network modelling is a well adapted approach to study messy and highly correlated datasets which are very common in, e.g., systems epidemiology. A popular approach to learn a Bayesian network from an observational datasets is to…

Machine Learning · Statistics 2018-08-06 Gilles Kratzer , Reinhard Furrer

A Bayesian net (BN) is more than a succinct way to encode a probabilistic distribution; it also corresponds to a function used to answer queries. A BN can therefore be evaluated by the accuracy of the answers it returns. Many algorithms for…

Artificial Intelligence · Computer Science 2013-02-08 Russell Greiner , Adam J. Grove , Dale Schuurmans

Exponential random graph models (ERGMs) are a widely used framework for network data, enabling hypothesis testing on the structural mechanisms underlying observed networks. Bayesian ERGMs provide principled uncertainty quantification and…

Methodology · Statistics 2026-05-26 Alberto Caimo , Isabella Gollini

We study the problem of learning Bayesian network structures from data. We develop an algorithm for finding the k-best Bayesian network structures. We propose to compute the posterior probabilities of hypotheses of interest by Bayesian…

Machine Learning · Computer Science 2012-03-19 Jin Tian , Ru He , Lavanya Ram

Learning a Bayesian networks with bounded treewidth is important for reducing the complexity of the inferences. We present a novel anytime algorithm (k-MAX) method for this task, which scales up to thousands of variables. Through extensive…

Artificial Intelligence · Computer Science 2018-02-08 Mauro Scanagatta , Giorgio Corani , Marco Zaffalon , Jaemin Yoo , U Kang

The Expectation-Maximization (EM) algorithm has been predominantly used to approximate the maximum likelihood estimation of the location-scale Gaussian mixtures. However, when the models are over-specified, namely, the chosen number of…

Machine Learning · Statistics 2022-05-24 Tongzheng Ren , Fuheng Cui , Sujay Sanghavi , Nhat Ho

We introduce semiparametric Bayesian networks that combine parametric and nonparametric conditional probability distributions. Their aim is to incorporate the advantages of both components: the bounded complexity of parametric models and…

Machine Learning · Computer Science 2021-09-08 David Atienza , Concha Bielza , Pedro Larrañaga

Approximate Bayesian inference on the basis of summary statistics is well-suited to complex problems for which the likelihood is either mathematically or computationally intractable. However the methods that use rejection suffer from the…

Computation · Statistics 2010-05-04 M. G. B. Blum , O. Francois

After experimenting with a number of non-probabilistic methods for dealing with uncertainty many researchers reaffirm a preference for probability methods [1] [2], although this remains controversial. The importance of being able to form…

Artificial Intelligence · Computer Science 2013-04-11 Thomas Slack

The willingness to trust predictions formulated by automatic algorithms is key in a vast number of domains. However, a vast number of deep architectures are only able to formulate predictions without an associated uncertainty. In this…

Image and Video Processing · Electrical Eng. & Systems 2022-09-28 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Implementing Bayesian inference is often computationally challenging in applications involving complex models, and sometimes calculating the likelihood itself is difficult. Synthetic likelihood is one approach for carrying out inference…

Computation · Statistics 2021-03-15 David T. Frazier , David J. Nott , Christopher Drovandi , Robert Kohn

We discuss Bayesian methods for learning Bayesian networks when data sets are incomplete. In particular, we examine asymptotic approximations for the marginal likelihood of incomplete data given a Bayesian network. We consider the Laplace…

Machine Learning · Computer Science 2015-05-19 David Maxwell Chickering , David Heckerman

In industrial machine learning pipelines, data often arrive in parts. Particularly in the case of deep neural networks, it may be too expensive to train the model from scratch each time, so one would rather use a previously learned model…

Machine Learning · Statistics 2018-03-29 Max Kochurov , Timur Garipov , Dmitry Podoprikhin , Dmitry Molchanov , Arsenii Ashukha , Dmitry Vetrov

Bayesian optimal experimental design provides a principled framework for selecting experimental settings that maximize obtained information. In this work, we focus on estimating the expected information gain in the setting where the…

Machine Learning · Statistics 2025-10-02 Chuntao Chen , Tapio Helin , Nuutti Hyvönen , Yuya Suzuki

In applications of Bayesian procedures, once a class of priors has been chosen, it may be tempting to fix the prior's hyperparameters from the data, in an empirical Bayes (EB) fashion, usually by their maximum marginal likelihood estimates…

Statistics Theory · Mathematics 2026-04-14 Stefano Rizzelli , Judith Rousseau , Sonia Petrone

The purpose of this note is to show how the method of maximum entropy in the mean (MEM) may be used to improve parametric estimation when the measurements are corrupted by large level of noise. The method is developed in the context on a…

Machine Learning · Computer Science 2021-08-23 Henryk Gzyl , Enrique ter Horst

Inferring the causal structure of a system typically requires interventional data, rather than just observational data. Since interventional experiments can be costly, it is preferable to select interventions that yield the maximum amount…

Methodology · Statistics 2021-03-30 Michele Zemplenyi , Jeffrey W. Miller

In this paper, we bridge the gap between hyperparameter optimization and ensemble learning by performing Bayesian optimization of an ensemble with regards to its hyperparameters. Our method consists in building a fixed-size ensemble,…

Machine Learning · Computer Science 2016-05-23 Julien-Charles Lévesque , Christian Gagné , Robert Sabourin