English
Related papers

Related papers: Importance Sampling in Bayesian Networks: An Influ…

200 papers

We propose a new sampling-based approach for approximate inference in filtering problems. Instead of approximating conditional distributions with a finite set of states, as done in particle filters, our approach approximates the…

Machine Learning · Computer Science 2020-03-03 Xuan Su , Wee Sun Lee , Zhen Zhang

In this paper we introduce Refractor Importance Sampling (RIS), an improvement to reduce error variance in Bayesian network importance sampling propagation under evidential reasoning. We prove the existence of a collection of importance…

Artificial Intelligence · Computer Science 2012-06-18 Haohai Yu , Robert A. van Engelen

Preferential sampling is a common feature in geostatistics and occurs when the locations to be sampled are chosen based on information about the phenomena under study. In this case, point pattern models are commonly used as the probability…

Methodology · Statistics 2022-10-27 Douglas Mateus da Silva , Dani Gamerman

Many contemporary machine learning models require extensive tuning of hyperparameters to perform well. A variety of methods, such as Bayesian optimization, have been developed to automate and expedite this process. However, tuning remains…

Machine Learning · Computer Science 2020-02-25 Setareh Ariafar , Zelda Mariet , Ehsan Elhamifar , Dana Brooks , Jennifer Dy , Jasper Snoek

We propose an efficient method for Bayesian network inference in models with functional dependence. We generalize the multiplicative factorization method originally designed by Takikawa and D Ambrosio(1999) FOR models WITH independence OF…

Artificial Intelligence · Computer Science 2013-01-07 Jirka Vomlel

Stochastic sampling algorithms, while an attractive alternative to exact algorithms in very large Bayesian network models, have been observed to perform poorly in evidential reasoning with extremely unlikely evidence. To address this…

Artificial Intelligence · Computer Science 2011-06-02 J. Cheng , M. J. Druzdzel

In this note, we shortly survey some recent approaches on the approximation of the Bayes factor used in Bayesian hypothesis testing and in Bayesian model choice. In particular, we reassess importance sampling, harmonic mean sampling, and…

Computation · Statistics 2015-05-13 Christian P. Robert , Darren Wraith

We consider the problem of selecting important nodes in a random network, where the nodes connect to each other randomly with certain transition probabilities. The node importance is characterized by the stationary probabilities of the…

Methodology · Statistics 2019-01-14 Haidong Li , Xiaoyun Xu , Yijie Peng , Chun-Hung Chen

We develop the theory and practice of an approach to modelling and probabilistic inference in causal networks that is suitable when application-specific or analysis-specific constraints should inform such inference or when little or no data…

Artificial Intelligence · Computer Science 2017-05-16 Paul Beaumont , Michael Huth

We present a new inference method based on approximate Bayesian computation for estimating parameters governing an entire network based on link-traced samples of that network. To do this, we first take summary statistics from an observed…

Computation · Statistics 2017-01-17 Jack Davis , Steven K. Thompson

Bayesian neural networks (BNNs) have received an increased interest in the last years. In BNNs, a complete posterior distribution of the unknown weight and bias parameters of the network is produced during the training stage. This…

Machine Learning · Computer Science 2023-04-14 Yunshi Huang , Emilie Chouzenoux , Victor Elvira , Jean-Christophe Pesquet

Importance sampling is a popular method for efficient computation of various properties of a distribution such as probabilities, expectations, quantiles etc. The output of an importance sampling algorithm can be represented as a weighted…

Probability · Mathematics 2016-04-18 Henrik Hult , Pierre Nyquist

Importance sampling is a popular technique in Bayesian inference: by reweighting samples drawn from a proposal distribution we are able to obtain samples and moment estimates from a Bayesian posterior over latent variables. Recent work,…

Computation · Statistics 2024-06-19 Sam Bowyer , Thomas Heap , Laurence Aitchison

Implementing Bayesian inference is often computationally challenging in applications involving complex models, and sometimes calculating the likelihood itself is difficult. Synthetic likelihood is one approach for carrying out inference…

Computation · Statistics 2021-03-15 David T. Frazier , David J. Nott , Christopher Drovandi , Robert Kohn

A new method is proposed for exploiting causal independencies in exact Bayesian network inference. A Bayesian network can be viewed as representing a factorization of a joint probability into the multiplication of a set of conditional…

Artificial Intelligence · Computer Science 2014-11-17 N. L. Zhang , D. Poole

We consider Bayesian optimization of the output of a network of functions, where each function takes as input the output of its parent nodes, and where the network takes significant time to evaluate. Such problems arise, for example, in…

Machine Learning · Computer Science 2022-01-03 Raul Astudillo , Peter I. Frazier

This paper describes a class of probabilistic approximation algorithms based on bucket elimination which offer adjustable levels of accuracy and efficiency. We analyze the approximation for several tasks: finding the most probable…

Artificial Intelligence · Computer Science 2013-02-08 Rina Dechter , Irina Rish

Doubly intractable distributions arise in many settings, for example in Markov models for point processes and exponential random graph models for networks. Bayesian inference for these models is challenging because they involve intractable…

Computation · Statistics 2019-04-03 Jaewoo Park , Murali Haran

Recently developed particle flow algorithms provide an alternative to importance sampling for drawing particles from a posterior distribution, and a number of particle filters based on this principle have been proposed. Samples are drawn…

Computation · Statistics 2014-12-01 Pete Bunch , Simon Godsill

We consider Bayesian inference by importance sampling when the likelihood is analytically intractable but can be unbiasedly estimated. We refer to this procedure as importance sampling squared (IS2), as we can often estimate the likelihood…

Methodology · Statistics 2016-07-26 Minh-Ngoc Tran , Marcel Scharth , Michael K. Pitt , Robert Kohn