English
Related papers

Related papers: Importance Sampling in Bayesian Networks: An Influ…

200 papers

This paper is concerned with Bayesian inference when the likelihood is analytically intractable but can be unbiasedly estimated. We propose an annealed importance sampling procedure for estimating expectations with respect to the posterior.…

Methodology · Statistics 2014-02-26 M. -N. Tran , C. Strickland , M. K. Pitt , R. Kohn

In solving simulation-based stochastic root-finding or optimization problems that involve rare events, such as in extreme quantile estimation, running crude Monte Carlo can be prohibitively inefficient. To address this issue, importance…

Methodology · Statistics 2021-02-23 Shengyi He , Guangxin Jiang , Henry Lam , Michael C. Fu

One of the most effective methods of channel pruning is to trim on the basis of the importance of each neuron. However, measuring the importance of each neuron is an NP-hard problem. Previous works have proposed to trim by considering the…

Machine Learning · Computer Science 2021-12-07 Bilan Lai , Haoran Xiang , Furao Shen

In recent years, researchers in decision analysis and artificial intelligence (AI) have used Bayesian belief networks to build models of expert opinion. Using standard methods drawn from the theory of computational complexity, workers in…

Artificial Intelligence · Computer Science 2013-04-05 R. Martin Chavez , Gregory F. Cooper

To infer the parameters of mechanistic models with intractable likelihoods, techniques such as approximate Bayesian computation (ABC) are increasingly being adopted. One of the main disadvantages of ABC in practical situations, however, is…

Computation · Statistics 2018-08-03 Jonathan U Harrison , Ruth E Baker

Sample size derivation is a crucial element of the planning phase of any confirmatory trial. A sample size is typically derived based on constraints on the maximal acceptable type I error rate and a minimal desired power. Here, power…

We investigate in this paper an alternative method to simulation based recursive importance sampling procedure to estimate the optimal change of measure for Monte Carlo simulations. We propose an algorithm which combines (vector and…

Probability · Mathematics 2011-09-20 Noufel Frikha , Abass Sagna

We show how to use a variational approximation to the logistic function to perform approximate inference in Bayesian networks containing discrete nodes with continuous parents. Essentially, we convert the logistic function to a Gaussian,…

Artificial Intelligence · Computer Science 2013-01-30 Kevin Murphy

Approximate Bayesian Computation (ABC) provides methods for Bayesian inference in simulation-based stochastic models which do not permit tractable likelihoods. We present a new ABC method which uses probabilistic neural emulator networks to…

Machine Learning · Statistics 2019-05-21 Jan-Matthis Lueckmann , Giacomo Bassetto , Theofanis Karaletsos , Jakob H. Macke

The note studies the problem of selecting a good enough subset out of a finite number of alternatives under a fixed simulation budget. Our work aims to maximize the posterior probability of correctly selecting a good subset. We formulate…

Optimization and Control · Mathematics 2023-05-09 Gongbo Zhang , Bin Chen , Qing-shan Jia , Yijie Peng

Bayesian inference has theoretical attractions as a principled framework for reasoning about beliefs. However, the motivations of Bayesian inference which claim it to be the only 'rational' kind of reasoning do not apply in practice. They…

Machine Learning · Statistics 2022-11-14 Sebastian Farquhar

Importance sampling is a Monte Carlo method which designs estimators of expectations under a target distribution using weighted samples from a proposal distribution. When the target distribution is complex, such as multimodal distributions…

Methodology · Statistics 2026-02-04 Anas Cherradi , Yazid Janati , Alain Durmus , Sylvain Le Corff , Yohan Petetin , Julien Stoehr

Approximate Bayesian Computation (ABC) has become increasingly prominent as a method for conducting parameter inference in a range of challenging statistical problems, most notably those characterized by an intractable likelihood function.…

We provide a method for approximating Bayesian inference using rejection sampling. We not only make the process efficient, but also dramatically reduce the memory required relative to conventional methods by combining rejection sampling…

Machine Learning · Computer Science 2015-12-04 Nathan Wiebe , Christopher Granade , Ashish Kapoor , Krysta M Svore

Neural networks are popular state-of-the-art models for many different tasks.They are often trained via back-propagation to find a value of the weights that correctly predicts the observed data. Although back-propagation has shown good…

Machine Learning · Statistics 2020-12-29 Simón Rodríguez Santana , Daniel Hernández-Lobato

Variational Bayesian Inference is a popular methodology for approximating posterior distributions over Bayesian neural network weights. Recent work developing this class of methods has explored ever richer parameterizations of the…

We demonstrate and explicate Bayesian methods for fitting the parameters that encode the impact of short-distance physics on observables in effective field theories (EFTs). We use Bayes' theorem together with the principle of maximum…

High Energy Physics - Phenomenology · Physics 2009-08-14 Matthias R. Schindler , Daniel R. Phillips

Approximate Bayesian computation (ABC) is a simulation-based likelihood-free method applicable to both model selection and parameter estimation. ABC parameter estimation requires the ability to forward simulate datasets from a candidate…

Methodology · Statistics 2020-11-10 Louis Raynal , Sixing Chen , Antonietta Mira , Jukka-Pekka Onnela

Several strategies have been developed recently to ensure valid inference after model selection; some of these are easy to compute, while others fare better in terms of inferential power. In this paper, we consider a selective inference…

Methodology · Statistics 2022-07-13 Snigdha Panigrahi , Jonathan Taylor

Influence propagation has been the subject of extensive study due to its important role in social networks, epidemiology, and many other areas. Understanding propagation mechanisms is critical to control the spread of fake news or…

Optimization and Control · Mathematics 2022-09-28 Vinicius Ferreira , Artur Pessoa , Thibaut Vidal