English
Related papers

Related papers: Adaptive quadrature schemes for Bayesian inference…

200 papers

Gathering labeled data to train well-performing machine learning models is one of the critical challenges in many applications. Active learning aims at reducing the labeling costs by an efficient and effective allocation of costly labeling…

Machine Learning · Computer Science 2020-06-03 Daniel Kottke , Marek Herde , Christoph Sandrock , Denis Huseljic , Georg Krempl , Bernhard Sick

Recursive Bayesian inference, in which posterior beliefs are updated in light of accumulating data, is a tool for implementing Bayesian models in applications with streaming and/or very large data sets. As the posterior of one iteration…

Methodology · Statistics 2025-08-05 Henry R. Scharf

The Bayesian approach to Inverse Problems relies predominantly on Markov Chain Monte Carlo methods for posterior inference. The typical nonlinear concentration of posterior measure observed in many such Inverse Problems presents severe…

Computation · Statistics 2016-02-17 Shiwei Lan , Tan Bui-Thanh , Mike Christie , Mark Girolami

Active learning of Gaussian process (GP) surrogates has been useful for optimizing experimental designs for physical/computer simulation experiments, and for steering data acquisition schemes in machine learning. In this paper, we develop a…

Machine Learning · Computer Science 2025-09-10 Chiwoo Park , Robert Waelder , Bonggwon Kang , Benji Maruyama , Soondo Hong , Robert Gramacy

Approximate Bayesian computation (ABC) refers to a family of inference methods used in the Bayesian analysis of complex models where evaluation of the likelihood is difficult. Conventional ABC methods often suffer from the curse of…

Computation · Statistics 2016-07-08 Jingjing Li , David J. Nott , Yanan Fan , Scott A. Sisson

Integration over non-negative integrands is a central problem in machine learning (e.g. for model averaging, (hyper-)parameter marginalisation, and computing posterior predictive distributions). Bayesian Quadrature is a probabilistic…

Machine Learning · Statistics 2018-12-05 Ed Wagstaff , Saad Hamid , Michael Osborne

Running a reliability analysis on engineering problems involving complex numerical models can be computationally very expensive, requiring advanced simulation methods to reduce the overall numerical cost. Gaussian process based active…

Machine Learning · Statistics 2020-12-01 Morgane Menz , Sylvain Dubreuil , Jérôme Morio , Christian Gogu , Nathalie Bartoli , Marie Chiron

Scenarios requiring humans to choose from multiple seemingly optimal actions are commonplace, however standard imitation learning often fails to capture this behavior. Instead, an over-reliance on replicating expert actions induces…

Robotics · Computer Science 2022-11-08 Hanbit Oh , Hikaru Sasaki , Brendan Michael , Takamitsu Matsubara

This paper focuses on variational inference with intractable likelihood functions that can be unbiasedly estimated. A flexible variational approximation based on Gaussian mixtures is developed, by adopting the mixture population Monte Carlo…

Numerical Analysis · Mathematics 2021-12-02 Zhijian He , Shifeng Huo , Tianhui Yang

In computational inverse problems, it is common that a detailed and accurate forward model is approximated by a computationally less challenging substitute. The model reduction may be necessary to meet constraints in computing time when…

Methodology · Statistics 2018-02-14 Daniela Calvetti , Matthew M. Dunlop , Erkki Somersalo , Andrew M. Stuart

Model-based approaches bear great promise for decision making of agents interacting with the physical world. In the context of spatial environments, different types of problems such as localisation, mapping, navigation or autonomous…

Machine Learning · Statistics 2019-06-21 Atanas Mirchev , Baris Kayalibay , Maximilian Soelch , Patrick van der Smagt , Justin Bayer

We consider the utilization of a computational model to guide the optimal acquisition of experimental data to inform the stochastic description of model input parameters. Our formulation is based on the recently developed consistent…

Computation · Statistics 2021-05-04 Scott N. Walsh , Tim M. Wildey , John D. Jakeman

We develop and analyze a method for stochastic simulation optimization based on Gaussian process models within a trust-region framework. We focus on settings where the variance of the objective function is large, making accurate estimation…

Optimization and Control · Mathematics 2026-03-10 Mickael Binois , Jeffrey Larson

Estimating the predictive uncertainty of a Bayesian learning model is critical in various decision-making problems, e.g., reinforcement learning, detecting adversarial attack, self-driving car. As the model posterior is almost always…

Machine Learning · Computer Science 2021-02-16 Yufei Cui , Wuguannan Yao , Qiao Li , Antoni B. Chan , Chun Jason Xue

The data-centric construction of inexpensive surrogates for fine-grained, physical models has been at the forefront of computational physics due to its significant utility in many-query tasks such as uncertainty quantification. Recent…

Machine Learning · Statistics 2021-03-17 Maximilian Rixner , Phaedon-Stelios Koutsourelakis

Bayesian optimal experimental design provides a principled framework for selecting experimental settings that maximize obtained information. In this work, we focus on estimating the expected information gain in the setting where the…

Machine Learning · Statistics 2025-10-02 Chuntao Chen , Tapio Helin , Nuutti Hyvönen , Yuya Suzuki

Current methods for learning graphical models with latent variables and a fixed structure estimate optimal values for the model parameters. Whereas this approach usually produces overfitting and suboptimal generalization performance,…

Machine Learning · Computer Science 2013-01-30 Hagai Attias

Both Approximate Bayesian Computation (ABC) and composite likelihood methods are useful for Bayesian and frequentist inference, respectively, when the likelihood function is intractable. We propose to use composite likelihood score…

Computation · Statistics 2015-02-25 Erlis Ruli , Nicola Sartori , Laura Ventura

Understanding the properties of transient gravitational waves and their sources is of broad interest in physics and astronomy. Bayesian inference is the standard framework for astro-physical measurement in transient gravitational-wave…

General Relativity and Quantum Cosmology · Physics 2020-10-07 Rory Smith , Gregory Ashton , Avi Vajpeyi , Colm Talbot

Modern simulation-based inference techniques use neural networks to solve inverse problems efficiently. One notable strategy is neural posterior estimation (NPE), wherein a neural network parameterizes a distribution to approximate the…

Instrumentation and Methods for Astrophysics · Physics 2024-03-06 Alex Kolmus , Justin Janquart , Tomasz Baka , Twan van Laarhoven , Chris Van Den Broeck , Tom Heskes