English
Related papers

Related papers: Efficient Multifidelity Likelihood-Free Bayesian I…

200 papers

Approximate Bayesian Computation (ABC) methods often require extensive simulations, resulting in high computational costs. This paper focuses on multifidelity simulation models and proposes a pre-filtering hierarchical importance sampling…

Computation · Statistics 2026-02-03 Xuefei Cao , Shijia Wang , Yongdao Zhou

Multifidelity methods are widely used for estimating quantities of interest (QoI) in computational science by employing numerical simulations of differing costs and accuracies. Many methods approximate numerical-valued statistics that…

Computation · Statistics 2022-12-02 Yiming Xu , Akil Narayan

We propose a novel approach to allocating resources for expensive simulations of high fidelity models when used in a multifidelity framework. Allocation decisions that distribute computational resources across several simulation models…

Numerical Analysis · Mathematics 2019-01-01 Daniel J. Perry , Robert M. Kirby , Akil Narayan , Ross T. Whitaker

Machine learning techniques typically rely on large datasets to create accurate classifiers. However, there are situations when data is scarce and expensive to acquire. This is the case of studies that rely on state-of-the-art computational…

Machine Learning · Computer Science 2019-10-02 Francisco Sahli Costabal , Paris Perdikaris , Ellen Kuhl , Daniel E. Hurtado

Likelihood-free inference for simulator-based statistical models has developed rapidly from its infancy to a useful tool for practitioners. However, models with more than a handful of parameters still generally remain a challenge for the…

A common method for assessing validity of Bayesian sampling or approximate inference methods makes use of simulated data replicates for parameters drawn from the prior. Under continuity assumptions, quantiles of functions of the simulated…

Computation · Statistics 2019-11-21 Xuejun Yu , David J. Nott , Minh-Ngoc Tran , Nadja Klein

We propose a method to improve the efficiency and accuracy of amortized Bayesian inference by leveraging universal symmetries in the joint probabilistic model of parameters and data. In a nutshell, we invert Bayes' theorem and estimate the…

Machine Learning · Computer Science 2024-07-24 Marvin Schmitt , Desi R. Ivanova , Daniel Habermann , Ullrich Köthe , Paul-Christian Bürkner , Stefan T. Radev

We consider Bayesian optimization of an expensive-to-evaluate black-box objective function, where we also have access to cheaper approximations of the objective. In general, such approximations arise in applications such as reinforcement…

Machine Learning · Statistics 2016-11-16 Matthias Poloczek , Jialei Wang , Peter I. Frazier

Computer models, aiming at simulating a complex real system, are often calibrated in the light of data to improve performance. Standard calibration methods assume that the optimal values of calibration parameters are invariant to the model…

Methodology · Statistics 2017-09-01 Georgios Karagiannis , Bledar A. Konomi , Guang Lin

Bayesian inference allows expressing the uncertainty of posterior belief under a probabilistic model given prior information and the likelihood of the evidence. Predominantly, the likelihood function is only implicitly established by a…

Bayesian inference is a principled framework for dealing with uncertainty. The practitioner can perform an initial assumption for the physical phenomenon they want to model (prior belief), collect some data and then adjust the initial…

Machine Learning · Computer Science 2020-11-10 Vasileios Gkolemis , Michael Gutmann

Estimations of physical parameters using data usually involve non-uniform experimental efficiencies. In this article, a method of maximum likelihood fit is introduced using the efficiency as a weight, while the probability distribution…

Data Analysis, Statistics and Probability · Physics 2023-08-31 Chenxu Yu , Yanxi Zhang

Approximate Bayesian Computation (ABC) provides methods for Bayesian inference in simulation-based stochastic models which do not permit tractable likelihoods. We present a new ABC method which uses probabilistic neural emulator networks to…

Machine Learning · Statistics 2019-05-21 Jan-Matthis Lueckmann , Giacomo Bassetto , Theofanis Karaletsos , Jakob H. Macke

Multifidelity approximate Bayesian computation (MF-ABC) is a likelihood-free technique for parameter inference that exploits model approximations to significantly increase the speed of ABC algorithms (Prescott and Baker, 2020). Previous…

Computation · Statistics 2021-12-23 Thomas P. Prescott , Ruth E. Baker

Bayesian statistics has gained popularity in psychological research due to its intuitive uncertainty quantification and convenient information-updating rules. In many applications, however, prior distributions are introduced merely as…

Methodology · Statistics 2026-03-10 Yang Liu , Jonathan P. Williams , Jan Hannig

Multi-fidelity Gaussian process is a common approach to address the extensive computationally demanding algorithms such as optimization, calibration and uncertainty quantification. Adaptive sampling for multi-fidelity Gaussian process is a…

Machine Learning · Statistics 2019-07-30 Sayan Ghosh , Jesper Kristensen , Yiming Zhang , Waad Subber , Liping Wang

Bayesian inference typically relies on specifying a parametric model that approximates the data-generating process. However, misspecified models can yield poor convergence rates and unreliable posterior calibration. Bayesian empirical…

Methodology · Statistics 2025-10-27 Kenyon Ng , Weichang Yu , Howard D. Bondell

Multi-fidelity methods that use an ensemble of models to compute a Monte Carlo estimator of the expectation of a high-fidelity model can significantly reduce computational costs compared to single-model approaches. These methods use oracle…

Computation · Statistics 2026-03-12 Thomas Dixon , Alex Gorodetsky , John Jakeman , Akil Narayan , Yiming Xu

In this work, we develop a multi-fidelity Bayesian experimental design framework to efficiently quantify the extreme-event statistics of an input-to-response (ItR) system with given input probability and expensive function evaluations. The…

Fluid Dynamics · Physics 2022-01-04 Xianliang Gong , Yulin Pan

Approximate Bayesian computation performs approximate inference for models where likelihood computations are expensive or impossible. Instead simulations from the model are performed for various parameter values and accepted if they are…

Computation · Statistics 2015-12-16 Dennis Prangle