English
Related papers

Related papers: Taylor Approximation Variance Reduction for Approx…

200 papers

This paper introduces a practical sampling method for training surrogate models in the context of uncertainty propagation. We propose a heuristic method to uniformly draw samples within highest density regions of the density given by the…

Methodology · Statistics 2025-09-15 Jocelyn Minini , Micha Wasem

In this work, a method for obtaining pixel-wise error bounds in Bayesian regularization of inverse imaging problems is introduced. The proposed method employs estimates of the posterior variance together with techniques from conformal…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Dominik Narnhofer , Andreas Habring , Martin Holler , Thomas Pock

We propose a general framework for obtaining probabilistic solutions to PDE-based inverse problems. Bayesian methods are attractive for uncertainty quantification but assume knowledge of the likelihood model or data generation process. This…

Methodology · Statistics 2023-09-28 Youngsoo Baek , Wilkins Aquino , Sayan Mukherjee

Variational autoencoder (VAE) is a very successful generative model whose key element is the so called amortized inference network, which can perform test time inference using a single feed forward pass. Unfortunately, this comes at the…

Machine Learning · Computer Science 2021-02-08 Minyoung Kim , Vladimir Pavlovic

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

Specifying a governing physical model in the presence of missing physics and recovering its parameters are two intertwined and fundamental problems in science. Modern machine learning allows one to circumvent these, via emulators and…

Machine Learning · Computer Science 2020-06-30 Daniel J. Tait , Theodoros Damoulas

Expensive optimization problems (EOPs) are prevalent in real-world applications, where the evaluation of a single solution requires a significant amount of resources. In our study of surrogate-assisted evolutionary algorithms (SAEAs) in…

Neural and Evolutionary Computing · Computer Science 2024-12-06 Hao Hao , Xiaoqun Zhang , Aimin Zhou

Trial level surrogates are useful tools for improving the speed and cost effectiveness of trials, but surrogates that have not been properly evaluated can cause misleading results. The evaluation procedure is often contextual and depends on…

Methodology · Statistics 2022-08-23 Michael C Sachs , Erin E Gabriel , Alessio Crippa , Michael J Daniels

Bayesian hierarchical models can provide efficient algorithms for finding sparse solutions to ill-posed inverse problems. The models typically comprise a conditionally Gaussian prior model for the unknown which is augmented by a generalized…

Numerical Analysis · Mathematics 2025-01-09 Jonathan Lindbloom , Jan Glaubitz , Anne Gelb

In this paper we propose a new Bayesian estimation method to solve linear inverse problems in signal and image restoration and reconstruction problems which has the property to be scale invariant. In general, Bayesian estimators are {\em…

Data Analysis, Statistics and Probability · Physics 2007-05-23 A. Mohammad-Djafari , Jérôme Idier

The use of surrogate models instead of computationally expensive simulation codes is very convenient in engineering. Roughly speaking, there are two kinds of surrogate models: the deterministic and the probabilistic ones. These last are…

Applications · Statistics 2015-12-24 Malek Ben Salem , Olivier Roustant , Fabrice Gamboa , Lionel Tomaso

In this paper we propose a new sampling-free approach to solve Bayesian model inversion problems that is an extension of the previously proposed spectral likelihood expansions (SLE) method. Our approach, called stochastic spectral…

Computation · Statistics 2021-04-21 P. -R. Wagner , S. Marelli , B. Sudret

The fundamental computational issues in Bayesian inverse problems (BIP) governed by partial differential equations (PDEs) stem from the requirement of repeated forward model evaluations. A popular strategy to reduce such costs is to replace…

Numerical Analysis · Mathematics 2024-09-05 Zhiwei Gao , Liang Yan , Tao Zhou

In inverse problems, the parameters of a model are estimated based on observations of the model response. The Bayesian approach is powerful for solving such problems; one formulates a prior distribution for the parameter state that is…

Computation · Statistics 2022-06-08 Max Ehre , Rafael Flock , Martin Fußeder , Iason Papaioannou , Daniel Straub

The surrogate-assisted optimization algorithm is a promising approach for solving expensive multi-objective optimization problems. However, most existing surrogate-assisted multi-objective optimization algorithms have three main drawbacks:…

Neural and Evolutionary Computing · Computer Science 2018-11-06 Xi Lin , Hui-Ling Zhen , Zhenhua Li , Qingfu Zhang , Sam Kwong

Many geophysical problems can be cast as inverse problems that estimate a set of parameter values from observed data. Within a Bayesian framework, solutions to such problems are described probabilistically by the so-called posterior…

Geophysics · Physics 2025-07-23 Xuebin Zhao , Andrew Curtis

This paper develops a probabilistic numerical method for solution of partial differential equations (PDEs) and studies application of that method to PDE-constrained inverse problems. This approach enables the solution of challenging inverse…

Methodology · Statistics 2017-07-12 Jon Cockayne , Chris Oates , Tim Sullivan , Mark Girolami

Randomize-then-optimize (RTO) is widely used for sampling from posterior distributions in Bayesian inverse problems. However, RTO may be computationally intensive for complexity problems due to repetitive evaluations of the expensive…

Numerical Analysis · Mathematics 2021-04-14 Liang Yan , Tao Zhou

The statistical consistency of surrogate losses for discrete prediction tasks is often checked via the condition of calibration. However, directly verifying calibration can be arduous. Recent work shows that for polyhedral surrogates, a…

Machine Learning · Computer Science 2025-05-21 Drona Khurana , Anish Thilagar , Dhamma Kimpara , Rafael Frongillo

Engineering and applied science rely on computational experiments to rigorously study physical systems. The mathematical models used to probe these systems are highly complex, and sampling-intensive studies often require prohibitively many…

Methodology · Statistics 2024-06-19 Joy N. Mueller , Khachik Sargsyan , Craig J. Daniels , Habib N. Najm