English
Related papers

Related papers: Multifidelity Simulation-based Inference for Compu…

200 papers

Many problems in science and engineering require making predictions based on few observations. To build a robust predictive model, these sparse data may need to be augmented with simulated data, especially when the design space is…

Multi-fidelity surrogate learning is important for physical simulation related applications in that it avoids running numerical solvers from scratch, which is known to be costly, and it uses multi-fidelity examples for training and greatly…

Machine Learning · Computer Science 2023-11-10 Zheng Wang , Shibo Li , Shikai Fang , Shandian Zhe

The key task of physical simulation is to solve partial differential equations (PDEs) on discretized domains, which is known to be costly. In particular, high-fidelity solutions are much more expensive than low-fidelity ones. To reduce the…

Machine Learning · Statistics 2020-06-11 Zheng Wang , Wei Xing , Robert Kirby , Shandian Zhe

Simulators often provide the best description of real-world phenomena. However, they also lead to challenging inverse problems because the density they implicitly define is often intractable. We present a new suite of simulation-based…

Machine Learning · Statistics 2020-02-25 Johann Brehmer , Gilles Louppe , Juan Pavez , Kyle Cranmer

Multifidelity uncertainty propagation combines the efficiency of low-fidelity models with the accuracy of a high-fidelity model to construct statistical estimators of quantities of interest. It is well known that the effectiveness of such…

Computation · Statistics 2026-01-06 James E. Warner , Geoffrey F. Bomarito , Gianluca Geraci , Michael S. Eldred

Neural networks (NNs) are often used as surrogates or emulators of partial differential equations (PDEs) that describe the dynamics of complex systems. A virtually negligible computational cost of such surrogates renders them an attractive…

Numerical Analysis · Mathematics 2021-05-04 Dong H. Song , Daniel M. Tartakovsky

Stochastic variational inference makes it possible to approximate posterior distributions induced by large datasets quickly using stochastic optimization. The algorithm relies on the use of fully factorized variational distributions.…

Machine Learning · Computer Science 2014-11-27 Matthew D. Hoffman , David M. Blei

Multi-fidelity Monte Carlo methods leverage low-fidelity and surrogate models for variance reduction to make tractable uncertainty quantification even when numerically simulating the physical systems of interest with high-fidelity models is…

Numerical Analysis · Mathematics 2022-11-22 Ionut-Gabriel Farcas , Benjamin Peherstorfer , Tobias Neckel , Frank Jenko , Hans-Joachim Bungartz

Likelihood-free inference refers to inference when a likelihood function cannot be explicitly evaluated, which is often the case for models based on simulators. Most of the literature is based on sample-based `Approximate Bayesian…

Machine Learning · Statistics 2018-11-22 Conor Durkan , George Papamakarios , Iain Murray

This paper examines Bayesian belief network inference using simulation as a method for computing the posterior probabilities of network variables. Specifically, it examines the use of a method described by Henrion, called logic sampling,…

Artificial Intelligence · Computer Science 2013-04-11 Homer L. Chin , Gregory F. Cooper

We present multimodal neural posterior estimation (MultiNPE), a method to integrate heterogeneous data from different sources in simulation-based inference with neural networks. Inspired by advances in deep fusion, it allows researchers to…

Machine Learning · Computer Science 2024-11-05 Marvin Schmitt , Leona Odole , Stefan T. Radev , Paul-Christian Bürkner

Posterior probabilistic statistical inference without priors is an important but so far elusive goal. Fisher's fiducial inference, Dempster-Shafer theory of belief functions, and Bayesian inference with default priors are attempts to…

Statistics Theory · Mathematics 2013-03-26 Ryan Martin , Chuanhai Liu

We analyze a lightweight simulation-based inference method that infers simulator parameters using only a regression-based projection of the observed data. After fitting a surrogate linear regression once, the procedure simulates small…

Methodology · Statistics 2026-02-04 Arya Farahi , Jonah Rose , Paul Torrey

Renewable energy projects, such as large offshore wind farms, are critical to achieving low-emission targets set by governments. Stochastic computer models allow us to explore future scenarios to aid decision making whilst considering the…

Methodology · Statistics 2021-12-07 Jack C. Kennedy , Daniel A. Henderson , Kevin J. Wilson

Despite the successful implementations of physics-informed neural networks in different scientific domains, it has been shown that for complex nonlinear systems, achieving an accurate model requires extensive hyperparameter tuning, network…

Computational Engineering, Finance, and Science · Computer Science 2022-11-30 Milad Ramezankhani , Amir Nazemi , Apurva Narayan , Heinz Voggenreiter , Mehrtash Harandi , Rudolf Seethaler , Abbas S. Milani

Bayesian inference is an effective approach for solving statistical learning problems especially with uncertainty and incompleteness. However, inference efficiencies are physically limited by the bottlenecks of conventional computing…

Emerging Technologies · Computer Science 2017-11-06 Xiaotao Jia , Jianlei Yang , Zhaohao Wang , Yiran Chen , Hai , Li , Weisheng Zhao

We introduce a multi-fidelity estimator of covariance matrices that employs the log-Euclidean geometry of the symmetric positive-definite manifold. The estimator fuses samples from a hierarchy of data sources of differing fidelities and…

Computation · Statistics 2023-05-30 Aimee Maurais , Terrence Alsup , Benjamin Peherstorfer , Youssef Marzouk

We consider the problem of optimizing a robot morphology to achieve the best performance for a target task, under computational resource limitations. The evaluation process for each morphological design involves learning a controller for…

Robotics · Computer Science 2020-12-10 Sha Hu , Zeshi Yang , Greg Mori

In this paper, we study the multiscale Boltzmann equation with multi-dimensional random parameters by a bi-fidelity stochastic collocation (SC) method developed in [A. Narayan, C. Gittelson and D. Xiu, SIAM J. Sci. Comput., 36 (2014); X.…

Numerical Analysis · Mathematics 2020-01-29 Liu Liu , Xueyu Zhu

How can we efficiently gather information to optimize an unknown function, when presented with multiple, mutually dependent information sources with different costs? For example, when optimizing a robotic system, intelligently trading off…

Machine Learning · Computer Science 2018-11-05 Jialin Song , Yuxin Chen , Yisong Yue