English
Related papers

Related papers: Bayesian Emulation of Grey-Box Multi-Model Ensembl…

200 papers

Engineers are often faced with the decision to select the most appropriate model for simulating the behavior of engineered systems, among a candidate set of models. Experimental monitoring data can generate significant value by supporting…

Applications · Statistics 2023-10-17 Antonios Kamariotis , Eleni Chatzi

There is a long history in machine learning of model ensembling, beginning with boosting and bagging and continuing to the present day. Much of this history has focused on combining models for classification and regression, but recently…

Machine Learning · Computer Science 2024-05-28 Ira Globus-Harris , Varun Gupta , Michael Kearns , Aaron Roth

The dynamic emulation of non-linear deterministic computer codes where the output is a time series, possibly multivariate, is examined. Such computer models simulate the evolution of some real-world phenomenon over time, for example models…

Machine Learning · Statistics 2022-03-22 Hossein Mohammadi , Peter Challenor , Marc Goodfellow

The construction of decision-theoretic Bayesian designs for realistically-complex nonlinear models is computationally challenging, as it requires the optimization of analytically intractable expected utility functions over high-dimensional…

Methodology · Statistics 2016-07-01 Antony Overstall , David Woods

Optimizing discrete black-box functions is key in several domains, e.g. protein engineering and drug design. Due to the lack of gradient information and the need for sample efficiency, Bayesian optimization is an ideal candidate for these…

Recently Quantum Computation has generated a lot of interest due to the discovery of a quantum algorithm which can factor large numbers in polynomial time. The usefulness of a quantum com puter is limited by the effect of errors. Simulation…

Quantum Physics · Physics 2007-05-23 Kevin M. Obenland , Alvin M. Despain

Numerical simulations of physical systems exhibit discrepancies arising from unmodeled physics and idealizations, as well as numerical approximation errors stemming from discretization and solver tolerances. This article reviews techniques…

Computational Physics · Physics 2026-01-23 Danny Smyl

Bayesian optimisation is a powerful method for optimising black-box functions, popular in settings where the true function is expensive to evaluate and no gradient information is available. Bayesian optimisation can improve responses to…

Machine Learning · Computer Science 2025-05-27 Sigrid Passano Hellan , Christopher G. Lucas , Nigel H. Goddard

This paper describes methods for comparative evaluation of the interpretability of models of high dimensional time series data inferred by unsupervised machine learning algorithms. The time series data used in this investigation were logs…

Artificial Intelligence · Computer Science 2020-05-05 Nicholas Hoernle , Kobi Gal , Barbara Grosz , Leilah Lyons , Ada Ren , Andee Rubin

Bayesian optimization has emerged as a highly effective tool for the safe online optimization of systems, due to its high sample efficiency and noise robustness. To further enhance its efficiency, reduced physical models of the system can…

Machine Learning · Computer Science 2024-06-18 Jannis O. Lübsen , Christian Hespe , Annika Eichler

Existing Bayesian Optimization (BO) methods typically balance exploration and exploitation to optimize costly objective functions. However, these methods often suffer from a significant one-step bias, which may lead to convergence towards…

Machine Learning · Computer Science 2025-10-23 Ruiyao Miao , Junren Xiao , Shiya Tsang , Hui Xiong , Yingnian Wu

Traditional models of climate change use complex systems of coupled equations to simulate physical processes across the Earth system. These simulations are highly computationally expensive, limiting our predictions of climate change and…

Closed-loop performance of sequential decision making algorithms, such as model predictive control, depends strongly on the choice of controller parameters. Bayesian optimization allows learning of parameters from closed-loop experiments,…

Systems and Control · Electrical Eng. & Systems 2025-11-18 Sebastian Hirt , Lukas Theiner , Rolf Findeisen

Computer simulations have become an important tool across the biomedical sciences and beyond. For many important problems several different models or hypotheses exist and choosing which one best describes reality or observed data is not…

Quantitative Methods · Quantitative Biology 2010-01-20 Tina Toni , Michael P. H. Stumpf

The vast majority of stochastic simulation models are imperfect in that they fail to exactly emulate real system dynamics. The inexactness of the simulation model, or model discrepancy, can impact the predictive accuracy and usefulness of…

Methodology · Statistics 2017-07-21 Matthew Plumlee , Henry Lam

The process of calibrating computer models of natural phenomena is essential for applications in the physical sciences, where plenty of domain knowledge can be embedded into simulations and then calibrated against real observations. Current…

Machine Learning · Computer Science 2025-01-20 Rafael Oliveira , Dino Sejdinovic , David Howard , Edwin V. Bonilla

Stochastic process models are now commonly used to analyse complex biological, ecological and industrial systems. Increasingly there is a need to deliver accurate estimates of model parameters and assess model fit by optimizing the timing…

Computation · Statistics 2018-09-18 Colin S. Gillespie , Richard J. Boys

The analysis of computer models can be aided by the construction of surrogate models, or emulators, that statistically model the numerical computer model. Increasingly, computer models are becoming stochastic, yielding different outputs…

Methodology · Statistics 2020-04-10 Evan Baker , Peter Challenor , Matt Eames

The performance of many machine learning models depends on their hyper-parameter settings. Bayesian Optimization has become a successful tool for hyper-parameter optimization of machine learning algorithms, which aims to identify optimal…

Machine Learning · Computer Science 2020-08-04 Lidan Wang , Franck Dernoncourt , Trung Bui

Black-box optimization is often encountered for decision-making in complex systems management, where the knowledge of system is limited. Under these circumstances, it is essential to balance the utilization of new information with…

Computation · Statistics 2025-01-15 Teng Lian , Jian-Qiang Hu , Yuhang Wu , Zeyu Zheng