English
Related papers

Related papers: Multi-modal Bayesian Neural Network Surrogates wit…

200 papers

Bayesian optimization is a highly efficient approach to optimizing objective functions which are expensive to query. These objectives are typically represented by Gaussian process (GP) surrogate models which are easy to optimize and support…

Machine Learning · Computer Science 2024-05-09 Yucen Lily Li , Tim G. J. Rudner , Andrew Gordon Wilson

Inverse modeling for computing a high-dimensional spatially-varying property field from indirect sparse and noisy observations is a challenging problem. This is due to the complex physical system of interest often expressed in the form of…

Computational Physics · Physics 2021-02-22 Govinda Anantha Padmanabha , Nicholas Zabaras

In Bayesian inverse problems, surrogate models are often constructed to speed up the computational procedure, as the parameter-to-data map can be very expensive to evaluate. However, due to the curse of dimensionality and the nonlinear…

Numerical Analysis · Mathematics 2020-03-03 Liang Yan , Tao Zhou

Bayesian optimization (BO) methods often rely on the assumption that the objective function is well-behaved, but in practice, this is seldom true for real-world objectives even if noise-free observations can be collected. Common approaches,…

Machine Learning · Statistics 2020-09-10 Erik Bodin , Markus Kaiser , Ieva Kazlauskaite , Zhenwen Dai , Neill D. F. Campbell , Carl Henrik Ek

Deep learning has proven to be effective in a wide variety of loss minimization problems. However, many applications of interest, like minimizing projected Bellman error and min-max optimization, cannot be modelled as minimizing a scalar…

Machine Learning · Computer Science 2025-05-27 Ryan D'Orazio , Danilo Vucetic , Zichu Liu , Junhyung Lyle Kim , Ioannis Mitliagkas , Gauthier Gidel

Explainable AI is a crucial component for edge services, as it ensures reliable decision making based on complex AI models. Surrogate models are a prominent approach of XAI where human-interpretable models, such as a linear regression…

Machine Learning · Computer Science 2025-03-12 Foivos Charalampakos , Thomas Tsouparopoulos , Iordanis Koutsopoulos

Bayesian optimization (BO) is a widely used method for data-driven optimization that generally relies on zeroth-order data of objective function to construct probabilistic surrogate models. These surrogates guide the…

Machine Learning · Computer Science 2025-08-08 Georgios Makrygiorgos , Joshua Hang Sai Ip , Ali Mesbah

Multi-fidelity methods leverage low-cost surrogate models to speed up computations and make occasional recourse to expensive high-fidelity models to establish accuracy guarantees. Because surrogate and high-fidelity models are used…

Numerical Analysis · Mathematics 2021-09-14 Terrence Alsup , Benjamin Peherstorfer

Stochastic Petri Nets (SPNs) are an increasingly popular tool of choice for modeling discrete-event dynamics in areas such as epidemiology and systems biology, yet their parameter estimation remains challenging in general and in particular…

Machine Learning · Computer Science 2025-12-09 Bright Kwaku Manu , Trevor Reckell , Beckett Sterner , Petar Jevtic

Predictive estimation, which comprises model calibration, model prediction, and validation, is a common objective when performing inverse uncertainty quantification (UQ) in diverse scientific applications. These techniques typically require…

Numerical Analysis · Mathematics 2024-07-17 Ningxin Yang , Truong Le , Lidija Zdravković , David M. Potts

Bayesian optimization has been shown to be a powerful tool for solving black box problems during online accelerator optimization. The major advantage of Bayesian based optimization techniques is the ability to include prior information…

Accelerator Physics · Physics 2022-11-17 Connie Xu , Ryan Roussel , Auralee Edelen

We propose a novel training method based on nonlinear multilevel minimization techniques, commonly used for solving discretized large scale partial differential equations. Our multilevel training method constructs a multilevel hierarchy by…

Machine Learning · Computer Science 2020-06-30 Vanessa Braglia , Alena Kopaničáková , Rolf Krause

Crash simulations play an essential role in improving vehicle safety, design optimization, and injury risk estimation. Unfortunately, numerical solutions of such problems using state-of-the-art high-fidelity models require significant…

Machine Learning · Computer Science 2024-02-16 Jonas Kneifl , Jörg Fehr , Steven L. Brunton , J. Nathan Kutz

The Linear Parameter-Varying (LPV) framework enables the construction of surrogate models of complex nonlinear and high-dimensional systems, facilitating efficient stability and performance analysis together with controller design. Despite…

Systems and Control · Electrical Eng. & Systems 2026-04-01 E. Javier Olucha , Valentin Preda , Amritam Das , Roland Tóth

Oilfield development related decisions are made using reservoir simulation-based optimization study in which different production scenarios and well controls are compared. Such simulations are computationally expensive and so surrogate…

Machine Learning · Computer Science 2022-03-01 Ajitabh Kumar

Surrogate endpoints are very important in regulatory decision-making in healthcare, in particular if they can be measured early compared to the long-term final clinical outcome and act as good predictors of clinical benefit. Bivariate…

Solving optimization problems with unknown parameters often requires learning a predictive model to predict the values of the unknown parameters and then solving the problem using these values. Recent work has shown that including the…

Machine Learning · Computer Science 2020-10-23 Kai Wang , Bryan Wilder , Andrew Perrault , Milind Tambe

Systematic exploration of Agent-Based Models (ABMs) is challenged by the curse of dimensionality and their inherent stochasticity. We present a multi-stage pipeline integrating the systematic design of experiments with machine learning…

Machine Learning · Computer Science 2026-04-07 Paul Saves , Matthieu Mastio , Nicolas Verstaevel , Benoit Gaudou

Supervised Machine Learning (SML) algorithms, such as Gradient Boosting, Random Forest, and Neural Networks, have become popular in recent years due to their superior predictive performance over traditional statistical methods. However,…

Machine Learning · Statistics 2020-07-30 Linwei Hu , Jie Chen , Vijayan N. Nair , Agus Sudjianto

For stochastic process models, parameter inference is often severely bottlenecked by computationally expensive likelihood functions. Simulation-based inference (SBI) bypasses this restriction by constructing amortized surrogate likelihoods,…

Machine Learning · Statistics 2026-05-26 Alexander Shen , Mikael Kuusela