English
Related papers

Related papers: Surrogate-based optimization using an artificial n…

200 papers

Improving predictive understanding of Earth system variability and change requires data-model integration. Efficient data-model integration for complex models requires surrogate modeling to reduce model evaluation time. However, building a…

Machine Learning · Statistics 2019-01-17 Dan Lu , Daniel Ricciuto

Optimization plays an important role in chemical engineering, impacting cost-effectiveness, resource utilization, product quality, and process sustainability metrics. This chapter broadly focuses on data-driven optimization, particularly,…

Optimization and Control · Mathematics 2024-12-19 Mathias Neufang , Emma Pajak , Damien van de Berg , Ye Seol Lee , Ehecatl Antonio del Rio Chanona

Bayesian optimization (BO) is a powerful approach for optimizing black-box, expensive-to-evaluate functions. To enable a flexible trade-off between the cost and accuracy, many applications allow the function to be evaluated at different…

Machine Learning · Computer Science 2021-10-27 Shibo Li , Robert M. Kirby , Shandian Zhe

Explainable AI is a crucial component for edge services, as it ensures reliable decision making based on complex AI models. Surrogate models are a prominent approach of XAI where human-interpretable models, such as a linear regression…

Machine Learning · Computer Science 2025-03-12 Foivos Charalampakos , Thomas Tsouparopoulos , Iordanis Koutsopoulos

Real-world optimisation problems typically have objective functions which cannot be expressed analytically. These optimisation problems are evaluated through expensive physical experiments or simulations. Cheap approximations of the…

Neural and Evolutionary Computing · Computer Science 2022-11-01 Mohamed Z. Variawa , Terence L. Van Zyl , Matthew Woolway

We consider minimizing functions for which it is expensive to compute the (possibly stochastic) gradient. Such functions are prevalent in reinforcement learning, imitation learning and adversarial training. Our target optimization framework…

Machine Learning · Computer Science 2023-06-09 Jonathan Wilder Lavington , Sharan Vaswani , Reza Babanezhad , Mark Schmidt , Nicolas Le Roux

Global optimization of large-scale, complex systems such as multi-physics black-box simulations and real-world industrial systems is important but challenging. This work presents a novel Surrogate-Based Optimization framework based on…

Machine Learning · Computer Science 2026-01-13 Maaz Ahmad , Iftekhar A. Karimi

This paper presents a novel methodology that uses surrogate models in the form of neural networks to reduce the computation time of simulation-based optimization of a reference trajectory. Simulation-based optimization is necessary when…

Optimization and Control · Mathematics 2023-03-31 Evelyn Ruff , Rebecca Russell , Matthew Stoeckle , Piero Miotto , Jonathan P. How

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Numerical Analysis · Mathematics 2022-08-12 Maarten V. de Hoop , Daniel Zhengyu Huang , Elizabeth Qian , Andrew M. Stuart

We develop a new computational framework to solve sequential Bayesian optimal experimental design (SBOED) problems constrained by large-scale partial differential equations with infinite-dimensional random parameters. We propose an adaptive…

Computational Engineering, Finance, and Science · Computer Science 2024-10-04 Jinwoo Go , Peng Chen

Surrogate Optimization (SO) algorithms have shown promise for optimizing expensive black-box functions. However, their performance is heavily influenced by hyperparameters related to sampling and surrogate fitting, which poses a challenge…

Machine Learning · Computer Science 2023-10-13 Nazanin Nezami , Hadis Anahideh

Machine learning methods are increasingly used to build computationally inexpensive surrogates for complex physical models. The predictive capability of these surrogates suffers when data are noisy, sparse, or time-dependent. As we are…

Machine Learning · Computer Science 2024-05-20 A. Diaw , M. McKerns , I. Sagert , L. G. Stanton , M. S. Murillo

Sample efficiency is one of the key factors when applying policy search to real-world problems. In recent years, Bayesian Optimization (BO) has become prominent in the field of robotics due to its sample efficiency and little prior…

Robotics · Computer Science 2020-11-19 Lukas P. Fröhlich , Melanie N. Zeilinger , Edgar D. Klenske

Bayesian optimization (BO) is a promising approach for hyperparameter optimization of deep neural networks (DNNs), where each model training can take minutes to hours. In BO, a computationally cheap surrogate model is employed to learn the…

Machine Learning · Computer Science 2023-09-27 Romain Egele , Isabelle Guyon , Venkatram Vishwanath , Prasanna Balaprakash

The central task in modeling complex dynamical systems is parameter estimation. This task involves numerous evaluations of a computationally expensive objective function. Surrogate-based optimization introduces a computationally efficient…

Machine Learning · Computer Science 2019-12-19 Žiga Lukšič , Jovan Tanevski , Sašo Džeroski , Ljupčo Todorovski

The optimal and robust design of structures has gained much attention in the past ten years due to the ever increasing need for manufacturers to build robust systems at the lowest cost. Reliability-based design optimization (RBDO) allows…

Applications · Statistics 2017-04-12 Vincent Dubourg , Jean-Marc Bourinet , Bruno Sudret

For stochastic process models, parameter inference is often severely bottlenecked by computationally expensive likelihood functions. Simulation-based inference (SBI) bypasses this restriction by constructing amortized surrogate likelihoods,…

Machine Learning · Statistics 2026-05-26 Alexander Shen , Mikael Kuusela

We propose a multi-fidelity neural network surrogate sampling method for the uncertainty quantification of physical/biological systems described by ordinary or partial differential equations. We first generate a set of low/high-fidelity…

Numerical Analysis · Mathematics 2020-05-07 Mohammad Motamed

A surrogate-based topology optimisation algorithm for linear elastic structures under parametric loads and boundary conditions is proposed. Instead of learning the parametric solution of the state (and adjoint) problems or the optimisation…

Numerical Analysis · Mathematics 2025-11-04 Matteo Giacomini , Antonio Huerta

In NeuroEvolution, the topologies of artificial neural networks are optimized with evolutionary algorithms to solve tasks in data regression, data classification, or reinforcement learning. One downside of NeuroEvolution is the large amount…

Neural and Evolutionary Computing · Computer Science 2019-02-12 Jörg Stork , Martin Zaefferer , Thomas Bartz-Beielstein