English
Related papers

Related papers: Error Analysis of Surrogate Models Constructed thr…

200 papers

This paper presents a methodological framework for training, self-optimising, and self-organising surrogate models to approximate and speed up multiobjective optimisation of technical systems based on multiphysics simulations. At the hand…

Machine Learning · Computer Science 2024-04-04 Diego Botache , Jens Decke , Winfried Ripken , Abhinay Dornipati , Franz Götz-Hahn , Mohamed Ayeb , Bernhard Sick

The central task in modeling complex dynamical systems is parameter estimation. This task involves numerous evaluations of a computationally expensive objective function. Surrogate-based optimization introduces a computationally efficient…

Machine Learning · Computer Science 2019-12-19 Žiga Lukšič , Jovan Tanevski , Sašo Džeroski , Ljupčo Todorovski

Driven by increased complexity of dynamical systems, the solution of system of differential equations through numerical simulation in optimization problems has become computationally expensive. This paper provides a smart data driven…

Optimization and Control · Mathematics 2021-08-25 Kainat Khowaja , Mykhaylo Shcherbatyy , Wolfgang Karl Härdle

Offline design optimization problem arises in numerous science and engineering applications including material and chemical design, where expensive online experimentation necessitates the use of in silico surrogate functions to predict and…

Machine Learning · Computer Science 2025-03-05 Minh Hoang , Azza Fadhel , Aryan Deshwal , Janardhan Rao Doppa , Trong Nghia Hoang

One method to solve expensive black-box optimization problems is to use a surrogate model that approximates the objective based on previous observed evaluations. The surrogate, which is cheaper to evaluate, is optimized instead to find an…

Optimization and Control · Mathematics 2021-05-28 Rickard Karlsson , Laurens Bliek , Sicco Verwer , Mathijs de Weerdt

Computational design problems arise in a number of settings, from synthetic biology to computer architectures. In this paper, we aim to solve data-driven model-based optimization (MBO) problems, where the goal is to find a design input that…

Machine Learning · Computer Science 2021-07-15 Brandon Trabucco , Aviral Kumar , Xinyang Geng , Sergey Levine

The goal of offline black-box optimization (BBO) is to optimize an expensive black-box function using a fixed dataset of function evaluations. Prior works consider forward approaches that learn surrogates to the black-box function and…

Machine Learning · Computer Science 2023-08-22 Siddarth Krishnamoorthy , Satvik Mehul Mashkaria , Aditya Grover

Complex black-box predictive models may have high performance, but lack of interpretability causes problems like lack of trust, lack of stability, sensitivity to concept drift. On the other hand, achieving satisfactory accuracy of…

Machine Learning · Computer Science 2020-02-12 Alicja Gosiewska , Przemyslaw Biecek

Offline optimization aims to maximize a black-box objective function with a static dataset and has wide applications. In addition to the objective function being black-box and expensive to evaluate, numerous complex real-world problems…

Machine Learning · Computer Science 2024-06-07 Ke Xue , Rong-Xi Tan , Xiaobin Huang , Chao Qian

We consider the problem of offline black-box optimization, where the goal is to discover optimal designs (e.g., molecules or materials) from past experimental data. A key challenge in this setting is data scarcity: in many scientific…

Machine Learning · Computer Science 2026-05-22 Azza Fadhel , The Hung Tran , Trong Nghia Hoang , Jana Doppa

In many applications of mathematical optimization, one may wish to optimize an objective function without access to its derivatives. These situations call for derivative-free optimization (DFO) methods. Among the most successful approaches…

Optimization and Control · Mathematics 2025-12-11 Abraar Chaudhry , Katya Scheinberg

Derivative-free optimization (DFO) has recently gained a lot of momentum in machine learning, spawning interest in the community to design faster methods for problems where gradients are not accessible. While some attention has been given…

Optimization and Control · Mathematics 2020-08-04 Yuwen Chen , Antonio Orvieto , Aurelien Lucchi

Derivative-free optimization problems are optimization problems where derivative information is unavailable. The least Frobenius norm updating quadratic interpolation model function is one of the essential under-determined model functions…

Optimization and Control · Mathematics 2023-11-21 Pengcheng Xie , Ya-xiang Yuan

Some real problems require the evaluation of expensive and noisy objective functions. Moreover, the analytical expression of these objective functions may be unknown. These functions are known as black-boxes, for example, estimating the…

Machine Learning · Statistics 2021-07-12 Lucia Asencio Martín , Eduardo C. Garrido-Merchán

Bayesian Optimization (BO) is a powerful method for optimizing black-box functions by combining prior knowledge with ongoing function evaluations. BO constructs a probabilistic surrogate model of the objective function given the covariates,…

Machine Learning · Statistics 2025-08-26 Roi Naveiro , Becky Tang

Structured optimization problems are ubiquitous in fields like data science and engineering. The goal in structured optimization is using a prescribed set of points, called atoms, to build up a solution that minimizes or maximizes a given…

Optimization and Control · Mathematics 2021-01-14 Andrea Cristofari , Francesco Rinaldi

Data-driven optimization has found many successful applications in the real world and received increased attention in the field of evolutionary optimization. Most existing algorithms assume that the data used for optimization is always…

Neural and Evolutionary Computing · Computer Science 2021-06-24 Jinjin Xu , Yaochu Jin , Wenli Du

Explainable AI is a crucial component for edge services, as it ensures reliable decision making based on complex AI models. Surrogate models are a prominent approach of XAI where human-interpretable models, such as a linear regression…

Machine Learning · Computer Science 2025-03-12 Foivos Charalampakos , Thomas Tsouparopoulos , Iordanis Koutsopoulos

We consider minimizing functions for which it is expensive to compute the (possibly stochastic) gradient. Such functions are prevalent in reinforcement learning, imitation learning and adversarial training. Our target optimization framework…

Machine Learning · Computer Science 2023-06-09 Jonathan Wilder Lavington , Sharan Vaswani , Reza Babanezhad , Mark Schmidt , Nicolas Le Roux

We perform a comprehensive study on the performance of derivative free optimization (DFO) algorithms for the generation of targeted black-box adversarial attacks on Deep Neural Network (DNN) classifiers assuming the perturbation energy is…

Machine Learning · Computer Science 2020-12-04 Giuseppe Ughi , Vinayak Abrol , Jared Tanner