English
Related papers

Related papers: Surrogate-based Optimization using Mutual Informat…

200 papers

Bayesian optimization (BO) methods often rely on the assumption that the objective function is well-behaved, but in practice, this is seldom true for real-world objectives even if noise-free observations can be collected. Common approaches,…

Machine Learning · Statistics 2020-09-10 Erik Bodin , Markus Kaiser , Ieva Kazlauskaite , Zhenwen Dai , Neill D. F. Campbell , Carl Henrik Ek

In engineering design and scientific computing, computational cost and predictive accuracy are intrinsically coupled. High-fidelity simulations provide accurate predictions but at substantial computational costs, while lower-fidelity…

Machine Learning · Computer Science 2026-05-11 Ahmed Mohamed Eisa Nasr , Ali Elham , Haris Moazam Sheikh

This study focuses on two important problems related to applying offline model-based optimization to real-world industrial control problems. The first problem is how to create a reliable probabilistic model that accurately captures the…

Machine Learning · Computer Science 2024-03-26 Cheng Feng

It is not uncommon that meta-heuristic algorithms contain some intrinsic parameters, the optimal configuration of which is crucial for achieving their peak performance. However, evaluating the effectiveness of a configuration is expensive,…

Neural and Evolutionary Computing · Computer Science 2019-02-01 Ke Li , Zilin Xiang , Kay Chen Tan

Reasonable setting of traffic signals can be very helpful in alleviating congestion in urban traffic networks. Meta-heuristic optimization algorithms have proved themselves to be able to find high-quality signal timing plans. However, they…

Neural and Evolutionary Computing · Computer Science 2021-03-04 Yongsheng Liang , Zhigang Ren , Lin Wang , Hanqing Liu , Wenhao Du

Mutual Information (MI) is a powerful statistical measure that quantifies shared information between random variables, particularly valuable in high-dimensional data analysis across fields like genomics, natural language processing, and…

Machine Learning · Computer Science 2024-12-02 Andre O. Falcao

Bayesian optimization is a popular formalism for global optimization, but its computational costs limit it to expensive-to-evaluate functions. A competing, computationally more efficient, global optimization framework is optimistic…

Machine Learning · Computer Science 2022-09-05 Julia Grosse , Cheng Zhang , Philipp Hennig

We introduce the concept of decision-focused surrogate modeling for solving computationally challenging nonlinear optimization problems in real-time settings. The proposed data-driven framework seeks to learn a simpler, e.g. convex,…

Optimization and Control · Mathematics 2023-12-27 Rishabh Gupta , Qi Zhang

We present GLASSES: Global optimisation with Look-Ahead through Stochastic Simulation and Expected-loss Search. The majority of global optimisation approaches in use are myopic, in only considering the impact of the next function value; the…

Machine Learning · Statistics 2015-10-22 Javier González , Michael Osborne , Neil D. Lawrence

This paper proposes an integration of surrogate modeling and topology to significantly reduce the amount of data required to describe the underlying global dynamics of robot controllers, including closed-box ones. A Gaussian Process (GP),…

In this paper, we propose a surrogate-assisted evolutionary algorithm (EA) for hyperparameter optimization of machine learning (ML) models. The proposed STEADE model initially estimates the objective function landscape using RadialBasis…

Neural and Evolutionary Computing · Computer Science 2020-12-14 Subhodip Biswas , Adam D Cobb , Andreea Sistrunk , Naren Ramakrishnan , Brian Jalaian

A key drawback of the current generation of artificial decision-makers is that they do not adapt well to changes in unexpected situations. This paper addresses the situation in which an AI for aerial dog fighting, with tunable parameters…

Machine Learning · Statistics 2016-12-14 Brett Israelsen , Nisar Ahmed

Many real-world multi-objective optimisation problems rely on computationally expensive function evaluations. Multi-objective Bayesian optimisation (BO) can be used to alleviate the computation time to find an approximated set of Pareto…

Machine Learning · Statistics 2022-04-29 Tinkle Chugh

The minimisation of cost functions is crucial in various optimisation fields. However, identifying their global minimum remains challenging owing to the huge computational cost incurred. This work analytically expresses the computational…

Neural and Evolutionary Computing · Computer Science 2021-11-22 Takuya Isomura

Chemical plant design and optimisation have proven challenging due to the complexity of these real-world systems. The resulting complexity translates into high computational costs for these systems' mathematical formulations and simulation…

Neural and Evolutionary Computing · Computer Science 2022-04-28 Liezl Stander , Matthew Woolway , Terence L. Van Zyl

Preferential Bayesian Optimization (PBO) aims to find a decision-maker's most preferred solution in as few pairwise comparisons as possible. Existing approaches rely on Gaussian Process (GP) surrogates, which provide strong performance but…

Machine Learning · Computer Science 2026-05-11 Nick Leenders , Thomas Quadt , Boris Cule , Roy Lindelauf , Herman Monsuur , Joost van Oijen , Mark Voskuijl

We consider computationally expensive blackbox optimization problems and present a method that employs surrogate models and concurrent computing at the search step of the mesh adaptive direct search (MADS) algorithm. Specifically, we solve…

Optimization and Control · Mathematics 2021-07-28 Bastien Talgorn , Stéphane Alarie , Michael Kokkolaras

Machine learning methods are increasingly used to build computationally inexpensive surrogates for complex physical models. The predictive capability of these surrogates suffers when data are noisy, sparse, or time-dependent. As we are…

Machine Learning · Computer Science 2024-05-20 A. Diaw , M. McKerns , I. Sagert , L. G. Stanton , M. S. Murillo

The MAP-Elites algorithm produces a set of high-performing solutions that vary according to features defined by the user. This technique has the potential to be a powerful tool for design space exploration, but is limited by the need for…

Neural and Evolutionary Computing · Computer Science 2017-08-01 Adam Gaier , Alexander Asteroth , Jean-Baptiste Mouret

Bayesian optimization is a technique for optimizing black-box target functions. At the core of Bayesian optimization is a surrogate model that predicts the output of the target function at previously unseen inputs to facilitate the…

Machine Learning · Computer Science 2022-03-04 Felix Jimenez , Matthias Katzfuss