中文
相关论文

相关论文: Mono-surrogate vs Multi-surrogate in Multi-objecti…

200 篇论文

Multi-objective optimization aims to solve problems with competing objectives. Evaluating such problems is often slow or expensive, limiting the budget of evaluations. In many applications, historical data from related optimization tasks is…

机器学习 · 计算机科学 2026-05-12 Leonard Papenmeier , Petru Tighineanu

Bayesian optimization (BO) is a class of sample-efficient global optimization methods, where a probabilistic model conditioned on previous observations is used to determine future evaluations via the optimization of an acquisition function.…

机器学习 · 计算机科学 2020-06-22 Eric Hans Lee , David Eriksson , Bolong Cheng , Michael McCourt , David Bindel

The exploration of novel architectures requires physics-based simulation due to a lack of prior experience to start from, which introduces two specific challenges for optimization algorithms: evaluations become more expensive (in time) and…

机器学习 · 计算机科学 2025-04-14 Jasper Bussemaker , Paul Saves , Nathalie Bartoli , Thierry Lefebvre , Björn Nagel

The optimization of large-scale multibody systems is a numerically challenging task, in particular when considering multiple conflicting criteria at the same time. In this situation, we need to approximate the Pareto set of optimal…

Bayesian Optimization (BO) for the minimization of expensive functions of continuous variables uses all the knowledge acquired from previous samples (${\boldsymbol x}_i$ and $f({\boldsymbol x}_i)$ values) to build a surrogate model based on…

数值分析 · 数学 2025-05-15 Roberto Battiti , Mauro Brunato

Bayesian Optimization is a popular approach for optimizing expensive black-box functions. Its key idea is to use a surrogate model to approximate the objective and, importantly, quantify the associated uncertainty that allows a sequential…

机器学习 · 统计学 2025-02-05 Haoxian Chen , Henry Lam

Many control problems require repeated tuning and adaptation of controllers across distinct closed-loop tasks, where data efficiency and adaptability are critical. We propose a hierarchical Bayesian optimization (BO) framework that is…

系统与控制 · 电气工程与系统科学 2026-03-27 Sebastian Hirt , Lukas Theiner , Maik Pfefferkorn , Rolf Findeisen

Classical evolutionary approaches for multiobjective optimization are quite accurate but incur a lot of queries to the objectives; this can be prohibitive when objectives are expensive oracles. A sample-efficient approach to solving…

最优化与控制 · 数学 2025-02-18 Ashwin Renganathan , Kade E. Carlson

Selecting the optimal combination of a machine learning (ML) algorithm and its hyper-parameters is crucial for the development of high-performance ML systems. However, since the combination of ML algorithms and hyper-parameters is enormous,…

机器学习 · 计算机科学 2025-02-14 Kazuki Ishikawa , Ryota Ozaki , Yohei Kanzaki , Ichiro Takeuchi , Masayuki Karasuyama

Bayesian optimization (BO) is a popular global optimization scheme for sample-efficient optimization in domains with expensive function evaluations. The existing BO techniques are capable of finding a single global optimum solution.…

最优化与控制 · 数学 2023-08-08 Yongsheng Mei , Tian Lan , Mahdi Imani , Suresh Subramaniam

This work aims at developing new methodologies to optimize computational costly complex systems (e.g., aeronautical engineering systems). The proposed surrogate-based method (often called Bayesian optimization) uses adaptive sampling to…

In this paper, we deal with batch Bayesian Optimization (Bayes-Opt) problems over a box and we propose a novel bi-objective optimization (BOO) acquisition strategy to sample points where to evaluate the objective function. The BOO problem…

最优化与控制 · 数学 2025-05-27 Francesco Carciaghi , Simone Magistri , Pierluigi Mansueto , Fabio Schoen

Bayesian optimization (BO) algorithms form a class of surrogate-based heuristics, aimed at efficiently computing high-quality solutions for numerical black-box optimization problems. The BO pipeline is highly modular, with different design…

机器学习 · 计算机科学 2022-11-18 Carolin Benjamins , Anja Jankovic , Elena Raponi , Koen van der Blom , Marius Lindauer , Carola Doerr

Bayesian optimization (BO) has become an indispensable tool for autonomous decision-making across diverse applications from autonomous vehicle control to accelerated drug and materials discovery. With the growing interest in self-driving…

机器学习 · 计算机科学 2025-08-22 Gary Tom , Stanley Lo , Samantha Corapi , Alan Aspuru-Guzik , Benjamin Sanchez-Lengeling

The acquisition function, a critical component in Bayesian optimization (BO), can often be written as the expectation of a utility function under a surrogate model. However, to ensure that acquisition functions are tractable to optimize,…

机器学习 · 计算机科学 2022-10-10 Jiaming Song , Lantao Yu , Willie Neiswanger , Stefano Ermon

Bayesian optimization (BO) has been widely used in machine learning and simulation optimization. With the increase in computational resources and storage capacities in these fields, high-dimensional and large-scale problems are becoming…

机器学习 · 计算机科学 2022-06-02 Haowei Wang , Ercong Zhang , Szu Hui Ng , Giulia Pedrielli

Many real world applications can be framed as multi-objective optimization problems, where we wish to simultaneously optimize for multiple criteria. Bayesian optimization techniques for the multi-objective setting are pertinent when the…

机器学习 · 计算机科学 2019-06-24 Biswajit Paria , Kirthevasan Kandasamy , Barnabás Póczos

Bayesian optimization (BO) is well known to be sample-efficient for solving black-box problems. However, the BO algorithms can sometimes get stuck in suboptimal solutions even with plenty of samples. Intrinsically, such suboptimal problem…

机器学习 · 计算机科学 2025-01-24 Zhendong Guo , Yew-Soon Ong , Tiantian He , Haitao Liu

Bayesian optimization (BO) provides a powerful framework for optimizing black-box, expensive-to-evaluate functions. It is therefore an attractive tool for engineering design problems, typically involving multiple objectives. Thanks to the…

机器学习 · 计算机科学 2024-09-06 Navid Ansari , Alireza Javanmardi , Eyke Hüllermeier , Hans-Peter Seidel , Vahid Babaei

Building a surrogate model of an objective function has shown to be effective to assist evolutionary algorithms (EAs) to solve real-world complex optimisation problems which involve either computationally expensive numerical simulations or…

神经与进化计算 · 计算机科学 2020-02-11 Xiaoran Ruan , Ke Li , Bilel Derbel , Arnaud Liefooghe