中文
相关论文

相关论文: Mean-Field Bayesian Optimisation

200 篇论文

Bayesian optimization (BO) is widely used to optimize expensive-to-evaluate black-box functions.BO first builds a surrogate model to represent the objective function and assesses its uncertainty. It then decides where to sample by…

机器学习 · 计算机科学 2024-01-25 Jiayu Zhao , Renyu Yang , Shenghao Qiu , Zheng Wang

The closed-loop performance of model predictive controllers (MPCs) is sensitive to the choice of prediction models, controller formulation, and tuning parameters. However, prediction models are typically optimized for prediction accuracy…

系统与控制 · 电气工程与系统科学 2020-11-25 Farshud Sorourifar , Georgios Makrygirgos , Ali Mesbah , Joel A. Paulson

We introduce a surrogate-based black-box optimization method, termed Polynomial-model-based optimization (PMBO). The algorithm alternates polynomial approximation with Bayesian optimization steps, using Gaussian processes to model the error…

最优化与控制 · 数学 2024-03-13 Janina Schreiber , Pau Batlle , Damar Wicaksono , Michael Hecht

Bayesian optimization is a popular black-box optimization method for parameter learning in control and robotics. It typically requires an objective function that reflects the user's optimization goal. However, in practical applications,…

机器人学 · 计算机科学 2026-04-03 Johanna Menn , David Stenger , Sebastian Trimpe

We present a multi-agent algorithm for multi-objective optimization problems, which extends the class of consensus-based optimization methods and relies on a scalarization strategy. The optimization is achieved by a set of interacting…

最优化与控制 · 数学 2022-03-31 Giacomo Borghi , Michael Herty , Lorenzo Pareschi

Learning robot controllers by minimizing a black-box objective cost using Bayesian optimization (BO) can be time-consuming and challenging. It is very often the case that some roll-outs result in failure behaviors, causing premature…

机器学习 · 计算机科学 2020-11-11 Alonso Marco , Dominik Baumann , Philipp Hennig , Sebastian Trimpe

Bayesian optimization (BO) is well known to be sample-efficient for solving black-box problems. However, the BO algorithms can sometimes get stuck in suboptimal solutions even with plenty of samples. Intrinsically, such suboptimal problem…

机器学习 · 计算机科学 2025-01-24 Zhendong Guo , Yew-Soon Ong , Tiantian He , Haitao Liu

Multi-Source Bayesian Optimization (MSBO) serves as a variant of the traditional Bayesian Optimization (BO) framework applicable to situations involving optimization of an objective black-box function over multiple information sources such…

机器学习 · 计算机科学 2026-02-17 Luuk Jacobs , Mohammad Ali Javidian

We aim to optimize a black-box function $f:\mathcal{X} \mapsto \mathbb{R}$ under the assumption that $f$ is H\"older smooth and has bounded norm in the RKHS associated with a given kernel $K$. This problem is known to have an agnostic…

机器学习 · 计算机科学 2020-05-12 Shubhanshu Shekhar , Tara Javidi

Many real-world optimisation problems are defined over both categorical and continuous variables, yet efficient optimisation methods such asBayesian Optimisation (BO) are not designed tohandle such mixed-variable search spaces. Recent…

机器学习 · 统计学 2022-02-18 Yan Zuo , Amir Dezfouli , Iadine Chades , David Alexander , Benjamin Ward Muir

Some real-world problems revolve to solve the optimization problem \max_{x\in\mathcal{X}}f\left(x\right) where f\left(.\right) is a black-box function and X might be the set of non-vectorial objects (e.g., distributions) where we can only…

机器学习 · 计算机科学 2017-09-20 Trung Le , Khanh Nguyen , Tu Dinh Nguyen , Dinh Phung

Bayesian optimization (BO) is a popular paradigm for global optimization of expensive black-box functions, but there are many domains where the function is not completely a black-box. The data may have some known structure (e.g. symmetries)…

机器学习 · 计算机科学 2022-12-08 Samuel Kim , Peter Y. Lu , Charlotte Loh , Jamie Smith , Jasper Snoek , Marin Soljačić

The growing ubiquity of machine learning (ML) has led it to enter various areas of computer science, including black-box optimization (BBO). Recent research is particularly concerned with Bayesian optimization (BO). BO-based algorithms are…

机器学习 · 计算机科学 2024-01-04 Elena Raponi , Nathanael Rakotonirina Carraz , Jérémy Rapin , Carola Doerr , Olivier Teytaud

Optimizing multiple, non-preferential objectives for mixed-variable, expensive black-box problems is important in many areas of engineering and science. The expensive, noisy, black-box nature of these problems makes them ideal candidates…

机器学习 · 计算机科学 2022-11-15 Haris Moazam Sheikh , Philip S. Marcus

Bayesian Optimization is a sample-efficient black-box optimization procedure that is typically applied to problems with a small number of independent objectives. However, in practice we often wish to optimize objectives defined over many…

机器学习 · 计算机科学 2021-10-29 Wesley J. Maddox , Maximilian Balandat , Andrew Gordon Wilson , Eytan Bakshy

Bayesian Optimization (BO) has been widely applied to optimize expensive black-box functions while retaining sample efficiency. However, scaling BO to high-dimensional spaces remains challenging. Existing literature proposes performing…

机器学习 · 计算机科学 2025-08-27 Quanlin Chen , Yiyu Chen , Jing Huo , Tianyu Ding , Yang Gao , Yuetong Chen

Choosing a set of benchmark problems is often a key component of any empirical evaluation of iterative optimization heuristics. In continuous, single-objective optimization, several sets of problems have become widespread, including the…

神经与进化计算 · 计算机科学 2023-12-19 Diederick Vermetten , Furong Ye , Thomas Bäck , Carola Doerr

Many challenges in science and engineering, such as drug discovery and communication network design, involve optimizing complex and expensive black-box functions across vast search spaces. Thus, it is essential to leverage existing data to…

机器学习 · 计算机科学 2024-12-04 Juncheng Dong , Zihao Wu , Hamid Jafarkhani , Ali Pezeshki , Vahid Tarokh

Modern scientific and engineering design increasingly involves distributed optimization, where agents such as laboratories, simulations, or industrial partners pursue related goals under differing conditions. These agents often face…

机器学习 · 统计学 2025-10-21 Zihan Wang , Yi-Ping Chen , Tuba Dolar , Wei Chen

Optimizing objectives under constraints, where both the objectives and constraints are black box functions, is a common scenario in real-world applications such as scientific experimental design, design of medical therapies, and industrial…

机器学习 · 计算机科学 2023-10-16 Fengxue Zhang , Zejie Zhu , Yuxin Chen