English
Related papers

Related papers: BOFormer: Learning to Solve Multi-Objective Bayesi…

200 papers

This paper introduces the BOW Planner, a scalable motion planning algorithm designed to navigate robots through complex environments using constrained Bayesian optimization (CBO). Unlike traditional methods, which often struggle with…

Robotics · Computer Science 2026-05-01 Sourav Raxit , Abdullah Al Redwan Newaz , Paulo Padrao , Jose Fuentes , Leonardo Bobadilla

Black-box optimization minimizes an objective function without derivatives or explicit forms. Such an optimization method with continuous variables has been successful in the fields of machine learning and material science. For discrete…

Bayesian optimization (BO) is a sample-efficient global optimization algorithm for black-box functions which are expensive to evaluate. Existing literature on model based optimization in conditional parameter spaces are usually built on…

Machine Learning · Statistics 2020-10-08 Xingchen Ma , Matthew B. Blaschko

Bayesian Optimization (BO) is a standard tool for hyperparameter tuning thanks to its sample efficiency on expensive black-box functions. While most BO pipelines begin with uniform random initialization, default hyperparameter values…

Machine Learning · Computer Science 2026-02-10 Nicolás Villagrán Prieto , Eduardo C. Garrido-Merchán

Traditional methods for black box optimization require a considerable number of evaluations which can be time consuming, unpractical, and often unfeasible for many engineering applications that rely on accurate representations and expensive…

Machine Learning · Computer Science 2020-07-10 Francesco Grassi , Giorgio Manganini , Michele Garraffa , Laura Mainini

The goal of Multi-task Bayesian Optimization (MBO) is to minimize the number of queries required to accurately optimize a target black-box function, given access to offline evaluations of other auxiliary functions. When offline datasets are…

Machine Learning · Computer Science 2022-03-11 Kourosh Hakhamaneshi , Pieter Abbeel , Vladimir Stojanovic , Aditya Grover

The pursuit of universal black-box optimization (BBO) algorithms is a longstanding goal. However, unlike domains such as language or vision, where scaling structured data has driven generalization, progress in offline BBO remains hindered…

Machine Learning · Computer Science 2025-06-10 Rong-Xi Tan , Ming Chen , Ke Xue , Yao Wang , Yaoyuan Wang , Sheng Fu , Chao Qian

Computational models in fields such as computational neuroscience are often evaluated via stochastic simulation or numerical approximation. Fitting these models implies a difficult optimization problem over complex, possibly noisy parameter…

Machine Learning · Statistics 2017-11-03 Luigi Acerbi , Wei Ji Ma

Black box optimization (BBO) focuses on optimizing unknown functions in high-dimensional spaces. In many applications, sampling the unknown function is expensive, imposing a tight sample budget. Ongoing work is making progress on reducing…

Machine Learning · Computer Science 2025-07-29 Rajalaxmi Rajagopalan , Yu-Lin Wei , Romit Roy Choudhury

We consider multi-objective optimization (MOO) of an unknown vector-valued function in the non-parametric Bayesian optimization (BO) setting, with the aim being to learn points on the Pareto front of the objectives. Most existing BO…

Machine Learning · Computer Science 2020-08-21 Sayak Ray Chowdhury , Aditya Gopalan

We present a general strategy for turning generative models into candidate solution samplers for batch Bayesian optimization (BO). The use of generative models for BO enables large batch scaling as generative sampling, optimization of…

Machine Learning · Statistics 2026-05-15 Rafael Oliveira , Daniel M. Steinberg , Edwin V. Bonilla

Bayesian optimization (BO) is a popular algorithm for solving challenging optimization tasks. It is designed for problems where the objective function is expensive to evaluate, perhaps not available in exact form, without gradient…

Machine Learning · Statistics 2018-08-22 Umberto Noè , Dirk Husmeier

How should we intervene on an unknown structural equation model to maximize a downstream variable of interest? This setting, also known as causal Bayesian optimization (CBO), has important applications in medicine, ecology, and…

Machine Learning · Computer Science 2023-03-13 Scott Sussex , Anastasiia Makarova , Andreas Krause

Bayesian optimization (BO) is a widely used algorithm for solving expensive black-box optimization problems. However, its performance decreases significantly on high-dimensional problems due to the inherent high-dimensionality of the…

Machine Learning · Computer Science 2025-04-16 Jundi Huang , Dawei Zhan

Collaborative Optimization (CO) is a multidisciplinary design optimization (MDO) framework that decomposes large-scale engineering problems into parallel, independently solvable subsystems coordinated by a system-level optimizer. Its…

Optimization and Control · Mathematics 2026-05-08 Mohamed Ali Belhafnaoui , Youssef Diouane

Bayesian optimization (BO) is a widely used iterative algorithm for optimizing black-box functions. Each iteration requires maximizing an acquisition function, such as the upper confidence bound (UCB) or a sample path from the Gaussian…

Machine Learning · Statistics 2025-06-16 Hwanwoo Kim , Chong Liu , Yuxin Chen

Bayesian optimization (BO) struggles in high dimensions, where Gaussian-process surrogates demand heavy retraining and brittle assumptions, slowing progress on real engineering and design problems. We introduce GIT-BO, a Gradient-Informed…

Computational Engineering, Finance, and Science · Computer Science 2026-03-06 Rosen Ting-Ying Yu , Cyril Picard , Faez Ahmed

Optimizing multiple competing black-box objectives is a challenging problem in many fields, including science, engineering, and machine learning. Multi-objective Bayesian optimization (MOBO) is a sample-efficient approach for identifying…

Machine Learning · Computer Science 2021-10-28 Samuel Daulton , Maximilian Balandat , Eytan Bakshy

Bayesian optimization is widely used for optimizing expensive black box functions, but most existing approaches focus on scalar responses. In many scientific and engineering settings the response is functional, varying smoothly over an…

Machine Learning · Computer Science 2026-04-28 Pouya Ahadi , Reza Marzban , Ali Adibi , Kamran Paynabar

When gradient-based methods are impractical, black-box optimization (BBO) provides a valuable alternative. However, BBO often struggles with high-dimensional problems and limited trial budgets. In this work, we propose a novel approach…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Riccardo Busetto , Manas Mejari , Marco Forgione , Alberto Bemporad , Dario Piga