English
Related papers

Related papers: Bounce: Reliable High-Dimensional Bayesian Optimiz…

200 papers

Bayesian optimization methods have been successfully applied to black box optimization problems that are expensive to evaluate. In this paper, we adapt the so-called super effcient global optimization algorithm to solve more accurately…

Machine Learning · Statistics 2020-06-30 Rémy Priem , Nathalie Bartoli , Youssef Diouane , Alessandro Sgueglia

Bayesian optimization has recently emerged as a popular and efficient tool for global optimization and hyperparameter tuning. Currently, the established Bayesian optimization practice requires a user-defined bounding box which is assumed to…

Machine Learning · Statistics 2015-08-18 Bobak Shahriari , Alexandre Bouchard-Côté , Nando de Freitas

When it comes to expensive black-box optimization problems, Bayesian Optimization (BO) is a well-known and powerful solution. Many real-world applications involve a large number of dimensions, hence scaling BO to high dimension is of much…

Machine Learning · Statistics 2024-12-18 Lam Ngo , Huong Ha , Jeffrey Chan , Hongyu Zhang

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

Machine Learning · Statistics 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

At present, high-dimensional global optimization problems with time-series models have received much attention from engineering fields. Since it was proposed, Bayesian optimization has quickly become a popular and promising approach for…

Machine Learning · Computer Science 2021-08-06 Yuyang Chen , Kaiming Bi , Chih-Hang J. Wu , David Ben-Arieh , Ashesh Sinha

Scaling Bayesian optimization to high dimensions is challenging task as the global optimization of high-dimensional acquisition function can be expensive and often infeasible. Existing methods depend either on limited active variables or…

Machine Learning · Statistics 2018-02-16 Cheng Li , Sunil Gupta , Santu Rana , Vu Nguyen , Svetha Venkatesh , Alistair Shilton

Bayesian optimization is a methodology to optimize black-box functions. Traditionally, it focuses on the setting where you can arbitrarily query the search space. However, many real-life problems do not offer this flexibility; in…

Learning decompositions of expensive-to-evaluate black-box functions promises to scale Bayesian optimisation (BO) to high-dimensional problems. However, the success of these techniques depends on finding proper decompositions that…

Machine Learning · Computer Science 2023-05-30 Juliusz Ziomek , Haitham Bou-Ammar

Design optimisation offers the potential to develop lightweight aircraft structures with reduced environmental impact. Due to the high number of design variables and constraints, these challenges are typically addressed using gradient-based…

Computational Engineering, Finance, and Science · Computer Science 2025-08-04 Hauke F. Maathuis , Roeland De Breuker , Saullo G. P. Castro

Bayesian Optimization (BO) is a popular approach to optimizing expensive-to-evaluate black-box functions. Despite the success of BO, its performance may decrease exponentially as the dimensionality increases. A common framework to tackle…

Machine Learning · Computer Science 2024-12-24 Quoc-Anh Hoang Nguyen , The Hung Tran

The increasing availability of structured but high dimensional data has opened new opportunities for optimization. One emerging and promising avenue is the exploration of unsupervised methods for projecting structured high dimensional data…

Machine Learning · Computer Science 2021-01-07 Eero Siivola , Javier Gonzalez , Andrei Paleyes , Aki Vehtari

Bayesian optimisation is a popular method for efficient optimisation of expensive black-box functions. Traditionally, BO assumes that the search space is known. However, in many problems, this assumption does not hold. To this end, we…

Machine Learning · Statistics 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Huong Ha , Svetha Venkatesh

Data fusion has become an active research topic in recent years. Growing computational performance has allowed the use of redundant sensors to measure a single phenomenon. While Bayesian fusion approaches are common in general applications,…

Robotics · Computer Science 2017-04-25 Andres F. Echeverri , Henry Medeiros , Ryan Walsh , Yevgeniy Reznichenko , Richard Povinelli

Bayesian Optimization (BO) is used to find the global optima of black box functions. In this work, we propose a practical BO method of function compositions where the form of the composition is known but the constituent functions are…

Machine Learning · Computer Science 2023-05-02 Kunal Jain , Prabuchandran K. J. , Tejas Bodas

Bayesian Optimization (BO) is a class of black-box, surrogate-based heuristics that can efficiently optimize problems that are expensive to evaluate, and hence admit only small evaluation budgets. BO is particularly popular for solving…

Machine Learning · Computer Science 2024-06-25 Maria Laura Santoni , Elena Raponi , Renato De Leone , Carola Doerr

Bayesian optimization (BO) is a widely used algorithm for solving expensive black-box optimization problems. However, its performance decreases significantly on high-dimensional problems due to the inherent high-dimensionality of the…

Machine Learning · Computer Science 2025-04-16 Jundi Huang , Dawei Zhan

We propose a novel Bayesian Optimization approach for black-box functions with an environmental variable whose value determines the tradeoff between evaluation cost and the fidelity of the evaluations. Further, we use a novel approach to…

Machine Learning · Statistics 2018-05-16 Mark McLeod , Michael A. Osborne , Stephen J. Roberts

Bayesian optimization is an effective method for finding extrema of a black-box function. We propose a new type of Bayesian optimization for learning user preferences in high-dimensional spaces. The central assumption is that the underlying…

Machine Learning · Statistics 2020-08-17 Petrus Mikkola , Milica Todorović , Jari Järvi , Patrick Rinke , Samuel Kaski

Scaling Bayesian optimisation (BO) to high-dimensional search spaces is a active and open research problems particularly when no assumptions are made on function structure. The main reason is that at each iteration, BO requires to find…

Machine Learning · Statistics 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Svetha Venkatesh

When gradient-based methods are impractical, black-box optimization (BBO) provides a valuable alternative. However, BBO often struggles with high-dimensional problems and limited trial budgets. In this work, we propose a novel approach…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Riccardo Busetto , Manas Mejari , Marco Forgione , Alberto Bemporad , Dario Piga