English
Related papers

Related papers: Re-Examining Linear Embeddings for High-Dimensiona…

200 papers

Bayesian optimization (BO) is a popular paradigm for global optimization of expensive black-box functions, but there are many domains where the function is not completely a black-box. The data may have some known structure (e.g. symmetries)…

Machine Learning · Computer Science 2022-12-08 Samuel Kim , Peter Y. Lu , Charlotte Loh , Jamie Smith , Jasper Snoek , Marin Soljačić

Bayesian Optimization (BO) in high-dimensional spaces remains fundamentally limited by the curse of dimensionality and the rigidity of global low-dimensional assumptions. While Random EMbedding Bayesian Optimization (REMBO) mitigates this…

Machine Learning · Statistics 2025-05-19 Yuejiang Wen , Paul D. Franzon

When gradient-based methods are impractical, black-box optimization (BBO) provides a valuable alternative. However, BBO often struggles with high-dimensional problems and limited trial budgets. In this work, we propose a novel approach…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Riccardo Busetto , Manas Mejari , Marco Forgione , Alberto Bemporad , Dario Piga

A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization. Bayesian optimization (BO) is a powerful tool that models and optimizes such…

Machine Learning · Computer Science 2023-02-14 Tianyi Bai , Yang Li , Yu Shen , Xinyi Zhang , Wentao Zhang , Bin Cui

We consider the problem of optimizing expensive black-box functions over high-dimensional combinatorial spaces which arises in many science, engineering, and ML applications. We use Bayesian Optimization (BO) and propose a novel surrogate…

Machine Learning · Computer Science 2023-03-06 Aryan Deshwal , Sebastian Ament , Maximilian Balandat , Eytan Bakshy , Janardhan Rao Doppa , David Eriksson

Bayesian optimization (BO) is a powerful paradigm for efficient optimization of black-box objective functions. High-dimensional BO presents a particular challenge, in part because the curse of dimensionality makes it difficult to define --…

Machine Learning · Computer Science 2021-06-11 David Eriksson , Martin Jankowiak

Bayesian optimization (BO) is a popular approach for sample-efficient optimization of black-box objective functions. While BO has been successfully applied to a wide range of scientific applications, traditional approaches to…

Machine Learning · Computer Science 2023-05-04 Natalie Maus , Kaiwen Wu , David Eriksson , Jacob Gardner

Bayesian Optimisation (BO) is a state-of-the-art global optimisation technique for black-box problems where derivative information is unavailable, and sample efficiency is crucial. However, improving the general scalability of BO has proved…

Optimization and Control · Mathematics 2024-12-13 Luo Long , Coralia Cartis , Paz Fink Shustin

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

Machine Learning · Computer Science 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta

Bayesian optimization is a broadly applied methodology to optimize the expensive black-box function. Despite its success, it still faces the challenge from the high-dimensional search space. To alleviate this problem, we propose a novel…

Machine Learning · Computer Science 2020-10-20 Jingfan Chen , Guanghui Zhu , Chunfeng Yuan , Yihua Huang

We propose to use Bayesian optimization (BO) to improve the efficiency of the design selection process in clinical trials. BO is a method to optimize expensive black-box functions, by using a regression as a surrogate to guide the search.…

Methodology · Statistics 2021-05-20 Jakob Richter , Tim Friede , Jörg Rahnenführer

In high-dimensional settings, Bayesian optimization (BO) can be expensive and infeasible. The random embedding Bayesian optimization algorithm is commonly used to address high-dimensional BO challenges. However, this method relies on the…

Machine Learning · Computer Science 2024-08-12 Jiaming Lu , Rong J. B. Zhu

Bayesian optimization techniques have been successfully applied to robotics, planning, sensor placement, recommendation, advertising, intelligent user interfaces and automatic algorithm configuration. Despite these successes, the approach…

Machine Learning · Statistics 2016-01-12 Ziyu Wang , Frank Hutter , Masrour Zoghi , David Matheson , Nando de Freitas

Bayesian optimization (BO) is an approach to globally optimizing black-box objective functions that are expensive to evaluate. BO-powered experimental design has found wide application in materials science, chemistry, experimental physics,…

Machine Learning · Computer Science 2023-10-10 Mimi Zhang , Andrew Parnell , Dermot Brabazon , Alessio Benavoli

Bayesian optimization (BO) has shown impressive results in a variety of applications within low-to-moderate dimensional Euclidean spaces. However, extending BO to high-dimensional settings remains a significant challenge. We address this…

Machine Learning · Statistics 2024-03-11 Shouri Hu , Jiawei Li , Zhibo Cai

Bayesian optimization (BO) has been broadly applied to computational expensive problems, but it is still challenging to extend BO to high dimensions. Existing works are usually under strict assumption of an additive or a linear embedding…

Machine Learning · Computer Science 2019-07-23 Miao Zhang , Huiqi Li , Steven Su

Bayesian optimization is widely employed for optimizing complex black-box functions but struggles with the curse of dimensionality. Random embedding, as a dimension reduction strategy, simplifies tasks that possess the effective dimension…

Machine Learning · Computer Science 2026-05-26 Hong Qian , Xiang Shu , Xiang Xia , Xuhui Liu , Yangde Fu , Bei Liang , Huibin Wang , Liang Dou

Bayesian Optimisation (BO) is a technique used in optimising a $D$-dimensional function which is typically expensive to evaluate. While there have been many successes for BO in low dimensions, scaling it to high dimensions has been…

Machine Learning · Statistics 2016-05-16 Kirthevasan Kandasamy , Jeff Schneider , Barnabas Poczos

Bayesian optimization works effectively optimizing parameters in black-box problems. However, this method did not work for high-dimensional parameters in limited trials. Parameters can be efficiently explored by nonlinearly embedding them…

Machine Learning · Computer Science 2022-06-14 Shoki Miyagawa , Atsuyoshi Yano , Naoko Sawada , Isamu Ogawa

Bayesian optimization (BO) is one of the most effective methods for closed-loop experimental design and black-box optimization. However, a key limitation of BO is that it is an inherently sequential algorithm (one experiment is proposed per…

Machine Learning · Statistics 2023-11-21 Leonardo D. González , Victor M. Zavala