English
Related papers

Related papers: Offline Stochastic Optimization of Black-Box Objec…

200 papers

Bayesian optimization (BO) is a popular framework to optimize black-box functions. In many applications, the objective function can be evaluated at multiple fidelities to enable a trade-off between the cost and accuracy. To reduce the…

Machine Learning · Computer Science 2020-12-11 Shibo Li , Wei Xing , Mike Kirby , Shandian Zhe

Many problems in science and engineering involve optimizing an expensive black-box function over a high-dimensional space. For such black-box optimization (BBO) problems, we typically assume a small budget for online function evaluations,…

Machine Learning · Computer Science 2023-08-22 Siddarth Krishnamoorthy , Satvik Mehul Mashkaria , Aditya Grover

We present a data-driven Bayesian nonparametric approach for global optimization (DaBNO) of stochastic black-box function. The function value depends on the distribution of a random vector. However, this distribution is usually complex and…

Optimization and Control · Mathematics 2024-02-28 Haowei Wang , Xun Zhang , Szu Hui Ng , Songhao Wang

Online bilevel optimization (OBO) is a powerful framework for machine learning problems where both outer and inner objectives evolve over time, requiring dynamic updates. Current OBO approaches rely on deterministic \textit{window-smoothed}…

Machine Learning · Computer Science 2026-05-20 Parvin Nazari , Bojian Hou , Davoud Ataee Tarzanagh , Li Shen , George Michailidis

In many optimization problems arising from scientific, engineering and artificial intelligence applications, objective and constraint functions are available only as the output of a black-box or simulation oracle that does not provide…

Optimization and Control · Mathematics 2019-08-15 Jeffrey Larson , Matt Menickelly , Stefan M. Wild

Black-box optimization in science and engineering often comes with side information: experts, simulators, pretrained predictors, or heuristics can suggest which candidates look promising. This information can accelerate search, but it can…

Machine Learning · Computer Science 2026-05-08 Nicolas Samuel Blumer , Julien Martinelli , Samuel Kaski

Bayesian Optimization (BO) is a well-established method for addressing black-box optimization problems. In many real-world scenarios, optimization often involves multiple functions, emphasizing the importance of leveraging data and learned…

Machine Learning · Computer Science 2025-03-11 Khoa Nguyen , Viet Huynh , Binh Tran , Tri Pham , Tin Huynh , Thin Nguyen

Bayesian Optimization (BO) is a class of black-box, surrogate-based heuristics that can efficiently optimize problems that are expensive to evaluate, and hence admit only small evaluation budgets. BO is particularly popular for solving…

Machine Learning · Computer Science 2024-06-25 Maria Laura Santoni , Elena Raponi , Renato De Leone , Carola Doerr

Bayesian optimization (BO) is a successful methodology to optimize black-box functions that are expensive to evaluate. While traditional methods optimize each black-box function in isolation, there has been recent interest in speeding up BO…

Machine Learning · Statistics 2019-09-30 Valerio Perrone , Huibin Shen , Matthias Seeger , Cedric Archambeau , Rodolphe Jenatton

Bayesian optimization (BO) is a powerful paradigm for efficient optimization of black-box objective functions. High-dimensional BO presents a particular challenge, in part because the curse of dimensionality makes it difficult to define --…

Machine Learning · Computer Science 2021-06-11 David Eriksson , Martin Jankowiak

Bayesian optimization (BO) is one of the most powerful strategies to solve computationally expensive-to-evaluate blackbox optimization problems. However, BO methods are conventionally used for optimization problems of small dimension…

Optimization and Control · Mathematics 2025-02-10 Rémy Priem , Youssef Diouane , Nathalie Bartoli , Sylvain Dubreuil , Paul Saves

This paper reviews the state-of-the-art model-based adaptive sampling approaches for single-objective black-box optimization (BBO). While BBO literature includes various promising sampling techniques, there is still a lack of comprehensive…

Optimization and Control · Mathematics 2022-04-25 Nazanin Nezami , Hadis Anahideh

Bayesian optimization (BO) is an efficient framework for optimization of black-box objectives when function evaluations are costly and gradient information is not easily accessible. BO has been successfully applied to automate the task of…

Machine Learning · Computer Science 2024-07-09 Pallavi Mitra , Felix Biessmann

Bayesian optimization (BO) is a leading method for optimizing expensive black-box optimization and has been successfully applied across various scenarios. However, BO suffers from the curse of dimensionality, making it challenging to scale…

Machine Learning · Computer Science 2025-04-03 Vu Viet Hoang , Hung The Tran , Sunil Gupta , Vu Nguyen

Preferential Bayesian Optimization (PBO) is a sample-efficient method to learn latent user utilities from preferential feedback over a pair of designs. It relies on a statistical surrogate model for the latent function, usually a Gaussian…

Machine Learning · Statistics 2025-03-04 Xinyu Zhang , Daolang Huang , Samuel Kaski , Julien Martinelli

Bayesian optimization is a popular method for optimizing expensive black-box functions. Yet it oftentimes struggles in high dimensions where the computation could be prohibitively heavy. To alleviate this problem, we introduce Coordinate…

Machine Learning · Computer Science 2022-04-21 Jian Tan , Niv Nayman , Mengchang Wang

Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, experimental design, and database knob tuning. However, users still face challenges when applying BBO methods to their problems at hand…

Machine Learning · Computer Science 2024-05-17 Huaijun Jiang , Yu Shen , Yang Li , Beicheng Xu , Sixian Du , Wentao Zhang , Ce Zhang , Bin Cui

Many real-world optimisation problems such as hyperparameter tuning in machine learning or simulation-based optimisation can be formulated as expensive-to-evaluate black-box functions. A popular approach to tackle such problems is Bayesian…

Machine Learning · Computer Science 2021-05-28 Juan Ungredda , Juergen Branke

Global optimization of large-scale, complex systems such as multi-physics black-box simulations and real-world industrial systems is important but challenging. This work presents a novel Surrogate-Based Optimization framework based on…

Machine Learning · Computer Science 2026-01-13 Maaz Ahmad , Iftekhar A. Karimi

In this paper, a new sequential surrogate-based optimization (SSBO) algorithm is developed, which aims to improve the global search ability and local search efficiency for the global optimization of expensive black-box models. The proposed…

Machine Learning · Statistics 2018-11-30 Chunlin Gong , Xu Li , Hua Su , Jinlei Guo , Liangxian Gu