English
Related papers

Related papers: Offline Stochastic Optimization of Black-Box Objec…

200 papers

An algorithm is proposed, analyzed, and tested experimentally for solving stochastic optimization problems in which the decision variables are constrained to satisfy equations defined by deterministic, smooth, and nonlinear functions. It is…

Optimization and Control · Mathematics 2021-07-09 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

Model selection is an integral problem of model based optimization techniques such as Bayesian optimization (BO). Current approaches often treat model selection as an estimation problem, to be periodically updated with observations coming…

Machine Learning · Computer Science 2023-08-02 Manisha Senadeera , Santu Rana , Sunil Gupta , Svetha Venkatesh

We introduce kernel-QA, a black-box optimization (BBO) method that constructs surrogate models analytically using low-order polynomial kernels within a quadratic unconstrained binary optimization (QUBO) framework, enabling efficient…

Optimization and Control · Mathematics 2025-11-07 Yuki Minamoto , Yuya Sakamoto

Handcrafted optimizers become prohibitively inefficient for complex black-box optimization (BBO) tasks. MetaBBO addresses this challenge by meta-learning to automatically configure optimizers for low-level BBO tasks, thereby eliminating…

Neural and Evolutionary Computing · Computer Science 2026-02-10 Chao Wang , Licheng Jiao , Lingling Li , Jiaxuan Zhao , Guanchun Wang , Fang Liu , Shuyuan Yang

Bayesian optimization has been successfully applied to optimize black-box functions where the number of evaluations is severely limited. However, in many real-world applications, it is hard or impossible to know in advance which designs are…

BayesianOptimization(BO) is a sample-efficient black-box optimizer, and extensive methods have been proposed to build the absolute function response of the black-box function through a probabilistic surrogate model, including…

Machine Learning · Computer Science 2024-02-07 Xiaoxing Wang , Jiaxing Li , Chao Xue , Wei Liu , Weifeng Liu , Xiaokang Yang , Junchi Yan , Dacheng Tao

One of the most challenging problems in evolutionary computation is to select from its family of diverse solvers one that performs well on a given problem. This algorithm selection problem is complicated by the fact that different phases of…

Neural and Evolutionary Computing · Computer Science 2020-06-12 Diederick Vermetten , Hao Wang , Carola Doerr , Thomas Bäck

Optimizing black-box functions in high-dimensional search spaces has been known to be challenging for traditional Bayesian Optimization (BO). In this paper, we introduce HiBO, a novel hierarchical algorithm integrating global-level search…

Machine Learning · Computer Science 2025-04-04 Wenxuan Li , Taiyi Wang , Eiko Yoneki

Offline optimization is an emerging problem in many experimental engineering domains including protein, drug or aircraft design, where online experimentation to collect evaluation data is too expensive or dangerous. To avoid that, one has…

Machine Learning · Computer Science 2024-05-10 Yassine Chemingui , Aryan Deshwal , Trong Nghia Hoang , Janardhan Rao Doppa

Bayesian optimization is a class of data efficient model based algorithms typically focused on global optimization. We consider the more general case where a user is faced with multiple problems that each need to be optimized conditional on…

Machine Learning · Statistics 2020-11-04 Michael Pearce , Janis Klaise , Matthew Groves

In materials informatics, searching for chemical materials with desired properties is challenging due to the vastness of the chemical space. Moreover, the high cost of evaluating properties necessitates a search with a few clues. In…

Quantum Physics · Physics 2023-12-18 Mikiya Doi , Yoshihiro Nakao , Takuro Tanaka , Masami Sako , Masayuki Ohzeki

This paper addresses the problem of constrained multi-objective optimization over black-box objective functions with practitioner-specified preferences over the objectives when a large fraction of the input space is infeasible (i.e.,…

Machine Learning · Computer Science 2023-03-24 Alaleh Ahmadianshalchi , Syrine Belakaria , Janardhan Rao Doppa

Offline model-based optimization (MBO) refers to the task of optimizing a black-box objective function using only a fixed set of prior input-output data, without any active experimentation. Recent work has introduced quantum extremal…

Bayesian optimization (BO) is an effective technique for black-box optimization. However, its applicability is typically limited to moderate-budget problems due to the cubic complexity of fitting the Gaussian process (GP) surrogate model.…

Machine Learning · Statistics 2025-10-13 Qiyu Wei , Haowei Wang , Zirui Cao , Songhao Wang , Richard Allmendinger , Mauricio A Álvarez

Motivated by energy management for micro-grids, we study convex optimization problems with uncertainty in the objective function and sequential decision making. To solve these problems, we propose a new framework called ``Online…

Optimization and Control · Mathematics 2020-08-25 Martijn H. H. Schoot Uiterkamp , Marco E. T. Gerards , Johann L. Hurink

We present a new algorithm ASEBO for optimizing high-dimensional blackbox functions. ASEBO adapts to the geometry of the function and learns optimal sets of sensing directions, which are used to probe it, on-the-fly. It addresses the…

Optimization and Control · Mathematics 2019-06-06 Krzysztof Choromanski , Aldo Pacchiano , Jack Parker-Holder , Yunhao Tang

Offline black-box optimization (BBO) aims to find optimal designs based solely on an offline dataset of designs and their labels. Such scenarios frequently arise in domains like DNA sequence design and robotics, where only a few labeled…

Computational Engineering, Finance, and Science · Computer Science 2026-01-22 Ye Yuan , Can , Chen , Zipeng Sun , Dinghuai Zhang , Christopher Pal , Xue Liu

Black-box optimization refers to the optimization problem whose objective function and/or constraint sets are either unknown, inaccessible, or non-existent. In many applications, especially with the involvement of humans, the only way to…

Stochastic Optimization (SO) is a classical approach for optimization under uncertainty that typically requires knowledge about the probability distribution of uncertain parameters. As the latter is often unknown, Distributionally Robust…

Quadratic unconstrained binary optimization (QUBO) solvers can be applied to design an optimal structure to avoid resonance. QUBO algorithms that work on a classical or quantum device have succeeded in some industrial applications. However,…

Mesoscale and Nanoscale Physics · Physics 2022-09-29 Tadayoshi Matsumori , Masato Taki , Tadashi Kadowaki