English
Related papers

Related papers: Black Box Optimization Using QUBO and the Cross En…

200 papers

Online black-box optimization (BBO) aims to optimize an objective function by iteratively querying a black-box oracle in a sample-efficient way. While prior studies focus on forward approaches such as Gaussian Processes (GPs) to learn a…

Machine Learning · Computer Science 2025-02-04 Dongxia Wu , Nikki Lijing Kuang , Ruijia Niu , Yi-An Ma , Rose Yu

In solving optimization problems, objective functions generally need to be minimized or maximized. However, objective functions cannot always be formulated explicitly in a mathematical form for complicated problem settings. Although several…

Statistical Mechanics · Physics 2021-07-20 Ami S. Koshikawa , Masayuki Ohzeki , Tadashi Kadowaki , Kazuyuki Tanaka

In edge computing, suppressing data size is a challenge for machine learning models that perform complex tasks such as autonomous driving, in which computational resources (speed, memory size and power) are limited. Efficient lossy…

Machine Learning · Computer Science 2022-09-28 Tadashi Kadowaki , Mitsuru Ambai

Bayesian optimization (BO) is a popular approach for sample-efficient optimization of black-box objective functions. While BO has been successfully applied to a wide range of scientific applications, traditional approaches to…

Machine Learning · Computer Science 2023-05-04 Natalie Maus , Kaiwen Wu , David Eriksson , Jacob Gardner

Bayesian optimization is widely used for optimizing expensive black box functions, but most existing approaches focus on scalar responses. In many scientific and engineering settings the response is functional, varying smoothly over an…

Machine Learning · Computer Science 2026-04-28 Pouya Ahadi , Reza Marzban , Ali Adibi , Kamran Paynabar

Black-box global optimization aims at minimizing an objective function whose analytical form is not known. To do so, many state-of-the-art methods rely on sampling-based strategies, where sampling distributions are built in an iterative…

Optimization and Control · Mathematics 2024-09-30 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

Machine Learning · Computer Science 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta

The Quadratic Unconstrained Binary Optimization problem (QUBO) has become a unifying model for representing a wide range of combinatorial optimization problems, and for linking a variety of disciplines that face these problems. A new class…

Artificial Intelligence · Computer Science 2017-05-30 Mark Lewis , Fred Glover

Bayesian optimization (BO) is well known to be sample-efficient for solving black-box problems. However, the BO algorithms can sometimes get stuck in suboptimal solutions even with plenty of samples. Intrinsically, such suboptimal problem…

Machine Learning · Computer Science 2025-01-24 Zhendong Guo , Yew-Soon Ong , Tiantian He , Haitao Liu

In this survey, we introduce Meta-Black-Box-Optimization~(MetaBBO) as an emerging avenue within the Evolutionary Computation~(EC) community, which incorporates Meta-learning approaches to assist automated algorithm design. Despite the…

Neural and Evolutionary Computing · Computer Science 2025-05-01 Zeyuan Ma , Hongshu Guo , Yue-Jiao Gong , Jun Zhang , Kay Chen Tan

A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization. Bayesian optimization (BO) is a powerful tool that models and optimizes such…

Machine Learning · Computer Science 2023-02-14 Tianyi Bai , Yang Li , Yu Shen , Xinyi Zhang , Wentao Zhang , Bin Cui

Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, experimental design, and database knob tuning. However, users still face challenges when applying BBO methods to their problems at hand…

Machine Learning · Computer Science 2024-05-17 Huaijun Jiang , Yu Shen , Yang Li , Beicheng Xu , Sixian Du , Wentao Zhang , Ce Zhang , Bin Cui

Optimizing expensive black-box systems with limited data is an extremely challenging problem. As a resolution, we present a new surrogate optimization approach by addressing two gaps in prior research -- unimportant input variables and…

Optimization and Control · Mathematics 2021-09-10 Hadis Anahideh , Jay Rosenberger , Victoria Chen

The pursuit of universal black-box optimization (BBO) algorithms is a longstanding goal. However, unlike domains such as language or vision, where scaling structured data has driven generalization, progress in offline BBO remains hindered…

Machine Learning · Computer Science 2025-06-10 Rong-Xi Tan , Ming Chen , Ke Xue , Yao Wang , Yaoyuan Wang , Sheng Fu , Chao Qian

Bayesian optimization (BO) is a powerful black-box optimization framework that looks to efficiently learn the global optimum of an unknown system by systematically trading-off between exploration and exploitation. However, the use of BO as…

Optimization and Control · Mathematics 2023-03-28 Dinesh Krishnamoorthy , Joel A. Paulson

Black-box optimization (BBO) algorithms are concerned with finding the best solutions for problems with missing analytical details. Most classical methods for such problems are based on strong and fixed a priori assumptions, such as…

Machine Learning · Computer Science 2023-02-01 Minfang Lu , Shuai Ning , Shuangrong Liu , Fengyang Sun , Bo Zhang , Bo Yang , Lin Wang

Bayesian Optimization (BO) is a widely used approach for blackbox optimization that leverages a Gaussian process (GP) model and an acquisition function to guide future sampling. While effective in low-dimensional settings, BO faces…

Machine Learning · Computer Science 2025-11-26 Pavankumar Koratikere , Leifur Leifsson

The Quadratic Unconstrained Binary Optimization (QUBO) modeling and solution framework is a requirement for quantum and digital annealers. However optimality for QUBO problems of any practical size is extremely difficult to achieve. In…

Artificial Intelligence · Computer Science 2021-05-13 Amit Verma , Mark Lewis

This work is in the context of blackbox optimization where the functions defining the problem are expensive to evaluate and where no derivatives are available. A tried and tested technique is to build surrogates of the objective and the…

Optimization and Control · Mathematics 2022-08-18 Charles Audet , Sébastien Le Digabel , Renaud Saltet

The global optimization of a high-dimensional black-box function under black-box constraints is a pervasive task in machine learning, control, and engineering. These problems are challenging since the feasible set is typically non-convex…

Machine Learning · Computer Science 2021-03-02 David Eriksson , Matthias Poloczek