English
Related papers

Related papers: Black-box Optimization with Simultaneous Statistic…

200 papers

In blackbox optimization, evaluation of the objective and constraint functions is time consuming. In some situations, constraint values may be evaluated independently or sequentially. The present work proposes and compares two strategies to…

Optimization and Control · Mathematics 2021-11-30 Stéphane Alarie , Charles Audet , Paulin Jacquot , Sébastien Le Digabel

This paper studies the black-box optimization task which aims to find the maxima of a black-box function using a static set of its observed input-output pairs. This is often achieved via learning and optimizing a surrogate function with…

Machine Learning · Computer Science 2025-10-24 Manh Cuong Dao , The Hung Tran , Phi Le Nguyen , Thao Nguyen Truong , Trong Nghia Hoang

Many challenges in science and engineering, such as drug discovery and communication network design, involve optimizing complex and expensive black-box functions across vast search spaces. Thus, it is essential to leverage existing data to…

Machine Learning · Computer Science 2024-12-04 Juncheng Dong , Zihao Wu , Hamid Jafarkhani , Ali Pezeshki , Vahid Tarokh

The core challenge of high-dimensional and expensive black-box optimization (BBO) is how to obtain better performance faster with little function evaluation cost. The essence of the problem is how to design an efficient optimization…

Machine Learning · Computer Science 2023-07-26 Xiaobin Li , Kai Wu , Xiaoyu Zhang , Handing Wang , Jing Liu

Black-box policy optimization is a class of reinforcement learning algorithms that explores and updates the policies at the parameter level. This class of algorithms is widely applied in robotics with movement primitives or…

Machine Learning · Computer Science 2022-03-22 Marius Memmel , Puze Liu , Davide Tateo , Jan Peters

Bayesian Optimization is the state of the art technique for the optimization of black boxes, i.e., functions where we do not have access to their analytical expression nor its gradients, they are expensive to evaluate and its evaluation is…

Artificial Intelligence · Computer Science 2021-01-13 Eduardo C. Garrido Merchán , Luis C. Jariego Pérez

Though black-box predictors are state-of-the-art for many complex tasks, they often fail to properly quantify predictive uncertainty and may provide inappropriate predictions for unfamiliar data. Instead, we can learn more reliable models…

Machine Learning · Statistics 2021-12-14 Jean Feng , Arjun Sondhi , Jessica Perry , Noah Simon

One way to reduce the time of conducting optimization studies is to evaluate designs in parallel rather than just one-at-a-time. For expensive-to-evaluate black-boxes, batch versions of Bayesian optimization have been proposed. They work by…

Optimization and Control · Mathematics 2023-04-04 Mickael Binois , Nicholson Collier , Jonathan Ozik

Constraining Beyond the Standard Model theories usually involves scanning highly multi-dimensional parameter spaces and check observable predictions against experimental bounds and theoretical constraints. Such task is often timely and…

High Energy Physics - Phenomenology · Physics 2023-02-08 Fernando Abreu de Souza , Miguel Crispim Romão , Nuno Filipe Castro , Mehraveh Nikjoo , Werner Porod

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

Machine Learning · Statistics 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

In the machine learning algorithms, the choice of the hyperparameter is often an art more than a science, requiring labor-intensive search with expert experience. Therefore, automation on hyperparameter optimization to exclude human…

Machine Learning · Computer Science 2020-12-08 Taehyeon Kim , Jaeyeon Ahn , Nakyil Kim , Seyoung Yun

Although a large number of optimization algorithms have been proposed for black box optimization problems, the no free lunch theorems inform us that no algorithm can beat others on all types of problems. Different types of optimization…

Neural and Evolutionary Computing · Computer Science 2020-01-07 Yaodong He , Shiu Yin Yuen

We consider the problem of finding an input to a stochastic black box function such that the scalar output of the black box function is as close as possible to a target value in the sense of the expected squared error. While the…

Machine Learning · Computer Science 2023-05-16 Johannes G. Hoffer , Sascha Ranftl , Bernhard C. Geiger

Bin packing is a classic optimization problem with a wide range of applications, from load balancing to supply chain management. In this work, we study the online variant of the problem, in which a sequence of items of various sizes must be…

Data Structures and Algorithms · Computer Science 2024-04-18 Spyros Angelopoulos , Shahin Kamali , Kimia Shadkami

Black-box optimization is ubiquitous in machine learning, operations research and engineering simulation. Black-box optimization algorithms typically do not assume structural information about the objective function and thus must make use…

Optimization and Control · Mathematics 2024-07-19 Rohan Rele , Zelda Zabinsky , Giulia Pedrielli , Aleksandr Aravkin

Bayesian optimization (BO) is a sample-efficient method and has been widely used for optimizing expensive black-box functions. Recently, there has been a considerable interest in BO literature in optimizing functions that are affected by…

Machine Learning · Computer Science 2023-12-22 Xiaobin Huang , Lei Song , Ke Xue , Chao Qian

A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization. Bayesian optimization (BO) is a powerful tool that models and optimizes such…

Machine Learning · Computer Science 2023-02-14 Tianyi Bai , Yang Li , Yu Shen , Xinyi Zhang , Wentao Zhang , Bin Cui

Studies on simulation input uncertainty often built on the availability of input data. In this paper, we investigate an inverse problem where, given only the availability of output data, we nonparametrically calibrate the input models and…

Optimization and Control · Mathematics 2018-01-09 Aleksandrina Goeva , Henry Lam , Huajie Qian , Bo Zhang

Rank-based metrics are some of the most widely used criteria for performance evaluation of computer vision models. Despite years of effort, direct optimization for these metrics remains a challenge due to their non-differentiable and…

Machine Learning · Computer Science 2024-12-16 Michal Rolínek , Vít Musil , Anselm Paulus , Marin Vlastelica , Claudio Michaelis , Georg Martius

Simulation models, in particular agent-based models, are gaining popularity in economics. The considerable flexibility they offer, as well as their capacity to reproduce a variety of empirically observed behaviours of complex systems, give…

Econometrics · Economics 2024-02-20 Joel Dyer , Patrick Cannon , J. Doyne Farmer , Sebastian Schmon