English
Related papers

Related papers: Black-Box Optimization with Implicit Constraints f…

200 papers

Bayesian optimization (BO) is among the most effective and widely-used blackbox optimization methods. BO proposes solutions according to an explore-exploit trade-off criterion encoded in an acquisition function, many of which are computed…

Machine Learning · Computer Science 2021-02-19 Louis C. Tiao , Aaron Klein , Matthias Seeger , Edwin V. Bonilla , Cedric Archambeau , Fabio Ramos

This paper discusses a scenario approach to robust optimization of a blackbox function in a bandit setting. We assume that the blackbox function can be modeled as a Gaussian Process (GP) for every realization of the uncertain parameter. We…

Optimization and Control · Mathematics 2018-05-01 Shaunak D. Bopardikar , Vaibhav Srivastava

This research reports on the recent development of a black-box optimization method based on single-step deep reinforcement learning (DRL), and on its conceptual proximity to evolution strategy (ES) techniques. In the fashion of policy…

Optimization and Control · Mathematics 2021-11-29 Jonathan Viquerat , Régis Duvigneau , Philippe Meliga , Alexander Kuhnle , Elie Hachem

We study offline black-box optimization (BBO), aiming to discover improved designs from an offline dataset of designs and labels, a problem common in robotics, DNA, and materials science with limited labeled samples. While recent work…

Computational Engineering, Finance, and Science · Computer Science 2026-05-26 Zipeng Sun , Can Chen , Ye Yuan , Haolun Wu , Jiayao Gu , Christopher Pal , Xue Liu

Recent advances have extended the scope of Bayesian optimization (BO) to expensive-to-evaluate black-box functions with dozens of dimensions, aspiring to unlock impactful applications, for example, in the life sciences, neural architecture…

Machine Learning · Computer Science 2026-05-15 Leonard Papenmeier , Luigi Nardi , Matthias Poloczek

The use of black-box optimization for the design of new biological sequences is an emerging research area with potentially revolutionary impact. The cost and latency of wet-lab experiments requires methods that find good sequences in few…

Machine Learning · Computer Science 2020-07-14 Christof Angermueller , David Belanger , Andreea Gane , Zelda Mariet , David Dohan , Kevin Murphy , Lucy Colwell , D Sculley

Bilevel optimization is characterized by a two-level optimization structure, where the upper-level problem is constrained by optimal lower-level solutions, and such structures are prevalent in real-world problems. The constraint by optimal…

Machine Learning · Computer Science 2025-05-29 Ruth Wan Theng Chew , Quoc Phong Nguyen , Bryan Kian Hsiang Low

One of the most challenging problems in evolutionary computation is to select from its family of diverse solvers one that performs well on a given problem. This algorithm selection problem is complicated by the fact that different phases of…

Neural and Evolutionary Computing · Computer Science 2020-06-12 Diederick Vermetten , Hao Wang , Carola Doerr , Thomas Bäck

Many black-box optimization tasks arising in high-stakes applications require risk-averse decisions. The standard Bayesian optimization (BO) paradigm, however, optimizes the expected value only. We generalize BO to trade mean and…

Machine Learning · Computer Science 2021-11-10 Anastasiia Makarova , Ilnura Usmanova , Ilija Bogunovic , Andreas Krause

Controller tuning is crucial for closed-loop performance but often involves manual adjustments. Although Bayesian optimization (BO) has been established as a data-efficient method for automated tuning, applying it to large and…

Systems and Control · Electrical Eng. & Systems 2024-11-26 Alexander von Rohr , David Stenger , Dominik Scheurenberg , Sebastian Trimpe

We propose a novel Bayesian Optimization approach for black-box functions with an environmental variable whose value determines the tradeoff between evaluation cost and the fidelity of the evaluations. Further, we use a novel approach to…

Machine Learning · Statistics 2018-05-16 Mark McLeod , Michael A. Osborne , Stephen J. Roberts

Many real world scientific and industrial applications require optimizing multiple competing black-box objectives. When the objectives are expensive-to-evaluate, multi-objective Bayesian optimization (BO) is a popular approach because of…

Machine Learning · Computer Science 2022-06-17 Samuel Daulton , David Eriksson , Maximilian Balandat , Eytan Bakshy

Recent work on Bayesian optimization has shown its effectiveness in global optimization of difficult black-box objective functions. Many real-world optimization problems of interest also have constraints which are unknown a priori. In this…

Machine Learning · Statistics 2014-03-25 Michael A. Gelbart , Jasper Snoek , Ryan P. Adams

To relieve intensive human-expertise required to design optimization algorithms, recent Meta-Black-Box Optimization (MetaBBO) researches leverage generalization strength of meta-learning to train neural network-based algorithm design…

Machine Learning · Computer Science 2025-11-12 Chen Wang , Yue-Jiao Gong , Zhiguang Cao , Zeyuan Ma

Bayesian optimization has emerged as a prominent methodology for optimizing expensive black-box functions by leveraging Gaussian process surrogates, which focus on capturing the global characteristics of the objective function. However, in…

Machine Learning · Computer Science 2026-03-03 Qiyu Wei , Haowei Wang , Richard Allmendinger , Mauricio A. Álvarez

We consider the problem of learning control policies that optimize a reward function while satisfying constraints due to considerations of safety, fairness, or other costs. We propose a new algorithm, Projection-Based Constrained Policy…

Machine Learning · Computer Science 2020-10-08 Tsung-Yen Yang , Justinian Rosca , Karthik Narasimhan , Peter J. Ramadge

This paper introduces a model-free real-time optimization (RTO) framework based on unconstrained Bayesian optimization with embedded constraint control. The main contribution lies in demonstrating how this approach simplifies the black-box…

Optimization and Control · Mathematics 2024-02-29 Dinesh Krishnamoorthy

Bayesian optimization is a popular black-box optimization method for parameter learning in control and robotics. It typically requires an objective function that reflects the user's optimization goal. However, in practical applications,…

Robotics · Computer Science 2026-04-03 Johanna Menn , David Stenger , Sebastian Trimpe

In this paper, we propose a predictor-corrector type Consensus Based Optimization (CBO) algorithm on a convex feasible set. Our proposed algorithm generalizes the CBO algorithm in [11] to tackle a constrained optimization problem for the…

Optimization and Control · Mathematics 2021-10-14 Hyeong-Ohk Bae , Seung-Yeal Ha , Myeongju Kang , Hyuncheul Lim , Chanho Min , Jane Yoo

Bayesian optimization (BO) is a sample-efficient method and has been widely used for optimizing expensive black-box functions. Recently, there has been a considerable interest in BO literature in optimizing functions that are affected by…

Machine Learning · Computer Science 2023-12-22 Xiaobin Huang , Lei Song , Ke Xue , Chao Qian