English
Related papers

Related papers: CatCMA : Stochastic Optimization for Mixed-Categor…

200 papers

This paper addresses the problem of constrained multi-objective optimization over black-box objective functions with practitioner-specified preferences over the objectives when a large fraction of the input space is infeasible (i.e.,…

Machine Learning · Computer Science 2023-03-24 Alaleh Ahmadianshalchi , Syrine Belakaria , Janardhan Rao Doppa

In typical black-box optimization applications, the available computational budget is often allocated to a single algorithm, typically chosen based on user preference with limited knowledge about the problem at hand or according to some…

Neural and Evolutionary Computing · Computer Science 2026-01-26 Catalin-Viorel Dinu , Diederick Vermetten , Carola Doerr

We consider various stochastic models that incorporate the notion of risk-averseness into the standard 2-stage recourse model, and develop novel techniques for solving the algorithmic problems arising in these models. A key notable feature…

Data Structures and Algorithms · Computer Science 2008-05-06 Chaitanya Swamy

Black-box optimization is ubiquitous in machine learning, operations research and engineering simulation. Black-box optimization algorithms typically do not assume structural information about the objective function and thus must make use…

Optimization and Control · Mathematics 2024-07-19 Rohan Rele , Zelda Zabinsky , Giulia Pedrielli , Aleksandr Aravkin

Bayesian Optimization using Gaussian Processes is a popular approach to deal with the optimization of expensive black-box functions. However, because of the a priori on the stationarity of the covariance matrix of classic Gaussian…

Machine Learning · Statistics 2019-05-10 Ali Hebbal , Loic Brevault , Mathieu Balesdent , El-Ghazali Talbi , Nouredine Melab

This paper analyzes the performance of the Fractal Decomposition Algorithm (FDA) metaheuristic applied to low-dimensional continuous optimization problems. This algorithm was originally developed specifically to deal efficiently with…

Neural and Evolutionary Computing · Computer Science 2022-10-28 Arcadi Llanza , Nadiya Shvai , Amir Nakib

Bilinear Matrix Inequalities (BMIs) are fundamental to control system design but are notoriously difficult to solve due to their nonconvexity. This study addresses BMI-based control optimization problems by adapting and integrating advanced…

Systems and Control · Electrical Eng. & Systems 2026-01-14 Syue-Cian Lin , Wei-Yu Chiu , Chien-Feng Wu

Population-based evolutionary algorithms are often considered when approaching computationally expensive black-box optimization problems. They employ a selection mechanism to choose the best solutions from a given population after comparing…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Judith Echevarrieta , Etor Arza , Aritz Pérez

We introduce a cooperative Bayesian optimization problem for optimizing black-box functions of two variables where two agents choose together at which points to query the function but have only control over one variable each. This setting…

Machine Learning · Computer Science 2024-03-08 Ali Khoshvishkaie , Petrus Mikkola , Pierre-Alexandre Murena , Samuel Kaski

In multi-objective black-box optimization, the goal is typically to find solutions that optimize a set of $T$ black-box objective functions, $f_1, \ldots f_T$, simultaneously. Traditional approaches often seek a single Pareto-optimal set…

The domain of an optimization problem is seen as one of its most important characteristics. In particular, the distinction between continuous and discrete optimization is rather impactful. Based on this, the optimizing algorithm, analyzing…

Neural and Evolutionary Computing · Computer Science 2023-04-27 André Thomaser , Jacob de Nobel , Diederick Vermetten , Furong Ye , Thomas Bäck , Anna V. Kononova

We present a data-driven Bayesian nonparametric approach for global optimization (DaBNO) of stochastic black-box function. The function value depends on the distribution of a random vector. However, this distribution is usually complex and…

Optimization and Control · Mathematics 2024-02-28 Haowei Wang , Xun Zhang , Szu Hui Ng , Songhao Wang

Bayesian Optimization (BO) methods are useful for optimizing functions that are expen- sive to evaluate, lack an analytical expression and whose evaluations can be contaminated by noise. These methods rely on a probabilistic model of the…

Machine Learning · Statistics 2020-02-04 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

As climate change increases the threat of weather-related disasters, research on weather control is gaining importance. The objective of weather control is to mitigate disaster risks by administering interventions with optimal timing,…

Atmospheric and Oceanic Physics · Physics 2025-05-19 Yuta Higuchi , Rikuto Nagai , Atsushi Okazaki , Masaki Ogura , Naoki Wakamiya

We consider derivative-free black-box global optimization of expensive noisy functions, when most of the randomness in the objective is produced by a few influential scalar random inputs. We present a new Bayesian global optimization…

Machine Learning · Computer Science 2016-02-23 Saul Toscano-Palmerin , Peter I. Frazier

Research on new optimization algorithms is often funded based on the motivation that such algorithms might improve the capabilities to deal with real-world and industrially relevant optimization challenges. Besides a huge variety of…

Neural and Evolutionary Computing · Computer Science 2020-07-02 Ramses Sala , Ralf Müller

This work concerns the evolutionary approaches to distributed stochastic black-box optimization, in which each worker can individually solve an approximation of the problem with nature-inspired algorithms. We propose a distributed evolution…

Neural and Evolutionary Computing · Computer Science 2022-04-12 Xiaoyu He , Zibin Zheng , Chuan Chen , Yuren Zhou , Chuan Luo , Qingwei Lin

There has been considerable interest in making Bayesian inference more scalable. In big data settings, most literature focuses on reducing the computing time per iteration, with less focused on reducing the number of iterations needed in…

Methodology · Statistics 2017-09-28 Leo L. Duan , James E. Johndrow , David B. Dunson

Most leading implementations of black-box variational inference (BBVI) are based on optimizing a stochastic evidence lower bound (ELBO). But such approaches to BBVI often converge slowly due to the high variance of their gradient estimates…

Multiobjective blackbox optimization deals with problems where the objective and constraint functions are the outputs of a numerical simulation. In this context, no derivatives are available, nor can they be approximated by finite…

Optimization and Control · Mathematics 2025-04-07 Sébastien Le Digabel , Antoine Lesage-Landry , Ludovic Salomon , Christophe Tribes