English
Related papers

Related papers: Benchmarking the Hooke-Jeeves Method, MTS-LS1, and…

200 papers

Bayesian optimisation (BO) is a surrogate-based optimisation technique that efficiently solves expensive black-box functions with small evaluation budgets. Recent studies consider trust regions to improve the scalability of BO approaches…

Neural and Evolutionary Computing · Computer Science 2025-11-04 Kokila Kasuni Perera , Frank Neumann , Aneta Neumann

We are focusing on bound constrained global optimization problems, whose objective functions are computationally expensive black-box functions and have multiple local minima. The recently popular Metric Stochastic Response Surface (MSRS)…

Machine Learning · Statistics 2014-10-24 Yilun Wang , Christine A. Shoemaker

The key to Black-Box Optimization is to efficiently search through input regions with potentially widely-varying numerical properties, to achieve low-regret descent and fast progress toward the optima. Monte Carlo Tree Search (MCTS) methods…

Machine Learning · Computer Science 2022-11-03 Yaoguang Zhai , Sicun Gao

Black-box optimization (BBO) addresses problems where objectives are accessible only through costly queries without gradients or explicit structure. Classical derivative-free methods -- line search, direct search, and model-based solvers…

Machine Learning · Computer Science 2025-10-01 Morteza Kimiaei , Vyacheslav Kungurtsev

We focus on collaborative and federated black-box optimization (BBOpt), where agents optimize their heterogeneous black-box functions through collaborative sequential experimentation. From a Bayesian optimization perspective, we address the…

Machine Learning · Computer Science 2025-08-25 Raed Al Kontar

The generalization abilities of heuristic optimizers may deteriorate with the increment of the search space dimensionality. To achieve generalized performance across Large Scale Blackbox Optimization (LSBO) tasks, it ispossible to ensemble…

Neural and Evolutionary Computing · Computer Science 2019-09-19 Mingde Zhao , Hongwei Ge , Yi Lian , Kai Zhang

When solving optimization problems with black-box approaches, the algorithms gather valuable information about the problem instance during the optimization process. This information is used to adjust the distributions from which new…

Neural and Evolutionary Computing · Computer Science 2023-01-13 Dominik Schröder , Diederick Vermetten , Hao Wang , Carola Doerr , Thomas Bäck

Black-box optimization (BBO) involves functions that are unknown, inexact and/or expensive-to-evaluate. Existing BBO algorithms face several challenges, including high computational cost from extensive evaluations, difficulty in handling…

Optimization and Control · Mathematics 2025-09-26 Zixuan Zhang , Xiaowei Song , Jiaming Li , Yujiao Zeng , Yaling Nie , Min Zhu , Dongyun Lu , Yibo Zhang , Xin Xiao , Jie Li

Subsampling is a widely used and effective approach for addressing the computational challenges posed by massive datasets. Substantial progress has been made in developing non-uniform, probability-based subsampling schemes that prioritize…

Methodology · Statistics 2026-05-07 Dingyi Wang , Haiying Wang , Qingpei Hu

The application of machine learning (ML) models to the analysis of optimization algorithms requires the representation of optimization problems using numerical features. These features can be used as input for ML models that are trained to…

Machine Learning · Computer Science 2023-06-12 Gjorgjina Cenikj , Gašper Petelin , Carola Doerr , Peter Korošec , Tome Eftimov

Bayesian optimization (BO) is an efficient framework for optimizing expensive black-box functions. However, it is typically formulated as learning an end-to-end mapping from inputs to scalar objectives, thereby discarding the potentially…

Machine Learning · Computer Science 2026-05-12 Wenbin Wang , Colin N. Jones

Black-box optimization problems often require simultaneously optimizing different types of variables, such as continuous, integer, and categorical variables. Unlike integer variables, categorical variables do not necessarily have a…

Neural and Evolutionary Computing · Computer Science 2025-05-22 Ryoki Hamano , Shota Saito , Masahiro Nomura , Kento Uchida , Shinichi Shirakawa

This paper addresses the Optimal Transmission Switching (OTS) problem in electricity networks, which aims to find an optimal power grid topology that minimizes system operation costs while satisfying physical and operational constraints.…

Optimization and Control · Mathematics 2024-04-08 Salvador Pineda , Juan Miguel Morales , Álvaro Porras , Concepción Domínguez

Several test function suites are being used for numerical benchmarking of multiobjective optimization algorithms. While they have some desirable properties, like well-understood Pareto sets and Pareto fronts of various shapes, most of the…

Artificial Intelligence · Computer Science 2019-01-07 Dimo Brockhoff , Tea Tusar , Anne Auger , Nikolaus Hansen

We study the performance scaling of three quantum algorithms for combinatorial optimization: measurement-feedback coherent Ising machines (MFB-CIM), discrete adiabatic quantum computation (DAQC), and the D\"urr-Hoyer algorithm for quantum…

Automated algorithm performance prediction in numerical blackbox optimization often relies on problem characterizations, such as exploratory landscape analysis features. These features are typically used as inputs to machine learning models…

Artificial Intelligence · Computer Science 2025-06-23 Ana Kostovska , Carola Doerr , Sašo Džeroski , Panče Panov , Tome Eftimov

Optimizing expensive to evaluate black-box functions over an input space consisting of all permutations of d objects is an important problem with many real-world applications. For example, placement of functional blocks in hardware design…

Machine Learning · Computer Science 2021-12-03 Aryan Deshwal , Syrine Belakaria , Janardhan Rao Doppa , Dae Hyun Kim

We consider black box optimization of an unknown function in the nonparametric Gaussian process setting when the noise in the observed function values can be heavy tailed. This is in contrast to existing literature that typically assumes…

Machine Learning · Computer Science 2019-09-17 Sayak Ray Chowdhury , Aditya Gopalan

Loss functions steer the optimization direction of recommendation models and are critical to model performance, but have received relatively little attention in recent recommendation research. Among various losses, we find Softmax loss (SL)…

Machine Learning · Computer Science 2023-12-21 Junkang Wu , Jiawei Chen , Jiancan Wu , Wentao Shi , Jizhi Zhang , Xiang Wang

This study focuses on mixed-variable black-box optimization (MV-BBO), addressing continuous, integer, and categorical variables. Many real-world MV-BBO problems involve dependencies among these different types of variables, requiring…

Neural and Evolutionary Computing · Computer Science 2026-01-08 Ryoki Hamano , Masahiro Nomura , Shota Saito , Kento Uchida , Shinichi Shirakawa