English
Related papers

Related papers: Switching between Numerical Black-box Optimization…

200 papers

Benchmarking is essential for developing and evaluating black-box optimization algorithms, providing a structured means to analyze their search behavior. Its effectiveness relies on carefully selected problem sets used for evaluation. To…

Neural and Evolutionary Computing · Computer Science 2025-11-17 Iván Olarte Rodríguez , Maria Laura Santoni , Fabian Duddeck , Carola Doerr , Thomas Bäck , Elena Raponi

Bayesian optimisation is a sample efficient method for finding a global optimum of expensive black-box objective functions. Historic datasets from related problems can be exploited to help improve performance of Bayesian optimisation by…

Machine Learning · Computer Science 2026-01-23 Natasha Trinkle , Huong Ha , Jeffrey Chan

A major challenge in collaborative filtering methods is how to produce recommendations for cold items (items with no ratings), or integrate cold item into an existing catalog. Over the years, a variety of hybrid recommendation models have…

Information Retrieval · Computer Science 2021-12-15 Oren Barkan , Roy Hirsch , Ori Katz , Avi Caciularu , Jonathan Weill , Noam Koenigstein

In discrete-variable black-box optimization, the number of candidate solutions grows combinatorially, while each evaluation is often expensive. Therefore, it is important to identify promising solutions efficiently within a limited number…

Quantum Physics · Physics 2026-05-12 Reo Shikanai , Masayuki Ohzeki

We present an approach, which we term quantum-enhanced optimization, to accelerate classical optimization algorithms by leveraging quantum sampling. Our method uses quantum-generated samples as warm starts to classical heuristics for…

Quantum Physics · Physics 2025-08-25 Ieva Čepaitė , Niam Vaishnav , Leo Zhou , Ashley Montanaro

High dimensional parameter space optimization is crucial in many applications. The parameters affecting this performance can be both numerical and categorical in their type. The existing techniques of black-box optimization and visual…

Human-Computer Interaction · Computer Science 2022-05-02 Anjul Tyagi

Accurately predicting the performance of different optimization algorithms for previously unseen problem instances is crucial for high-performing algorithm selection and configuration techniques. In the context of numerical optimization,…

Neural and Evolutionary Computing · Computer Science 2021-04-23 Tome Eftimov , Anja Jankovic , Gorjan Popovski , Carola Doerr , Peter Korošec

Bayesian optimisation is a well-known sample-efficient method for the optimisation of expensive black-box functions. However when dealing with big search spaces the algorithm goes through several low function value regions before reaching…

Machine Learning · Computer Science 2020-03-31 Anil Ramachandran , Sunil Gupta , Santu Rana , Cheng Li , Svetha Venkatesh

Black-box optimization (BBO) involves functions that are unknown, inexact and/or expensive-to-evaluate. Existing BBO algorithms face several challenges, including high computational cost from extensive evaluations, difficulty in handling…

Optimization and Control · Mathematics 2025-09-26 Zixuan Zhang , Xiaowei Song , Jiaming Li , Yujiao Zeng , Yaling Nie , Min Zhu , Dongyun Lu , Yibo Zhang , Xin Xiao , Jie Li

Optimal decision making requires that classifiers produce uncertainty estimates consistent with their empirical accuracy. However, deep neural networks are often under- or over-confident in their predictions. Consequently, methods have been…

We develop the first Bayesian Optimization algorithm, BLOSSOM, which selects between multiple alternative acquisition functions and traditional local optimization at each step. This is combined with a novel stopping condition based on…

Machine Learning · Statistics 2018-05-23 Mark McLeod , Michael A. Osborne , Stephen J. Roberts

In this paper, we make the key delineation on the roles of resolution and statistical uncertainty in hierarchical bandits-based black-box optimization algorithms, guiding a more general analysis and a more efficient algorithm design. We…

Machine Learning · Statistics 2023-06-01 Wenjie Li , Chi-Hua Wang , Guang Cheng , Qifan Song

Bayesian optimization is a sample-efficient method for solving expensive, black-box optimization problems. Stochastic programming concerns optimization under uncertainty where, typically, average performance is the quantity of interest. In…

Machine Learning · Statistics 2025-02-19 Jack M. Buckingham , Ivo Couckuyt , Juergen Branke

Offline optimization aims to maximize a black-box objective function with a static dataset and has wide applications. In addition to the objective function being black-box and expensive to evaluate, numerous complex real-world problems…

Machine Learning · Computer Science 2024-06-07 Ke Xue , Rong-Xi Tan , Xiaobin Huang , Chao Qian

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

Machine Learning · Statistics 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

Energy systems optimization problems are complex due to strongly non-linear system behavior and multiple competing objectives, e.g. economic gain vs. environmental impact. Moreover, a large number of input variables and different variable…

Deep learning algorithms have recently shown to be a successful tool in estimating parameters of statistical models for which simulation is easy, but likelihood computation is challenging. But the success of these approaches depends on…

Machine Learning · Statistics 2024-02-20 Amanda Lenzi , Haavard Rue

Black-box and preference-based optimization algorithms are global optimization procedures that aim to find the global solutions of an optimization problem using, respectively, the least amount of function evaluations or sample comparisons…

Optimization and Control · Mathematics 2022-02-04 Davide Previtali , Mirko Mazzoleni , Antonio Ferramosca , Fabio Previdi

Closed queuing networks with finite capacity buffers and skip-over policies are fundamental models in the performance evaluation of computer and communication systems. This technical report presents the details of computational algorithms…

Performance · Computer Science 2024-09-13 Gianfranco Balbo , Andrea Marin , Diletta Olliaro , Matteo Sereno

In the online packet buffering problem (also known as the unweighted FIFO variant of buffer management), we focus on a single network packet switching device with several input ports and one output port. This device forwards unit-size,…

Data Structures and Algorithms · Computer Science 2012-08-15 Marcin Bienkowski