English
Related papers

Related papers: On the Influence of the Feature Computation Budget…

200 papers

Feature-based offline algorithm selection has shown its effectiveness in a wide range of optimization problems, including the black-box optimization problem. An algorithm selection system selects the most promising optimizer from an…

Machine Learning · Computer Science 2024-05-21 Takushi Yoshikawa , Ryoji Tanabe

The selection of the most appropriate algorithm to solve a given problem instance, known as algorithm selection, is driven by the potential to capitalize on the complementary performance of different algorithms across sets of problem…

Machine Learning · Computer Science 2024-06-12 Gjorgjina Cenikj , Ana Nikolikj , Gašper Petelin , Niki van Stein , Carola Doerr , Tome Eftimov

The performance of automated algorithm selection (AAS) strongly depends on the portfolio of algorithms to choose from. Selecting the portfolio is a non-trivial task that requires balancing the trade-off between the higher flexibility of…

It has long been observed that for practically any computational problem that has been intensely studied, different instances are best solved using different algorithms. This is particularly pronounced for computationally hard problems,…

Machine Learning · Computer Science 2018-11-29 Pascal Kerschke , Holger H. Hoos , Frank Neumann , Heike Trautmann

Feature-based algorithm selection aims to automatically find the best one from a portfolio of optimization algorithms on an unseen problem based on its landscape features. Feature-based algorithm selection has recently received attention in…

Neural and Evolutionary Computing · Computer Science 2022-04-27 Ryoji Tanabe

Evaluating the performance of heuristic optimisation algorithms is essential to determine how well they perform under various conditions. Recently, the BIAS toolbox was introduced as a behaviour benchmark to detect structural bias (SB) in…

Neural and Evolutionary Computing · Computer Science 2023-04-05 Bas van Stein , Diederick Vermetten , Fabio Caraffini , Anna V. Kononova

The aim of black-box optimization is to optimize an objective function within the constraints of a given evaluation budget. In this problem, it is generally assumed that the computational cost for evaluating a point is large; thus, it is…

Machine Learning · Statistics 2019-12-03 Masahiro Nomura , Kenshi Abe

When faced with a specific optimization problem, choosing which algorithm to use is always a tough task. Not only is there a vast variety of algorithms to select from, but these algorithms often are controlled by many hyperparameters, which…

Neural and Evolutionary Computing · Computer Science 2020-01-07 Diederick Vermetten , Hao Wang , Carola Doerr , Thomas Bäck

Black box optimization requires specifying a search space to explore for solutions, e.g. a d-dimensional compact space, and this choice is critical for getting the best results at a reasonable budget. Unfortunately, determining a high…

Machine Learning · Computer Science 2021-12-20 Setareh Ariafar , Justin Gilmer , Zachary Nado , Jasper Snoek , Rodolphe Jenatton , George E. Dahl

In typical black-box optimization applications, the available computational budget is often allocated to a single algorithm, typically chosen based on user preference with limited knowledge about the problem at hand or according to some…

Neural and Evolutionary Computing · Computer Science 2026-01-26 Catalin-Viorel Dinu , Diederick Vermetten , Carola Doerr

In black-box optimization, a central question is which algorithm to use to solve a given, previously unseen, problem. Selecting a single algorithm, however, entails inherent risks: inaccuracies in the selector may lead to poor choices, and…

Neural and Evolutionary Computing · Computer Science 2026-04-21 Catalin-Viorel Dinu , Diederick Vermetten , Carola Doerr

Algorithm selection, aiming to identify the best algorithm for a given problem, plays a pivotal role in continuous black-box optimization. A common approach involves representing optimization functions using a set of features, which are…

Machine Learning · Computer Science 2025-05-13 Gašper Petelin , Gjorgjina Cenikj

Optimization problems are crucial in artificial intelligence. Optimization algorithms are generally used to adjust the performance of artificial intelligence models to minimize the error of mapping inputs to outputs. Current evaluation…

Artificial Intelligence · Computer Science 2021-11-23 Zhicheng He

In the machine learning algorithms, the choice of the hyperparameter is often an art more than a science, requiring labor-intensive search with expert experience. Therefore, automation on hyperparameter optimization to exclude human…

Machine Learning · Computer Science 2020-12-08 Taehyeon Kim , Jaeyeon Ahn , Nakyil Kim , Seyoung Yun

We formulate selecting the best optimizing system (SBOS) problems and provide solutions for those problems. In an SBOS problem, a finite number of systems are contenders. Inside each system, a continuous decision variable affects the…

Methodology · Statistics 2025-11-04 Nian Si , Yifu Tang , Zeyu Zheng

One of the most challenging problems in evolutionary computation is to select from its family of diverse solvers one that performs well on a given problem. This algorithm selection problem is complicated by the fact that different phases of…

Neural and Evolutionary Computing · Computer Science 2020-06-12 Diederick Vermetten , Hao Wang , Carola Doerr , Thomas Bäck

The best algorithm for a computational problem generally depends on the "relevant inputs," a concept that depends on the application domain and often defies formal articulation. While there is a large literature on empirical approaches to…

Machine Learning · Computer Science 2016-09-06 Rishi Gupta , Tim Roughgarden

We introduce a variational quantum algorithm to solve unconstrained black box binary optimization problems, i.e., problems in which the objective function is given as black box. This is in contrast to the typical setting of quantum…

In many real-world problems, we want to infer some property of an expensive black-box function $f$, given a budget of $T$ function evaluations. One example is budget constrained global optimization of $f$, for which Bayesian optimization is…

Machine Learning · Statistics 2021-07-07 Willie Neiswanger , Ke Alexander Wang , Stefano Ermon

We consider Bayesian optimization of an expensive-to-evaluate black-box objective function, where we also have access to cheaper approximations of the objective. In general, such approximations arise in applications such as reinforcement…

Machine Learning · Statistics 2016-11-16 Matthias Poloczek , Jialei Wang , Peter I. Frazier
‹ Prev 1 2 3 10 Next ›