English
Related papers

Related papers: On the Influence of the Feature Computation Budget…

200 papers

The performance of the Quantum Approximate Optimisation Algorithm (QAOA) relies on the setting of optimal parameters in each layer of the circuit. This is no trivial task, and much literature has focused on the challenge of finding optimal…

Quantum Physics · Physics 2024-02-14 Vivek Katial , Kate Smith-Miles , Charles Hill

Black-box optimization is a powerful approach for discovering global optima in noisy and expensive black-box functions, a problem widely encountered in real-world scenarios. Recently, there has been a growing interest in leveraging domain…

Machine Learning · Computer Science 2024-02-06 Dat Phan-Trong , Hung The Tran , Alistair Shilton , Sunil Gupta

We consider black-box optimization in which only an extremely limited number of function evaluations, on the order of around 100, are affordable and the function evaluations must be performed in even fewer batches of a limited number of…

Machine Learning · Computer Science 2021-03-19 Carlos Ansotegui , Meinolf Sellmann , Tapan Shah , Kevin Tierney

This work studies constrained blackbox optimization problems that cannot be solved in reasonable time due to prohibitive computational costs. This challenge is especially prevalent in industrial applications, where blackbox evaluations are…

Optimization and Control · Mathematics 2026-01-20 Stéphane Alarie , Charles Audet , Miguel Diago , Sébastien Le Digabel , Xavier Lebeuf

Software model optimization is a process that automatically generates design alternatives aimed at improving quantifiable non-functional properties of software systems, such as performance and reliability. Multi-objective evolutionary…

Software Engineering · Computer Science 2025-11-04 J. Andres Diaz-Pace , Daniele Di Pompeo , Michele Tucci

The notion of expense in Bayesian optimisation generally refers to the uniformly expensive cost of function evaluations over the whole search space. However, in some scenarios, the cost of evaluation for black-box objective functions is…

Machine Learning · Computer Science 2019-09-10 Majid Abdolshah , Alistair Shilton , Santu Rana , Sunil Gupta , Svetha Venkatesh

Black-box optimization is a very active area of research, with many new algorithms being developed every year. This variety is needed, on the one hand, since different algorithms are most suitable for different types of optimization…

Neural and Evolutionary Computing · Computer Science 2021-02-11 Anja Jankovic , Tome Eftimov , Carola Doerr

Automated algorithm selection promises to support the user in the decisive task of selecting a most suitable algorithm for a given problem. A common component of these machine-trained techniques are regression models which predict the…

Neural and Evolutionary Computing · Computer Science 2020-06-18 Anja Jankovic , Carola Doerr

This paper addresses the problem of constrained multi-objective optimization over black-box objective functions with practitioner-specified preferences over the objectives when a large fraction of the input space is infeasible (i.e.,…

Machine Learning · Computer Science 2023-03-24 Alaleh Ahmadianshalchi , Syrine Belakaria , Janardhan Rao Doppa

Bayesian optimization (BO) is a popular method to optimize expensive black-box functions. It efficiently tunes machine learning algorithms under the implicit assumption that hyperparameter evaluations cost approximately the same. In…

Machine Learning · Computer Science 2020-11-25 Gauthier Guinet , Valerio Perrone , Cédric Archambeau

With the advent of big data applications, which tends to have longer execution time, choosing the right cloud VM to run these applications has significant performance as well as economic implications. For example, in our large-scale…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-01 Chin-Jung Hsu , Vivek Nair , Vincent W. Freeh , Tim Menzies

We derive an optimal policy for adaptively restarting a randomized algorithm, based on observed features of the run-so-far, so as to minimize the expected time required for the algorithm to successfully terminate. Given a suitable Bayesian…

Machine Learning · Computer Science 2019-02-25 Matthew Streeter

We study a budgeted hyper-parameter tuning problem, where we optimize the tuning result under a hard resource constraint. We propose to solve it as a sequential decision making problem, such that we can use the partial training progress of…

Machine Learning · Computer Science 2019-02-05 Zhiyun Lu , Chao-Kai Chiang , Fei Sha

In black-box optimization, it is essential to understand why an algorithm instance works on a set of problem instances while failing on others and provide explanations of its behavior. We propose a methodology for formulating an algorithm…

Neural and Evolutionary Computing · Computer Science 2024-02-13 Ana Nikolikj , Sašo Džeroski , Mario Andrés Muñoz , Carola Doerr , Peter Korošec , Tome Eftimov

Bayesian Optimization (BO) is a widely-used method for optimizing expensive-to-evaluate black-box functions. Traditional BO assumes that the learner has full control over all query variables without additional constraints. However, in many…

Machine Learning · Computer Science 2024-12-23 Vu Viet Hoang , Quoc Anh Hoang Nguyen , Hung Tran The

Infrastructure-as-a-Service (IaaS) clouds offer diverse instance purchasing options. A user can either run instances on demand and pay only for what it uses, or it can prepay to reserve instances for a long period, during which a usage…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-05-27 Wei Wang , Baochun Li , Ben Liang

With this paper, we contribute to the growing research area of feature-based analysis of bio-inspired computing. In this research area, problem instances are classified according to different features of the underlying problem in terms of…

Neural and Evolutionary Computing · Computer Science 2016-02-10 Shayan Poursoltan , Frank Neumann

Feature selection is of great importance in Machine Learning, where it can be used to reduce the dimensionality of classification, ranking and prediction problems. The removal of redundant and noisy features can improve both the accuracy…

Information Retrieval · Computer Science 2022-11-15 Gloria Turati , Maurizio Ferrari Dacrema , Paolo Cremonesi

Benchmark suites, i.e. a collection of benchmark functions, are widely used in the comparison of black-box optimization algorithms. Over the years, research has identified many desired qualities for benchmark suites, such as diverse…

Neural and Evolutionary Computing · Computer Science 2021-04-16 David Issa Mattos , Lucas Ruud , Jan Bosch , Helena Holmström Olsson

Recent approaches to training algorithm selectors in the black-box optimisation domain have advocated for the use of training data that is algorithm-centric in order to encapsulate information about how an algorithm performs on an instance,…

Machine Learning · Computer Science 2025-01-22 Quentin Renau , Emma Hart