English
Related papers

Related papers: Complexity Theory for Discrete Black-Box Optimizat…

200 papers

The aim of black-box optimization is to optimize an objective function within the constraints of a given evaluation budget. In this problem, it is generally assumed that the computational cost for evaluating a point is large; thus, it is…

Machine Learning · Statistics 2019-12-03 Masahiro Nomura , Kenshi Abe

We propose a new black-box complexity model for search algorithms evaluating $\lambda$ search points in parallel. The parallel unary unbiased black-box complexity gives lower bounds on the number of function evaluations every parallel unary…

Neural and Evolutionary Computing · Computer Science 2019-02-04 Per Kristian Lehre , Dirk Sudholt

In many optimization problems arising from scientific, engineering and artificial intelligence applications, objective and constraint functions are available only as the output of a black-box or simulation oracle that does not provide…

Optimization and Control · Mathematics 2019-08-15 Jeffrey Larson , Matt Menickelly , Stefan M. Wild

Traditional wireless network design relies on optimization algorithms derived from domain-specific mathematical models, which are often inefficient and unsuitable for dynamic, real-time applications due to high complexity. Deep learning has…

Machine Learning · Computer Science 2024-12-13 Sinem Coleri , Aysun Gurur Onalan , Marco di Renzo

Machine Learning algorithms have been extensively researched throughout the last decade, leading to unprecedented advances in a broad range of applications, such as image classification and reconstruction, object recognition, and text…

Artificial Intelligence · Computer Science 2022-12-20 Gustavo H. de Rosa , Mateus Roder , João Paulo Papa , Claudio F. G. dos Santos

Feature-based offline algorithm selection has shown its effectiveness in a wide range of optimization problems, including the black-box optimization problem. An algorithm selection system selects the most promising optimizer from an…

Machine Learning · Computer Science 2024-05-21 Takushi Yoshikawa , Ryoji Tanabe

While modern parallel computing systems offer high performance, utilizing these powerful computing resources to the highest possible extent demands advanced knowledge of various hardware architectures and parallel programming models.…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-03 Suejb Memeti , Sabri Pllana , Alecio Binotto , Joanna Kolodziej , Ivona Brandic

The research area of real-time heuristics search has produced quite many algorithms. In the landscape of real-time heuristics search research, it is not rare to find that an algorithm X that appears to perform better than algorithm Y on a…

Artificial Intelligence · Computer Science 2018-05-23 Md Solimul Chowdhury , Victor Silva

It is becoming increasingly apparent that probabilistic approaches can overcome conservatism and computational complexity of the classical worst-case deterministic framework and may lead to designs that are actually safer. In this paper we…

Applications · Statistics 2008-11-01 Xinjia Chen , Kemin Zhou , Jorge L. Aravena

Decision tree learning is a widely used approach in machine learning, favoured in applications that require concise and interpretable models. Heuristic methods are traditionally used to quickly produce models with reasonably high accuracy.…

Evolutionary algorithms have been frequently applied to constrained continuous optimisation problems. We carry out feature based comparisons of different types of evolutionary algorithms such as evolution strategies, differential evolution…

Artificial Intelligence · Computer Science 2015-09-24 Shayan Poursoltan , Frank Neumann

Heuristic algorithms have shown a good ability to solve a variety of optimization problems. Stockpile blending problem as an important component of the mine scheduling problem is an optimization problem with continuous search space…

Neural and Evolutionary Computing · Computer Science 2021-02-11 Yue Xie , Aneta Neumann , Frank Neumann

The quality of enumeration algorithms is often measured by their delay, that is, the maximal time spent between the output of two distinct solutions. If the goal is to enumerate $t$ distinct solutions for any given $t$, then another…

Computational Complexity · Computer Science 2024-09-04 Florent Capelli , Yann Strozecki

The performance of many algorithms in the fields of hard combinatorial problem solving, machine learning or AI in general depends on tuned hyperparameter configurations. Automated methods have been proposed to alleviate users from the…

Machine Learning · Computer Science 2019-08-23 André Biedenkapp , H. Furkan Bozkurt , Frank Hutter , Marius Lindauer

How can robots learn and adapt to new tasks and situations with little data? Systematic exploration and simulation are crucial tools for efficient robot learning. We present a novel black-box policy search algorithm focused on…

Robotics · Computer Science 2025-02-11 Shiming He , Alexander von Rohr , Dominik Baumann , Ji Xiang , Sebastian Trimpe

In an era where data-driven decision-making and computational efficiency are paramount, optimization plays a foundational role in advancing fields such as mathematics, computer science, operations research, machine learning, and beyond.…

Numerical Analysis · Mathematics 2025-03-11 Jun Lu

In certain real-world optimization scenarios, practitioners are not interested in solving multiple problems but rather in finding the best solution to a single, specific problem. When the computational budget is large relative to the cost…

Machine Learning · Computer Science 2026-02-10 Judith Echevarrieta , Etor Arza , Aritz Pérez , Josu Ceberio

Feature-based algorithm selection aims to automatically find the best one from a portfolio of optimization algorithms on an unseen problem based on its landscape features. Feature-based algorithm selection has recently received attention in…

Neural and Evolutionary Computing · Computer Science 2022-04-27 Ryoji Tanabe

We consider black-box optimization in which only an extremely limited number of function evaluations, on the order of around 100, are affordable and the function evaluations must be performed in even fewer batches of a limited number of…

Machine Learning · Computer Science 2021-03-19 Carlos Ansotegui , Meinolf Sellmann , Tapan Shah , Kevin Tierney

A frequently studied performance measure in online optimization is competitive analysis. It corresponds to the worst-case ratio, over all possible inputs of an algorithm, between the performance of the algorithm and the optimal offline…

Optimization and Control · Mathematics 2024-05-30 Antoine Lhomme , Nicolas Catusse , Nadia Brauner