English
Related papers

Related papers: Time Efficiency in Optimization with a Bayesian-Ev…

200 papers

Co-evolutionary algorithms have a wide range of applications, such as in hardware design, evolution of strategies for board games, and patching software bugs. However, these algorithms are poorly understood and applications are often…

Neural and Evolutionary Computing · Computer Science 2025-09-25 Per Kristian Lehre

Bayesian optimization (BO) is a successful methodology to optimize black-box functions that are expensive to evaluate. While traditional methods optimize each black-box function in isolation, there has been recent interest in speeding up BO…

Machine Learning · Statistics 2019-09-30 Valerio Perrone , Huibin Shen , Matthias Seeger , Cedric Archambeau , Rodolphe Jenatton

Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries. However, many…

Machine Learning · Statistics 2018-08-06 Zi Wang , Clement Gehring , Pushmeet Kohli , Stefanie Jegelka

Bayesian Optimization aims at optimizing an unknown non-convex/concave function that is costly to evaluate. We are interested in application scenarios where concurrent function evaluations are possible. Under such a setting, BO could choose…

Artificial Intelligence · Computer Science 2012-05-02 Javad Azimi , Ali Jalali , Xiaoli Fern

Recent advances in data-driven evolutionary algorithms (EAs) have demonstrated the potential of leveraging historical data to improve optimization accuracy and adaptability. Despite these advancements, existing methods remain reliant on…

Neural and Evolutionary Computing · Computer Science 2026-02-16 Tao Jiang , Kebin Sun , Zhenyu Liang , Ran Cheng , Yaochu Jin , Kay Chen Tan

Selecting the optimal combination of a machine learning (ML) algorithm and its hyper-parameters is crucial for the development of high-performance ML systems. However, since the combination of ML algorithms and hyper-parameters is enormous,…

Machine Learning · Computer Science 2025-02-14 Kazuki Ishikawa , Ryota Ozaki , Yohei Kanzaki , Ichiro Takeuchi , Masayuki Karasuyama

Population-based evolutionary algorithms are often considered when approaching computationally expensive black-box optimization problems. They employ a selection mechanism to choose the best solutions from a given population after comparing…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Judith Echevarrieta , Etor Arza , Aritz Pérez

Evolutionary algorithms (EA), a class of stochastic search methods based on the principles of natural evolution, have received widespread acclaim for their exceptional performance in various real-world optimization problems. While…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Yanjie Song , Yutong Wu , Yangyang Guo , Ran Yan , P. N. Suganthan , Yue Zhang , Witold Pedrycz , Swagatam Das , Rammohan Mallipeddi , Oladayo Solomon Ajani. Qiang Feng

Many science and engineering applications require finding solutions to planning and optimization problems by satisfying a set of constraints. These constraint problems (CPs) are typically NP-complete and can be formalized as constraint…

Neural and Evolutionary Computing · Computer Science 2024-02-13 Anuraganand Sharma

In recent years, many design automation methods have been developed to routinely create approximate implementations of circuits and programs that show excellent trade-offs between the quality of output and required resources. This paper…

Neural and Evolutionary Computing · Computer Science 2021-08-17 Lukas Sekanina

Bayesian optimization (BO) is a popular algorithm for solving challenging optimization tasks. It is designed for problems where the objective function is expensive to evaluate, perhaps not available in exact form, without gradient…

Machine Learning · Statistics 2018-08-22 Umberto Noè , Dirk Husmeier

This report presents the test results Python library BaumEvA, which implements evolutionary algorithms for optimizing various types of problems, including computer vision tasks accompanied by the search for optimal model architectures.…

Neural and Evolutionary Computing · Computer Science 2024-05-03 Vadim Tynchenko , Aleksei Kudryavtsev , Vladimir Nelyub , Aleksei Borodulin , Andrei Gantimurov

Bayesian optimization (BO) algorithms form a class of surrogate-based heuristics, aimed at efficiently computing high-quality solutions for numerical black-box optimization problems. The BO pipeline is highly modular, with different design…

Machine Learning · Computer Science 2022-11-18 Carolin Benjamins , Anja Jankovic , Elena Raponi , Koen van der Blom , Marius Lindauer , Carola Doerr

Robotic automation is a key technology that increases the efficiency and flexibility of manufacturing processes. However, one of the challenges in deploying robots in novel environments is finding the optimal base pose for the robot, which…

Robotics · Computer Science 2026-03-10 Matthias Mayer , Matthias Althoff

Surrogate-assisted evolutionary algorithms (SAEAs) are recently among the most widely studied methods for their capability to solve expensive real-world optimization problems. However, the development of new methods and benchmarking with…

Neural and Evolutionary Computing · Computer Science 2024-02-27 Jakub Kudela , Ladislav Dobrovsky

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment.…

Machine Learning · Computer Science 2023-09-15 Mohamed Aziz Bhouri , Michael Joly , Robert Yu , Soumalya Sarkar , Paris Perdikaris

Bayesian optimization (BO) is among the most effective and widely-used blackbox optimization methods. BO proposes solutions according to an explore-exploit trade-off criterion encoded in an acquisition function, many of which are computed…

Machine Learning · Computer Science 2021-02-19 Louis C. Tiao , Aaron Klein , Matthias Seeger , Edwin V. Bonilla , Cedric Archambeau , Fabio Ramos

Bayesian optimization (BO) provides a powerful framework for optimizing black-box, expensive-to-evaluate functions. It is therefore an attractive tool for engineering design problems, typically involving multiple objectives. Thanks to the…

Machine Learning · Computer Science 2024-09-06 Navid Ansari , Alireza Javanmardi , Eyke Hüllermeier , Hans-Peter Seidel , Vahid Babaei

Multi-objective optimization problems whose objectives have different evaluation costs are commonly seen in the real world. Such problems are now known as multi-objective optimization problems with heterogeneous objectives (HE-MOPs). So…

Neural and Evolutionary Computing · Computer Science 2022-08-26 Xilu Wang , Yaochu Jin , Sebastian Schmitt , Markus Olhofer

This paper proposes the incremental Bayesian optimization algorithm (iBOA), which modifies standard BOA by removing the population of solutions and using incremental updates of the Bayesian network. iBOA is shown to be able to learn and…

Neural and Evolutionary Computing · Computer Science 2008-07-30 Martin Pelikan , Kumara Sastry , David E. Goldberg