English
Related papers

Related papers: Time Efficiency in Optimization with a Bayesian-Ev…

200 papers

Evolutionary algorithms (EAs) have emerged as a powerful framework for optimization, especially for black-box optimization. Existing evolutionary algorithms struggle to comprehend and effectively utilize task-specific information for…

Neural and Evolutionary Computing · Computer Science 2024-12-24 Kai Wu , Xiaobin Li , Penghui Liu , Jing Liu

Bayesian optimization is an effective method to efficiently optimize unknown objective functions with high evaluation costs. Traditional Bayesian optimization algorithms select one point per iteration for single objective function, whereas…

Machine Learning · Statistics 2019-05-08 Takashi Wada , Hideitsu Hino

Known as two cornerstones of problem solving by search, exploitation and exploration are extensively discussed for implementation and application of evolutionary algorithms (EAs). However, only a few researches focus on evaluation and…

Neural and Evolutionary Computing · Computer Science 2020-01-30 Yu Chen , Jun He

Bayesian optimization (BO) is a model-based approach to sequentially optimize expensive black-box functions, such as the validation error of a deep neural network with respect to its hyperparameters. In many real-world scenarios, the…

Machine Learning · Statistics 2019-10-17 Valerio Perrone , Iaroslav Shcherbatyi , Rodolphe Jenatton , Cedric Archambeau , Matthias Seeger

This paper presents the Goat Optimization Algorithm (GOA), a novel bio-inspired metaheuristic optimization technique inspired by goats' adaptive foraging, strategic movement, and parasite avoidance behaviors.GOA is designed to balance…

Neural and Evolutionary Computing · Computer Science 2025-03-05 Hamed Nozari , Hoessein Abdi , Agnieszka Szmelter-Jarosz

We present a tutorial on Bayesian optimization, a method of finding the maximum of expensive cost functions. Bayesian optimization employs the Bayesian technique of setting a prior over the objective function and combining it with evidence…

Machine Learning · Computer Science 2010-12-14 Eric Brochu , Vlad M. Cora , Nando de Freitas

Bayesian optimization (BO) is an approach to globally optimizing black-box objective functions that are expensive to evaluate. BO-powered experimental design has found wide application in materials science, chemistry, experimental physics,…

Machine Learning · Computer Science 2023-10-10 Mimi Zhang , Andrew Parnell , Dermot Brabazon , Alessio Benavoli

Bayesian optimization (BO) methods are useful for optimizing functions that are expensive to evaluate, lack an analytical expression and whose evaluations can be contaminated by noise. These methods rely on a probabilistic model of the…

Machine Learning · Statistics 2020-02-04 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Estimation of Distribution Algorithms (EDAs) require flexible probability models that can be efficiently learned and sampled. Autoencoders (AE) are generative stochastic networks with these desired properties. We integrate a special type of…

Neural and Evolutionary Computing · Computer Science 2015-09-22 Malte Probst

The use of Evolutionary Algorithms (EA) for solving Mathematical/Computational Optimization Problems is inspired by the biological processes of Evolution. Few of the primitives involved in the Evolutionary process/paradigm are selection of…

Neural and Evolutionary Computing · Computer Science 2023-11-07 Parthasarathy Srinivasan

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

Machine Learning · Computer Science 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta

he greatest weakness of evolutionary algorithms, widely used today, is the premature convergence due to the loss of population diversity over generations. To overcome this problem, several algorithms have been proposed, such as the…

Neural and Evolutionary Computing · Computer Science 2019-08-22 Asmaa Ghoumari , Amir Nakib

The experiments conducted in previous studies demonstrated the successful performance of BSA and its non-sensitivity toward the several types of optimisation problems. This success of BSA motivated researchers to work on expanding it, e.g.,…

Neural and Evolutionary Computing · Computer Science 2019-12-03 Bryar A. Hassan , Tarik A. Rashid

Evolutionary algorithms (EAs) are a kind of nature-inspired general-purpose optimization algorithm, and have shown empirically good performance in solving various real-word optimization problems. During the past two decades, promising…

Neural and Evolutionary Computing · Computer Science 2022-11-29 Chao Qian , Yang Yu , Ke Tang , Xin Yao , Zhi-Hua Zhou

The running-time analysis of evolutionary combinatorial optimization is a fundamental topic in evolutionary computation. However, theoretical results regarding the $(\mu+\lambda)$ evolutionary algorithm (EA) for combinatorial optimization…

Neural and Evolutionary Computing · Computer Science 2025-07-04 Min Huang , Pengxiang Chen , Han Huang , Tongli He , Yushan Zhang , Zhifeng Hao

Quantum inspired Evolutionary Algorithms were proposed more than a decade ago and have been employed for solving a wide range of difficult search and optimization problems. A number of changes have been proposed to improve performance of…

Artificial Intelligence · Computer Science 2019-09-18 Nija Mani , Gursaran , Ashish Mani

The PC algorithm is a popular method for learning the structure of Gaussian Bayesian networks. It carries out statistical tests to determine absent edges in the network. It is hence governed by two parameters: (i) The type of test, and (ii)…

Bayesian optimization (BO) is a popular global optimization scheme for sample-efficient optimization in domains with expensive function evaluations. The existing BO techniques are capable of finding a single global optimum solution.…

Optimization and Control · Mathematics 2023-08-08 Yongsheng Mei , Tian Lan , Mahdi Imani , Suresh Subramaniam

Evolutionary algorithms are bio-inspired algorithms that can easily adapt to changing environments. Recent results in the area of runtime analysis have pointed out that algorithms such as the (1+1)~EA and Global SEMO can efficiently…

Neural and Evolutionary Computing · Computer Science 2022-06-07 Vahid Roostapour , Aneta Neumann , Frank Neumann

We have developed a Bayesian optimization (BO) workflow that integrates intra-step noise optimization into automated experimental cycles. Traditional BO approaches in automated experiments focus on optimizing experimental trajectories but…