English
Related papers

Related papers: Operational Framework for Recent Advances in Backt…

200 papers

Local search is an effective method for solving large-scale combinatorial optimization problems, and it has made remarkable progress in recent years through several subtle mechanisms. In this paper, we found two ways to improve the local…

Artificial Intelligence · Computer Science 2023-06-30 Luyu Jiang , Dantong Ouyang , Qi Zhang , Liming Zhang

The practical use of Bayesian Optimization (BO) in engineering applications imposes special requirements: high sampling efficiency on the one hand and finding a robust solution on the other hand. We address the case of adversarial…

Machine Learning · Computer Science 2024-06-03 Dorina Weichert , Alexander Kister , Sebastian Houben , Patrick Link , Gunar Ernis

In multi-task Bayesian optimization, the goal is to leverage experience from optimizing existing tasks to improve the efficiency of optimizing new ones. While approaches using multi-task Gaussian processes or deep kernel transfer exist, the…

Meta-heuristic algorithms have become very popular because of powerful performance on the optimization problem. A new algorithm called beetle antennae search algorithm (BAS) is proposed in the paper inspired by the searching behavior of…

Neural and Evolutionary Computing · Computer Science 2017-10-31 Xiangyuan Jiang , Shuai Li

Submodular functions play a key role in the area of optimization as they allow to model many real-world problems that face diminishing returns. Evolutionary algorithms have been shown to obtain strong theoretical performance guarantees for…

Bayesian optimization (BO) is a powerful technology for optimizing noisy expensive-to-evaluate black-box functions, with a broad range of real-world applications in science, engineering, economics, manufacturing, and beyond. In this paper,…

Machine Learning · Computer Science 2024-01-30 Joel A. Paulson , Calvin Tsay

Efficiency in optimisation and search processes persists to be one of the challenges, which affects the performance and use of optimisation algorithms. Utilising a pool of operators instead of a single operator to handle move operations…

Artificial Intelligence · Computer Science 2025-12-12 Mehmet Emin Aydin

Machine learning has been making great success in many application areas. However, for the non-expert practitioners, it is always very challenging to address a machine learning task successfully and efficiently. Finding the optimal machine…

Machine Learning · Computer Science 2025-08-08 Guanghui Zhu , Xin Fang , Feng Cheng , Lei Wang , Wenzhong Chen , Chunfeng Yuan , Yihua Huang

Differential Evolution (DE) is a renowned optimization stratagem that can easily solve nonlinear and comprehensive problems. DE is a well known and uncomplicated population based probabilistic approach for comprehensive optimization. It has…

Neural and Evolutionary Computing · Computer Science 2015-06-22 Sandeep Kumar , Vivek Kumar Sharma , Rajani Kumari

This paper introduces a novel hybrid optimisation algorithm that combines elements of both metaheuristic search and integer programming. This new matheuristic combines elements of Benders decomposition and the Bees Algorithm, to create the…

Optimization and Control · Mathematics 2019-03-12 Cameron A. G. MacRae , Melih Ozlen , Andreas T. Ernst

Recently, there has been a renewed interest in decomposition-based approaches for evolutionary multiobjective optimization. However, the impact of the choice of the underlying scalarizing function(s) is still far from being well understood.…

Artificial Intelligence · Computer Science 2014-09-22 Bilel Derbel , Dimo Brockhoff , Arnaud Liefooghe , Sébastien Verel

In this paper, the performances of the quasi-Newton BFGS algorithm, the NEWUOA derivative free optimizer, the Covariance Matrix Adaptation Evolution Strategy (CMA-ES), the Differential Evolution (DE) algorithm and Particle Swarm Optimizers…

Numerical Analysis · Computer Science 2010-06-01 Anne Auger , Nikolaus Hansen , Jorge M. Perez Zerpa , Raymond Ros , Marc Schoenauer

In several applications such as databases, planning, and sensor networks, parameters such as selectivity, load, or sensed values are known only with some associated uncertainty. The performance of such a system (as captured by some…

Data Structures and Algorithms · Computer Science 2010-01-28 Sudipto Guha , Kamesh Munagala

This paper introduces a modular framework for Mixed-variable and Combinatorial Bayesian Optimization (MCBO) to address the lack of systematic benchmarking and standardized evaluation in the field. Current MCBO papers often introduce…

Machine Learning · Computer Science 2023-12-12 Kamil Dreczkowski , Antoine Grosnit , Haitham Bou Ammar

Artificial bee colony (ABC) algorithm has proved its importance in solving a number of problems including engineering optimization problems. ABC algorithm is one of the most popular and youngest member of the family of population based…

Artificial Intelligence · Computer Science 2014-07-23 Sandeep Kumar , Vivek Kumar Sharma , Rajani Kumari

Solving an optimization task in any domain is a very challenging problem, especially when dealing with nonlinear problems and non-convex functions. Many meta-heuristic algorithms are very efficient when solving nonlinear functions. A…

Neural and Evolutionary Computing · Computer Science 2020-07-28 Mona Nasr , Omar Farouk , Ahmed Mohamedeen , Ali Elrafie , Marwan Bedeir , Ali Khaled

It is well known in the literature that the problem of learning the structure of Bayesian networks is very hard to tackle: its computational complexity is super-exponential in the number of nodes in the worst case and polynomial in most…

Computation · Statistics 2017-04-14 Marco Scutari

Benchmark problems are an important tool for gaining understanding of optimization algorithms. Since algorithms often aim to perform well on benchmarks, biases in benchmark design provide misleading insights. In single-objective…

Neural and Evolutionary Computing · Computer Science 2026-04-14 Diederick Vermetten , Jeroen Rook

The purpose of this paper is twofold. On one side, we present a general framework for Bayesian optimization and we compare it with some related fields in active learning and Bayesian numerical analysis. On the other hand, Bayesian…

Robotics · Computer Science 2018-02-13 Ruben Martinez-Cantin

Whale Optimization Algorithm (WOA) is a nature-inspired meta-heuristic optimization algorithm, which was proposed by Mirjalili and Lewis in 2016. This algorithm has shown its ability to solve many problems. Comprehensive surveys have been…

Neural and Evolutionary Computing · Computer Science 2019-04-25 Hardi M. Mohammed , Shahla U. Umar , Tarik A. Rashid