English
Related papers

Related papers: PyPop7: A Pure-Python Library for Population-Based…

200 papers

This article develops a Bayesian optimization (BO) method which acts directly over raw strings, proposing the first uses of string kernels and genetic algorithms within BO loops. Recent applications of BO over strings have been hindered by…

Machine Learning · Computer Science 2020-10-05 Henry B. Moss , Daniel Beck , Javier Gonzalez , David S. Leslie , Paul Rayson

Data-driven black-box model-based optimization (MBO) problems arise in a great number of practical application scenarios, where the goal is to find a design over the whole space maximizing a black-box target function based on a static…

Machine Learning · Computer Science 2023-10-20 Mingcheng Chen , Haoran Zhao , Yuxiang Zhao , Hulei Fan , Hongqiao Gao , Yong Yu , Zheng Tian

Bayesian optimization (BO) is one of the most powerful strategies to solve computationally expensive-to-evaluate blackbox optimization problems. However, BO methods are conventionally used for optimization problems of small dimension…

Optimization and Control · Mathematics 2025-02-10 Rémy Priem , Youssef Diouane , Nathalie Bartoli , Sylvain Dubreuil , Paul Saves

This paper presents an Improved Bayesian Optimization (IBO) algorithm to solve complex high-dimensional epidemic models' optimal control solution. Evaluating the total objective function value for disease control models with hundreds of…

Methodology · Statistics 2021-08-03 Yuyang Chen , Kaiming Bi , Chih-Hang J. Wu , David Ben-Arieh , Ashesh Sinha

Generating adversarial examples in a black-box setting retains a significant challenge with vast practical application prospects. In particular, existing black-box attacks suffer from the need for excessive queries, as it is non-trivial to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-11 Jie Li , Rongrong Ji , Hong Liu , Jianzhuang Liu , Bineng Zhong , Cheng Deng , Qi Tian

Evolutionary algorithms, inspired by natural evolution, aim to optimize difficult objective functions without computing derivatives. Here we detail the relationship between population genetics and evolutionary optimization and formulate a…

Populations and Evolution · Quantitative Biology 2023-07-19 Jakub Otwinowski , Colin LaMont

Bayesian optimisation is a popular method for efficient optimisation of expensive black-box functions. Traditionally, BO assumes that the search space is known. However, in many problems, this assumption does not hold. To this end, we…

Machine Learning · Statistics 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Huong Ha , Svetha Venkatesh

The optimization of high-dimensional black-box functions is a challenging problem. When a low-dimensional linear embedding structure can be assumed, existing Bayesian optimization (BO) methods often transform the original problem into…

Machine Learning · Statistics 2022-11-03 Shuhei A. Horiguchi , Tomoharu Iwata , Taku Tsuzuki , Yosuke Ozawa

Solving constrained multi-objective optimization problems (CMOPs) is a challenging task. While many practical algorithms have been developed to tackle CMOPs, real-world scenarios often present cases where the constraint functions are…

Neural and Evolutionary Computing · Computer Science 2025-09-25 Weixiong Huang , Rui Wang , Tao Zhang , Sheng Qi , Ling Wang

Optimization is nothing but a mathematical technique which finds maxima or minima of any function of concern in some realistic region. Different optimization techniques are proposed which are competing for the best solution. Particle Swarm…

Neural and Evolutionary Computing · Computer Science 2019-03-29 Vishakha A Metre , Mr Pramod B Deshmukh

We propose SonOpt, the first (open source) data sonification application for monitoring the progress of bi-objective population-based optimization algorithms during search, to facilitate algorithm understanding. SonOpt provides insights…

Neural and Evolutionary Computing · Computer Science 2022-02-25 Tasos Asonitis , Richard Allmendinger , Matt Benatan , Ricardo Climent

Most black-box optimization methods require extensive hyperparameter tuning, often limiting their ability to generalize across different optimization domains. Foundation models for black-box optimization that learn optimization principles…

Machine Learning · Computer Science 2026-05-25 Aaron Klein , Herilalaina Rakotoarison , Luca Thale-Bombien , David Salinas

Context: Evolutionary algorithms typically require a large number of evaluations (of solutions) to converge - which can be very slow and expensive to evaluate.Objective: To solve search-based software engineering (SE) problems, using fewer…

Software Engineering · Computer Science 2017-09-19 Jianfeng Chen , Vivek Nair , Tim Menzies

Many real world scientific and industrial applications require optimizing multiple competing black-box objectives. When the objectives are expensive-to-evaluate, multi-objective Bayesian optimization (BO) is a popular approach because of…

Machine Learning · Computer Science 2022-06-17 Samuel Daulton , David Eriksson , Maximilian Balandat , Eytan Bakshy

Black box discrete optimization (BBDO) appears in wide range of engineering tasks. Evolutionary or other BBDO approaches have been applied, aiming at automating necessary tuning of system parameters, such as hyper parameter tuning of…

Machine Learning · Computer Science 2018-09-19 Kouhei Nishida , Hernan Aguirre , Shota Saito , Shinichi Shirakawa , Youhei Akimoto

Direct preference optimization (DPO) is widely used as a simple and stable method for aligning large language models (LLMs) with human preferences. This paper investigates a generalized DPO loss that enables a policy model to match the…

Machine Learning · Computer Science 2025-10-28 Yeongmin Kim , Heesun Bae , Byeonghu Na , Il-Chul Moon

This paper introduces a Multi-Strategy Improved Black Widow Optimization Algorithm (MSBWOA), designed to enhance the performance of the standard Black Widow Algorithm (BW) in solving complex optimization problems. The proposed algorithm…

Neural and Evolutionary Computing · Computer Science 2023-12-22 Xin Xu

Swarm intelligence optimization algorithms can be adopted in swarm robotics for target searching tasks in a 2-D or 3-D space by treating the target signal strength as fitness values. Many current works in the literature have achieved good…

Neural and Evolutionary Computing · Computer Science 2021-05-28 Jian Yang , Yuhui Shi

Hyperparameter optimization (HPO) is a core problem for the machine learning community and remains largely unsolved due to the significant computational resources required to evaluate hyperparameter configurations. As a result, a series of…

Machine Learning · Computer Science 2021-10-12 Sebastian Pineda Arango , Hadi S. Jomaa , Martin Wistuba , Josif Grabocka

Optimizing an expensive-to-query function is a common task in science and engineering, where it is beneficial to keep the number of queries to a minimum. A popular strategy is Bayesian optimization (BO), which leverages probabilistic models…

Machine Learning · Computer Science 2019-07-05 Willie Neiswanger , Kirthevasan Kandasamy , Barnabas Poczos , Jeff Schneider , Eric Xing