English
Related papers

Related papers: CMA-ES with Radial Basis Function Surrogate for Bl…

200 papers

In this paper, we study the performance of IPOP-saACM-ES, recently proposed self-adaptive surrogate-assisted Covariance Matrix Adaptation Evolution Strategy. The algorithm was tested using restarts till a total number of function…

Neural and Evolutionary Computing · Computer Science 2012-06-06 Ilya Loshchilov , Marc Schoenauer , Michèle Sebag

Real-world optimization problems often have expensive objective functions in terms of cost and time. It is desirable to find near-optimal solutions with very few function evaluations. Surrogate-assisted optimizers tend to reduce the…

Machine Learning · Statistics 2019-04-18 Samineh Bagheri , Wolfgang Konen , Thomas Bäck

One method to solve expensive black-box optimization problems is to use a surrogate model that approximates the objective based on previous observed evaluations. The surrogate, which is cheaper to evaluate, is optimized instead to find an…

Optimization and Control · Mathematics 2021-05-28 Rickard Karlsson , Laurens Bliek , Sicco Verwer , Mathijs de Weerdt

Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is a highly effective optimization technique. A primary challenge when applying CMA-ES in high dimensionality is sampling from a multivariate normal distribution with an arbitrary…

Neural and Evolutionary Computing · Computer Science 2026-01-05 Jarosław Arabas , Adam Stelmaszczyk , Eryk Warchulski , Dariusz Jagodziński , Rafał Biedrzycki

This paper proposes RCMAES, a novel variant of the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) for CEC benchmark optimization. RCMAES integrates a dimension-dependent nonlinear population-size reduction strategy with an…

Neural and Evolutionary Computing · Computer Science 2026-05-01 Khoirul Faiq Muzakka , Sören Möller , Martin Finsterbusch

Many global optimization algorithms of the memetic variety rely on some form of stochastic search, and yet they often lack a sound probabilistic basis. Without a recourse to the powerful tools of stochastic calculus, treading the fine…

Optimization and Control · Mathematics 2024-12-17 Rajdeep Dutta , T Venkatesh Varma , Saikat Sarkar , Mariya Mamajiwala , Noor Awad , Senthilnath Jayavelu , Debasish Roy

Surrogate-assisted Evolutionary Algorithms~(SAEAs) have shown promising robustness in solving expensive optimization problems. A key aspect that impacts SAEAs' effectiveness is surrogate model selection, which in existing works is…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Yuxin Wu , Hongshu Guo , Ting Huang , Yue-Jiao Gong , Zeyuan Ma

AI-assisted molecular optimization is a very active research field as it is expected to provide the next-generation drugs and molecular materials. An important difficulty is that the properties to be optimized rely on costly evaluations.…

Machine Learning · Computer Science 2025-05-19 Jules Leguy , Thomas Cauchy , Beatrice Duval , Benoit Da Mota

Chemical plant design and optimisation have proven challenging due to the complexity of these real-world systems. The resulting complexity translates into high computational costs for these systems' mathematical formulations and simulation…

Neural and Evolutionary Computing · Computer Science 2022-04-28 Liezl Stander , Matthew Woolway , Terence L. Van Zyl

We propose a novel constraint-handling technique for the covariance matrix adaptation evolution strategy (CMA-ES). The proposed technique is aimed at solving explicitly constrained black-box continuous optimization problems, in which the…

Neural and Evolutionary Computing · Computer Science 2022-05-11 Naoki Sakamoto , Youhei Akimoto

Proportional integral derivative (PID) controllers are important and widely used tools in system control. Tuning of the controller gains is a laborious task, especially for complex systems such as combustion engines. To minimize the time of…

Systems and Control · Computer Science 2017-06-07 Katerina Henclova

This study targets the mixed-integer black-box optimization (MI-BBO) problem where continuous and integer variables should be optimized simultaneously. The CMA-ES, our focus in this study, is a population-based stochastic search method that…

Neural and Evolutionary Computing · Computer Science 2023-01-13 Ryoki Hamano , Shota Saito , Masahiro Nomura , Shinichi Shirakawa

This study modifies the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) algorithm for multi-modal optimization problems. The enhancements focus on addressing the challenges of multiple global minima, improving the algorithm's…

Neural and Evolutionary Computing · Computer Science 2024-07-02 Wathsala Karunarathne , Indu Bala , Dikshit Chauhan , Matthew Roughan , Lewis Mitchell

Feature selection is an intractable problem, therefore practical algorithms often trade off the solution accuracy against the computation time. In this paper, we propose a novel multi-stage feature selection framework utilizing multiple…

Machine Learning · Computer Science 2021-11-18 Mohammed Ghaith Altarabichi , Sławomir Nowaczyk , Sepideh Pashami , Peyman Sheikholharam Mashhad

In this paper, we propose an efficient approximated rank one update for covariance matrix adaptation evolution strategy (CMA-ES). It makes use of two evolution paths as simple as that of CMA-ES, while avoiding the computational matrix…

Neural and Evolutionary Computing · Computer Science 2017-10-24 Zhenhua Li , Qingfu Zhang

Bilevel optimization is a field of significant theoretical and practical interest, yet solving such optimization problems remains challenging. Evolutionary methods have been employed to address these problems in the black-box setting;…

Neural and Evolutionary Computing · Computer Science 2026-04-06 Marc Ong , Youhei Akimoto

Surrogate Optimization (SO) algorithms have shown promise for optimizing expensive black-box functions. However, their performance is heavily influenced by hyperparameters related to sampling and surrogate fitting, which poses a challenge…

Machine Learning · Computer Science 2023-10-13 Nazanin Nezami , Hadis Anahideh

Surrogate-assisted evolutionary algorithms (SAEAs) have been proposed to solve expensive optimization problems. Although SAEAs use surrogate models that approximate the evaluations of solutions using machine learning techniques, prior…

Neural and Evolutionary Computing · Computer Science 2026-01-21 Yuki Hanawa , Tomohiro Harada , Yukiya Miura

Real-world optimisation problems typically have objective functions which cannot be expressed analytically. These optimisation problems are evaluated through expensive physical experiments or simulations. Cheap approximations of the…

Neural and Evolutionary Computing · Computer Science 2022-11-01 Mohamed Z. Variawa , Terence L. Van Zyl , Matthew Woolway

By remarkably reducing real fitness evaluations, surrogate-assisted evolutionary algorithms (SAEAs), especially hierarchical SAEAs, have been shown to be effective in solving computationally expensive optimization problems. The success of…

Neural and Evolutionary Computing · Computer Science 2021-03-02 Xiaodong Ren , Daofu Guo , Zhigang Ren , Yongsheng Liang , An Chen