English
Related papers

Related papers: CMA-ES with Adaptive Reevaluation for Multiplicati…

200 papers

We present the results of a comprehensive study of optimization algorithms for the calibration of quantum devices. As part of our ongoing efforts to automate bring-up, tune-up, and system identification procedures, we investigate a broad…

Quantum Physics · Physics 2026-04-14 Kevin Pack , Shai Machnes , Frank K. Wilhelm

Theoretical analyses of evolution strategies are indispensable for gaining a deep understanding of their inner workings. For constrained problems, rather simple problems are of interest in the current research. This work presents a…

Neural and Evolutionary Computing · Computer Science 2019-08-12 Patrick Spettel , Hans-Georg Beyer

Reinforcement learning (RL) is still rarely applied in industrial control, partly due to the difficulty of training reliable agents for real-world conditions. This work investigates how evolution strategies can support RL in such settings…

Neural and Evolutionary Computing · Computer Science 2026-03-31 Tom Maus , Stephan Frank , Tobias Glasmachers

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is one of the most successful examples of a derandomized evolution strategy. However, it still relies on randomly sampling offspring, which can be done via a uniform distribution…

Neural and Evolutionary Computing · Computer Science 2024-09-25 Jacob de Nobel , Diederick Vermetten , Thomas H. W. Bäck , Anna V. Kononova

We propose a method for evolving solutions that are robust with respect to variations of the environmental conditions (i.e. that can operate effectively in new conditions immediately, without the need to adapt to variations). The obtained…

Neural and Evolutionary Computing · Computer Science 2019-06-19 Paolo Pagliuca , Stefano Nolfi

Several practical applications of evolutionary computation possess objective functions that receive the design variables and externally given parameters. Such problems are termed contextual optimization problems. These problems require…

Neural and Evolutionary Computing · Computer Science 2025-02-19 Yuta Sekino , Kento Uchida , Shinichi Shirakawa

Recent research in Cooperative Coevolution~(CC) have achieved promising progress in solving large-scale global optimization problems. However, existing CC paradigms have a primary limitation in that they require deep expertise for selecting…

Machine Learning · Computer Science 2025-04-25 Hongshu Guo , Wenjie Qiu , Zeyuan Ma , Xinglin Zhang , Jun Zhang , Yue-Jiao Gong

In the field of evolutionary computation, one of the most challenging topics is algorithm selection. Knowing which heuristics to use for which optimization problem is key to obtaining high-quality solutions. We aim to extend this research…

Neural and Evolutionary Computing · Computer Science 2019-04-17 Diederick Vermetten , Sander van Rijn , Thomas Bäck , Carola Doerr

The CSA-ES is an Evolution Strategy with Cumulative Step size Adaptation, where the step size is adapted measuring the length of a so-called cumulative path. The cumulative path is a combination of the previous steps realized by the…

Machine Learning · Computer Science 2013-02-19 Alexandre Chotard , Anne Auger , Nikolaus Hansen

This paper presents a novel mechanism to adapt surrogate-assisted population-based algorithms. This mechanism is applied to ACM-ES, a recently proposed surrogate-assisted variant of CMA-ES. The resulting algorithm, saACM-ES, adjusts online…

Neural and Evolutionary Computing · Computer Science 2012-04-12 Ilya Loshchilov , Marc Schoenauer , Michèle Sebag

In this study, we consider simulation-based worst-case optimization problems with continuous design variables and a finite scenario set. To reduce the number of simulations required and increase the number of restarts for better local…

Neural and Evolutionary Computing · Computer Science 2022-12-01 Atsuhiro Miyagi , Kazuto Fukuchi , Jun Sakuma , Youhei Akimoto

Single-objective optimization algorithms search for the single highest-quality solution with respect to an objective. Quality diversity (QD) optimization algorithms, such as Covariance Matrix Adaptation MAP-Elites (CMA-ME), search for a…

Machine Learning · Computer Science 2023-06-07 Matthew C. Fontaine , Stefanos Nikolaidis

The CSA-ES is an Evolution Strategy with Cumulative Step size Adaptation, where the step size is adapted measuring the length of a so-called cumulative path. The cumulative path is a combination of the previous steps realized by the…

Machine Learning · Computer Science 2012-07-02 Alexandre Adrien Chotard , Anne Auger , Nikolaus Hansen

Automated algorithm selection promises to support the user in the decisive task of selecting a most suitable algorithm for a given problem. A common component of these machine-trained techniques are regression models which predict the…

Neural and Evolutionary Computing · Computer Science 2020-06-18 Anja Jankovic , Carola Doerr

In this paper, we study the performance of IPOP-saACM-ES, recently proposed self-adaptive surrogate-assisted Covariance Matrix Adaptation Evolution Strategy. The algorithm was tested using restarts till a total number of function…

Neural and Evolutionary Computing · Computer Science 2012-06-06 Ilya Loshchilov , Marc Schoenauer , Michèle Sebag

This paper explores the theoretical basis of the covariance matrix adaptation evolution strategy (CMA-ES) from the information geometry viewpoint. To establish a theoretical foundation for the CMA-ES, we focus on a geometric structure of a…

Neural and Evolutionary Computing · Computer Science 2012-06-06 Youhei Akimoto , Yuichi Nagata , Isao Ono , Shigenobu Kobayashi

Evolution-based neural architecture search requires high computational resources, resulting in long search time. In this work, we propose a framework of applying the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) to the neural…

Neural and Evolutionary Computing · Computer Science 2021-07-16 Nilotpal Sinha , Kuan-Wen Chen

Quality-Diversity (QD) optimization is an emerging field that focuses on finding a set of behaviorally diverse and high-quality solutions. While the quality is typically defined w.r.t. a single objective function, recent work on…

Neural and Evolutionary Computing · Computer Science 2025-05-28 Shihan Zhao , Stefanos Nikolaidis

Parameter adaptation, that is the capability to automatically adjust an algorithm's hyperparameters depending on the problem being faced, is one of the main trends in evolutionary computation applied to numerical optimization. While several…

Neural and Evolutionary Computing · Computer Science 2022-06-30 Michele Tessari , Giovanni Iacca

Hyperparameter optimization (HPO), formulated as black-box optimization (BBO), is recognized as essential for automation and high performance of machine learning approaches. The CMA-ES is a promising BBO approach with a high degree of…

Machine Learning · Computer Science 2020-12-15 Masahiro Nomura , Shuhei Watanabe , Youhei Akimoto , Yoshihiko Ozaki , Masaki Onishi