English
Related papers

Related papers: Discovering Evolution Strategies via Meta-Black-Bo…

200 papers

The encoding of solutions in black-box optimization is a delicate, handcrafted balance between expressiveness and domain knowledge -- between exploring a wide variety of solutions, and ensuring that those solutions are useful. Our main…

Neural and Evolutionary Computing · Computer Science 2020-07-07 Adam Gaier , Alexander Asteroth , Jean-Baptiste Mouret

The ability to autonomously explore and resolve tasks with minimal human guidance is crucial for the self-development of embodied intelligence. Although reinforcement learning methods can largely ease human effort, it's challenging to…

Robotics · Computer Science 2024-12-19 Changxin Huang , Yanbin Chang , Junfan Lin , Junyang Liang , Runhao Zeng , Jianqiang Li

We introduce Genetic AI, a novel method for multi-objective optimization without external parameters or predefined weights. The method can be applied to all problems that can be formulated in matrix form and allows for a data-less training…

Neural and Evolutionary Computing · Computer Science 2025-05-09 Philipp Wissgott

Evolutionary computation (EC) algorithms, renowned as powerful black-box optimizers, leverage a group of individuals to cooperatively search for the optimum. The exploration-exploitation tradeoff (EET) plays a crucial role in EC, which,…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Zeyuan Ma , Jiacheng Chen , Hongshu Guo , Yining Ma , Yue-Jiao Gong

In this paper, we build upon previous work on designing informative and efficient Exploratory Landscape Analysis features for characterizing problems' landscapes and show their effectiveness in automatically constructing algorithm selection…

Machine Learning · Statistics 2018-11-30 Pascal Kerschke , Heike Trautmann

Meta-learning has been proposed as a promising machine learning topic in recent years, with important applications to image classification, robotics, computer games, and control systems. In this paper, we study the problem of using…

Systems and Control · Electrical Eng. & Systems 2025-03-04 Yunian Pan , Tao Li , Quanyan Zhu

A fundamental challenge in developing data-driven approaches to ecological systems for tasks such as state estimation and prediction is the paucity of the observational or measurement data. For example, modern machine-learning techniques…

Quantitative Methods · Quantitative Biology 2024-10-11 Zheng-Meng Zhai , Bryan Glaz , Mulugeta Haile , Ying-Cheng Lai

We investigate the problem of transferring an expert policy from a source robot to multiple different robots. To solve this problem, we propose a method named $Meta$-$Evolve$ that uses continuous robot evolution to efficiently transfer the…

Robotics · Computer Science 2024-05-07 Xingyu Liu , Deepak Pathak , Ding Zhao

Evolutionary computation can be used to optimize several different aspects of neural network architectures. For instance, the TaylorGLO method discovers novel, customized loss functions, resulting in improved performance, faster training,…

Machine Learning · Computer Science 2025-06-12 Santiago Gonzalez , Xin Qiu , Risto Miikkulainen

Although model-based and model-free approaches to learning the control of systems have achieved impressive results on standard benchmarks, generalization to task variations is still lacking. Recent results suggest that generalization for…

Machine Learning · Computer Science 2021-02-16 Marin Vlastelica , Michal Rolínek , Georg Martius

In statistics, it is common to encounter multi-modal and non-smooth likelihood (or objective function) maximization problems, where the parameters have known upper and lower bounds. This paper proposes a novel derivative-free global…

Optimization and Control · Mathematics 2023-09-14 Priyam Das

Many applications in machine learning require optimizing a function whose true gradient is unknown, but where surrogate gradient information (directions that may be correlated with, but not necessarily identical to, the true gradient) is…

Neural and Evolutionary Computing · Computer Science 2019-06-12 Niru Maheswaranathan , Luke Metz , George Tucker , Dami Choi , Jascha Sohl-Dickstein

Population-based evolutionary algorithms have great potential to handle multiobjective optimisation problems. However, these algorithms depends largely on problem characteristics, and there is a need to improve their performance for a wider…

Neural and Evolutionary Computing · Computer Science 2019-10-17 Shouyong Jiang , Hongru Li , Jinglei Guo , Mingjun Zhong , Shengxiang Yang , Marcus Kaiser , Natalio Krasnogor

Decision trees, owing to their interpretability, are attractive as control policies for (dynamical) systems. Unfortunately, constructing, or synthesising, such policies is a challenging task. Previous approaches do so by imitating a…

Artificial Intelligence · Computer Science 2025-04-23 Emir Demirović , Christian Schilling , Anna Lukina

The exponential growth of volume, variety and velocity of data is raising the need for investigations of automated or semi-automated ways to extract useful patterns from the data. It requires deep expert knowledge and extensive…

Machine Learning · Computer Science 2020-07-22 Abbas Raza Ali , Marcin Budka , Bogdan Gabrys

We study the problem of attacking a machine learning model in the hard-label black-box setting, where no model information is revealed except that the attacker can make queries to probe the corresponding hard-label decisions. This is a very…

Machine Learning · Computer Science 2018-07-13 Minhao Cheng , Thong Le , Pin-Yu Chen , Jinfeng Yi , Huan Zhang , Cho-Jui Hsieh

A novel optimization strategy, Info-Evo, is described, in which natural gradient search using nonparametric Fisher information is used to provide ongoing guidance to an evolutionary learning algorithm, so that the evolutionary process…

Neural and Evolutionary Computing · Computer Science 2021-03-09 Ben Goertzel

In addition to their undisputed success in solving classical optimization problems, neuroevolutionary and population-based algorithms have become an alternative to standard reinforcement learning methods. However, evolutionary methods often…

Neural and Evolutionary Computing · Computer Science 2021-05-18 Jörg Stork , Martin Zaefferer , Nils Eisler , Patrick Tichelmann , Thomas Bartz-Beielstein , A. E. Eiben

Most successful stochastic black-box optimizers, such as CMA-ES, use rankings of the individual samples to obtain a new search distribution. Yet, the use of rankings also introduces several issues such as the underlying optimization…

Machine Learning · Statistics 2022-06-14 Maximilian Hüttenrauch , Gerhard Neumann

Self-evolution methods enhance code generation through iterative "generate-verify-refine" cycles, yet existing approaches suffer from low exploration efficiency, failing to discover solutions with superior complexity within limited budgets.…

Computation and Language · Computer Science 2026-02-13 Tu Hu , Ronghao Chen , Shuo Zhang , Jianghao Yin , Mou Xiao Feng , Jingping Liu , Shaolei Zhang , Wenqi Jiang , Yuqi Fang , Sen Hu , Huacan Wang , Yi Xu