English
Related papers

Related papers: Evolvability ES: Scalable and Direct Optimization …

200 papers

Natural evolution has produced a tremendous diversity of functional organisms. Many believe an essential component of this process was the evolution of evolvability, whereby evolution speeds up its ability to innovate by generating a more…

Neural and Evolutionary Computing · Computer Science 2019-02-15 Joost Huizinga , Kenneth O. Stanley , Jeff Clune

This paper presents an evolvable conditional diffusion method such that black-box, non-differentiable multi-physics models, as are common in domains like computational fluid dynamics and electromagnetics, can be effectively used for guiding…

Machine Learning · Computer Science 2025-06-18 Zhao Wei , Chin Chun Ooi , Abhishek Gupta , Jian Cheng Wong , Pao-Hsiung Chiu , Sheares Xue Wen Toh , Yew-Soon Ong

We explore the use of Evolution Strategies (ES), a class of black box optimization algorithms, as an alternative to popular MDP-based RL techniques such as Q-learning and Policy Gradients. Experiments on MuJoCo and Atari show that ES is a…

Machine Learning · Statistics 2017-09-11 Tim Salimans , Jonathan Ho , Xi Chen , Szymon Sidor , Ilya Sutskever

Evolution Strategies (ES) emerged as a scalable alternative to popular Reinforcement Learning (RL) techniques, providing an almost perfect speedup when distributed across hundreds of CPU cores thanks to a reduced communication overhead.…

Machine Learning · Statistics 2018-11-13 Víctor Campos , Xavier Giro-i-Nieto , Jordi Torres

In this paper, we propose a novel meta-learning method in a reinforcement learning setting, based on evolution strategies (ES), exploration in parameter space and deterministic policy gradients. ES methods are easy to parallelize, which is…

Machine Learning · Computer Science 2019-05-09 Yiming Shen , Kehan Yang , Yufeng Yuan , Simon Cheng Liu

Evolvability refers to the ability of an individual genotype (solution) to produce offspring with mutually diverse phenotypes. Recent research has demonstrated that divergent search methods, particularly novelty search, promote evolvability…

Neural and Evolutionary Computing · Computer Science 2023-06-19 Bruno Gašperov , Marko Đurasević

We propose EVOlutionary Selector (EVOS), an efficient training paradigm for accelerating Implicit Neural Representation (INR). Unlike conventional INR training that feeds all samples through the neural network in each iteration, our…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Weixiang Zhang , Shuzhao Xie , Chengwei Ren , Siyi Xie , Chen Tang , Shijia Ge , Mingzi Wang , Zhi Wang

Discovering efficient algorithms for solving complex problems has been an outstanding challenge in mathematics and computer science, requiring substantial human expertise over the years. Recent advancements in evolutionary search with large…

Artificial Intelligence · Computer Science 2026-05-26 Anja Surina , Amin Mansouri , Lars Quaedvlieg , Amal Seddas , Maryna Viazovska , Emmanuel Abbe , Caglar Gulcehre

Adapting large language models (LLMs) to a targeted task efficiently and effectively remains a fundamental challenge. Such adaptation often requires iteratively improving the model toward a targeted task, yet collecting high-quality…

Computation and Language · Computer Science 2026-04-30 Ting-Wei Li , Sirui Chen , Jiaru Zou , Yingbing Huang , Tianxin Wei , Jingrui He , Hanghang Tong

A central biological question is how natural organisms are so evolvable (capable of quickly adapting to new environments). A key driver of evolvability is the widespread modularity of biological networks--their organization as functional,…

Populations and Evolution · Quantitative Biology 2015-03-13 Jeff Clune , Jean-Baptiste Mouret , Hod Lipson

In this paper, we approach the problem of optimizing blackbox functions over large hybrid search spaces consisting of both combinatorial and continuous parameters. We demonstrate that previous evolutionary algorithms which rely on…

Recent advances in data-driven evolutionary algorithms (EAs) have demonstrated the potential of leveraging historical data to improve optimization accuracy and adaptability. Despite these advancements, existing methods remain reliant on…

Neural and Evolutionary Computing · Computer Science 2026-02-16 Tao Jiang , Kebin Sun , Zhenyu Liang , Ran Cheng , Yaochu Jin , Kay Chen Tan

In recent years, large language models (LLMs) have made remarkable progress, with model optimization primarily relying on gradient-based optimizers such as Adam. However, these gradient-based methods impose stringent hardware requirements,…

Artificial Intelligence · Computer Science 2025-10-24 WenTao Liu , Siyu Song , Hao Hao , Aimin Zhou

Evolvability is the capacity to evolve. This paper introduces a simple computational model of evolvability and demonstrates that, under certain conditions, evolvability can increase indefinitely, even when there is no direct selection for…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Peter D. Turney

Large Language Models (LLMs) have unveiled remarkable capabilities in understanding and generating both natural language and code, but LLM reasoning is prone to hallucination and struggle with complex, novel scenarios, often getting stuck…

Neural and Evolutionary Computing · Computer Science 2025-05-12 Antonio Jimeno Yepes , Pieter Barnard

Differentiable programming has revolutionised optimisation by enabling efficient gradient-based training of complex models, such as Deep Neural Networks (NNs) with billions and trillions of parameters. However, traditional Evolutionary…

Neural and Evolutionary Computing · Computer Science 2025-06-10 Beatrice F. R. Citterio , Andrea Tangherloni

Evolutionary artificial neural networks (EANNs) refer to a special class of artificial neural networks (ANNs) in which evolution is another fundamental form of adaptation in addition to learning. Evolutionary algorithms are used to adapt…

Artificial Intelligence · Computer Science 2016-11-17 Ajith Abraham

Evolutionary optimization algorithms are often derived from loose biological analogies and struggle to leverage information obtained during the sequential course of optimization. An alternative promising approach is to leverage data and…

Artificial Intelligence · Computer Science 2024-03-06 Robert Tjarko Lange , Yingtao Tian , Yujin Tang

Evolutionary multi-agent systems (EMASs) are very good at dealing with difficult, multi-dimensional problems, their efficacy was proven theoretically based on analysis of the relevant Markov-Chain based model. Now the research continues on…

Neural and Evolutionary Computing · Computer Science 2022-10-25 Mateusz Godzik , Jacek Dajda , Marek Kisiel-Dorohinicki , Aleksander Byrski , Leszek Rutkowski , Patryk Orzechowski , Joost Wagenaar , Jason H. Moore

In modular robotics, modules can be reconfigured to change the morphology of the robot, making it able to adapt for specific tasks. However, optimizing both the body and control is a difficult challenge due to the intricate relationship…

Robotics · Computer Science 2020-12-09 Jørgen Nordmoen , Frank Veenstra , Kai Olav Ellefsen , Kyrre Glette