English
Related papers

Related papers: Scaling Policy Gradient Quality-Diversity with Mas…

200 papers

Quality-Diversity (QD) optimization is an emerging field that focuses on finding a set of behaviorally diverse and high-quality solutions. While the quality is typically defined w.r.t. a single objective function, recent work on…

Neural and Evolutionary Computing · Computer Science 2025-05-28 Shihan Zhao , Stefanos Nikolaidis

Differential MAP-Elites is a novel algorithm that combines the illumination capacity of CVT-MAP-Elites with the continuous-space optimization capacity of Differential Evolution. The algorithm is motivated by observations that illumination…

Neural and Evolutionary Computing · Computer Science 2021-07-13 Tae Jong Choi , Julian Togelius

Solving inverse problems and achieving statistical rigour in landscape evolution models requires running many model realizations. Parallel computation is necessary to achieve this in a reasonable time. However, no previous algorithm is…

Computational Engineering, Finance, and Science · Computer Science 2019-01-23 Richard Barnes

Deep artificial neural networks (DNNs) are typically trained via gradient-based learning algorithms, namely backpropagation. Evolution strategies (ES) can rival backprop-based algorithms such as Q-learning and policy gradients on…

Neural and Evolutionary Computing · Computer Science 2018-04-24 Felipe Petroski Such , Vashisht Madhavan , Edoardo Conti , Joel Lehman , Kenneth O. Stanley , Jeff Clune

Neuroevolution is one of the methodologies that can be used for learning optimal architecture during training. It uses evolutionary algorithms to generate the topology of artificial neural networks and its parameters. The main benefits are…

Neural and Evolutionary Computing · Computer Science 2022-08-30 M. Pietroń , D. Żurek , K. Faber , R. Corizzo

Real-world optimization often demands diverse, high-quality solutions. Quality-Diversity (QD) optimization is a multifaceted approach in evolutionary algorithms that aims to generate a set of solutions that are both high-performing and…

Neural and Evolutionary Computing · Computer Science 2025-07-04 Meng Xu , Frank Neumann , Aneta Neumann , Yew Soon Ong

Quality-Diversity (QD) algorithms have shown remarkable success in discovering diverse, high-performing solutions, but rely heavily on hand-crafted behavioral descriptors that constrain exploration to predefined notions of diversity.…

Machine Learning · Computer Science 2026-03-05 Saeed Hedayatian , Stefanos Nikolaidis

We demonstrate how efficiency of Cartesian Genetic Programming method can be scaled up through the preferential selection of phenotypically larger solutions, i.e. through the preferential selection of larger solutions among equally good…

Neural and Evolutionary Computing · Computer Science 2018-10-24 Nicola Milano , Stefano Nolfi

The implementation of a vast majority of machine learning (ML) algorithms boils down to solving a numerical optimization problem. In this context, Stochastic Gradient Descent (SGD) methods have long proven to provide good results, both in…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-10-06 Janis Keuper , Franz-Josef Pfreundt

On-policy reinforcement learning (RL) algorithms are widely used for their strong asymptotic performance and training stability, but they struggle to scale with larger batch sizes, as additional parallel environments yield redundant data…

Machine Learning · Computer Science 2025-11-13 Jianren Wang , Yifan Su , Abhinav Gupta , Deepak Pathak

Recently, single-stage embedding based deep learning algorithms gain increasing attention in cell segmentation and tracking. Compared with the traditional "segment-then-associate" two-stage approach, a single-stage algorithm not only…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Mengyang Zhao , Aadarsh Jha , Quan Liu , Bryan A. Millis , Anita Mahadevan-Jansen , Le Lu , Bennett A. Landman , Matthew J. Tyskac , Yuankai Huo

The success of Transformer models has pushed the deep learning model scale to billions of parameters. Due to the limited memory resource of a single GPU, However, the best practice for choosing the optimal parallel strategy is still…

Machine Learning · Computer Science 2023-10-06 Shenggui Li , Hongxin Liu , Zhengda Bian , Jiarui Fang , Haichen Huang , Yuliang Liu , Boxiang Wang , Yang You

Molecular discovery has brought great benefits to the chemical industry. Various molecule design techniques are developed to identify molecules with desirable properties. Traditional optimization methods, such as genetic algorithms,…

Biomolecules · Quantitative Biology 2025-11-05 Chris Zhuang , Debadyuti Mukherjee , Yingzhou Lu , Tianfan Fu , Ruqi Zhang

We propose the use of quality-diversity algorithms for mixed-initiative game content generation. This idea is implemented as a new feature of the Evolutionary Dungeon Designer, a system for mixed-initiative design of the type of levels you…

Artificial Intelligence · Computer Science 2020-03-06 Alberto Alvarez , Steve Dahlskog , Jose Font , Julian Togelius

Bayesian experimental design (BED) aims at designing an experiment to maximize the information gathering from the collected data. The optimal design is usually achieved by maximizing the mutual information (MI) between the data and the…

Machine Learning · Computer Science 2021-03-17 Jiaxin Zhang , Sirui Bi , Guannan Zhang

Quality-Diversity (QD) algorithms evolve behaviourally diverse and high-performing solutions. To illuminate the elite solutions for a space of behaviours, QD algorithms require the definition of a suitable behaviour space. If the behaviour…

Neural and Evolutionary Computing · Computer Science 2024-01-08 David M. Bossens , Danesh Tarapore

Differential evolution is one of the most prestigious population-based stochastic optimization algorithm for black-box problems. The performance of a differential evolution algorithm depends highly on its mutation and crossover strategy and…

Neural and Evolutionary Computing · Computer Science 2021-02-09 Jianyong Sun , Xin Liu , Thomas Bäck , Zongben Xu

Gradient-based hyperparameter optimization has earned a widespread popularity in the context of few-shot meta-learning, but remains broadly impractical for tasks with long horizons (many gradient steps), due to memory scaling and gradient…

Machine Learning · Computer Science 2021-10-01 Paul Micaelli , Amos Storkey

In Quality-Diversity (QD) algorithms, which evolve a behaviourally diverse archive of high-performing solutions, the behaviour space is a difficult design choice that should be tailored to the target application. In QD meta-evolution, one…

Neural and Evolutionary Computing · Computer Science 2024-01-08 David M. Bossens , Danesh Tarapore

We present DARLEI, a framework that combines evolutionary algorithms with parallelized reinforcement learning for efficiently training and evolving populations of UNIMAL agents. Our approach utilizes Proximal Policy Optimization (PPO) for…

Artificial Intelligence · Computer Science 2023-12-11 Saeejith Nair , Mohammad Javad Shafiee , Alexander Wong