English
Related papers

Related papers: Integrating Variable Reduction Strategy with Evolu…

200 papers

Evolutionary algorithms (EAs) simulate natural selection but have two main limitations: (1) they rarely update individuals based on global correlations, limiting comprehensive learning; (2) they struggle with balancing exploration and…

Neural and Evolutionary Computing · Computer Science 2025-11-25 Kaichen Ouyang , Zong Ke , Shengwei Fu , Lingjie Liu , Puning Zhao , Dayu Hu

In recent years, Evolutionary Strategies were actively explored in robotic tasks for policy search as they provide a simpler alternative to reinforcement learning algorithms. However, this class of algorithms is often claimed to be…

Robotics · Computer Science 2021-11-10 Vladislav Kurenkov , Bulat Maksudov

Discrete variational auto-encoders (VAEs) are able to represent semantic latent spaces in generative learning. In many real-life settings, the discrete latent space consists of high-dimensional structures, and propagating gradients through…

Machine Learning · Computer Science 2022-05-04 Alon Berliner , Guy Rotman , Yossi Adi , Roi Reichart , Tamir Hazan

This paper presents a comprehensive survey of methods which can be utilized to search for solutions to systems of nonlinear equations (SNEs). Our objectives with this survey are to synthesize pertinent literature in this field by presenting…

Mathematical Software · Computer Science 2022-08-19 Ilias S. Kotsireas , Panos M. Pardalos , Alexander Semenov , William T. Trevena , Michael N. Vrahatis

Efficient Natural Evolution Strategies (eNES) is a novel alternative to conventional evolutionary algorithms, using the natural gradient to adapt the mutation distribution. Unlike previous methods based on natural gradients, eNES uses a…

Artificial Intelligence · Computer Science 2012-09-27 Yi Sun , Daan Wierstra , Tom Schaul , Juergen Schmidhuber

This paper presents two different evolutionary systems - Evolutionary Programming Network (EPNet) and Novel Evolutions Strategy (NES) Algorithm. EPNet does both training and architecture evolution simultaneously, whereas NES does a fixed…

Neural and Evolutionary Computing · Computer Science 2013-05-07 M. A. Khayer Azad , Md. Shafiqul Islam , M. M. A. Hashem

Variational Quantum Algorithms (VQAs) employ parameterized quantum circuits optimized using classical methods to minimize a cost function. While VQAs have found broad applications, certain challenges persist. Notably, a significant…

Quantum Physics · Physics 2025-03-06 Lucas Friedrich , Jonas Maziero

Finding the optimal parameter setting (i.e. the optimal population size, the optimal mutation probability, the optimal evolutionary model etc) for an Evolutionary Algorithm (EA) is a difficult task. Instead of evolving only the parameters…

Neural and Evolutionary Computing · Computer Science 2021-09-29 Mihai Oltean , Crina Groşan

Zeroth-order local optimisation algorithms are essential for solving real-valued black-box optimisation problems. Among these, Natural Evolution Strategies (NES) represent a prominent class, particularly well-suited for scenarios where…

Machine Learning · Computer Science 2025-07-11 Pierre Osselin , Masaki Adachi , Xiaowen Dong , Michael A. Osborne

Combinatorial optimization problems are notoriously challenging due to their discrete structure and exponentially large solution space. Recent advances in deep reinforcement learning (DRL) have enabled the learning heuristics directly from…

Machine Learning · Computer Science 2025-06-12 Shengda Gu , Kai Li , Junliang Xing , Yifan Zhang , Jian Cheng

We develop fast and scalable methods for computing reduced-order nonlinear solutions (RONS). RONS was recently proposed as a framework for reduced-order modeling of time-dependent partial differential equations (PDEs), where the modes…

Dynamical Systems · Mathematics 2023-03-03 William Anderson , Mohammad Farazmand

Evolutionary algorithms (EA) have been widely accepted as efficient solvers for complex real world optimization problems, including engineering optimization. However, real world optimization problems often involve uncertain environment…

Neural and Evolutionary Computing · Computer Science 2016-11-17 Maumita Bhattacharya , R. Islam , A. Mahmood

Natural Evolution Strategies (NES) is a promising framework for black-box continuous optimization problems. NES optimizes the parameters of a probability distribution based on the estimated natural gradient, and one of the key parameters…

Neural and Evolutionary Computing · Computer Science 2022-02-08 Masahiro Nomura , Isao Ono

When employing an evolutionary algorithm to optimize a neural networks architecture, developers face the added challenge of tuning the evolutionary algorithm's own hyperparameters - population size, mutation rate, cloning rate, and number…

Neural and Evolutionary Computing · Computer Science 2025-03-17 Benjamin David Winter , William J. Teahan

We introduce an evolutionary stochastic-local-search (SLS) algorithm for addressing a generalized version of the so-called 1/V/D/R cutting-stock problem. Cutting-stock problems are encountered often in industrial environments and the…

Neural and Evolutionary Computing · Computer Science 2017-07-28 Georgios C. Chasparis , Michael Rossbory , Verena Haunschmid

Evolutionary algorithms (EAs) are universal solvers inspired by principles of natural evolution. In many applications, EAs produce astonishingly good solutions. As they are able to deal with complex optimisation problems, they show great…

Neural and Evolutionary Computing · Computer Science 2024-09-25 Jakob Baumann , Ignaz Rutter , Dirk Sudholt

We present a novel Natural Evolution Strategy (NES) variant, the Rank-One NES (R1-NES), which uses a low rank approximation of the search distribution covariance matrix. The algorithm allows computation of the natural gradient with cost…

Artificial Intelligence · Computer Science 2011-06-14 Yi Sun , Faustino Gomez , Tom Schaul , Juergen Schmidhuber

Evolutionary Strategies (ES) are a popular family of black-box zeroth-order optimization algorithms which rely on search distributions to efficiently optimize a large variety of objective functions. This paper investigates the potential…

Neural and Evolutionary Computing · Computer Science 2019-02-01 Louis Faury , Clement Calauzenes , Olivier Fercoq , Syrine Krichen

In response to the limitations of reinforcement learning and evolutionary algorithms (EAs) in complex problem-solving, Evolutionary Reinforcement Learning (EvoRL) has emerged as a synergistic solution. EvoRL integrates EAs and reinforcement…

Neural and Evolutionary Computing · Computer Science 2024-02-22 Yuanguo Lin , Fan Lin , Guorong Cai , Hong Chen , Lixin Zou , Pengcheng Wu

This paper presents a comprehensive survey of methods which can be utilized to search for solutions to systems of nonlinear equations (SNEs). Our objectives with this survey are to synthesize pertinent literature in this field by presenting…

Mathematical Software · Computer Science 2022-08-19 Ilias S. Kotsireas , Panos M. Pardalos , Alexander Semenov , William T. Trevena , Michael N. Vrahatis