English
Related papers

Related papers: Variance Reduction for Evolution Strategies via St…

200 papers

Reinforcement learning (RL) has been successfully applied to solve the problem of finding obstacle-free paths for autonomous agents operating in stochastic and uncertain environments. However, when the underlying stochastic dynamics of the…

Machine Learning · Computer Science 2024-10-29 Sheryl Paul , Jyotirmoy V. Deshmukh

Mixed-integer extensions of evolution strategies (ES) that discretize selected coordinates of sampled continuous vectors often impose a lower bound on the standard deviation of integer variables to prevent premature convergence. While these…

Neural and Evolutionary Computing · Computer Science 2026-05-21 Ryoki Hamano , Kento Uchida , Shinichi Shirakawa

Many applications in machine learning require optimizing a function whose true gradient is unknown, but where surrogate gradient information (directions that may be correlated with, but not necessarily identical to, the true gradient) is…

Neural and Evolutionary Computing · Computer Science 2019-06-12 Niru Maheswaranathan , Luke Metz , George Tucker , Dami Choi , Jascha Sohl-Dickstein

Designing evolutionary algorithms capable of uncovering highly evolvable representations is an open challenge; such evolvability is important because it accelerates evolution and enables fast adaptation to changing circumstances. This paper…

Neural and Evolutionary Computing · Computer Science 2019-07-16 Alexander Gajewski , Jeff Clune , Kenneth O. Stanley , Joel Lehman

Advances in Reinforcement Learning (RL) have demonstrated data efficiency and optimal control over large state spaces at the cost of scalable performance. Genetic methods, on the other hand, provide scalability but depict hyperparameter…

Machine Learning · Computer Science 2021-01-19 Karush Suri , Xiao Qi Shi , Konstantinos N. Plataniotis , Yuri A. Lawryshyn

Although Deep Reinforcement Learning has proven highly effective for complex decision-making problems, it demands significant computational resources and careful parameter adjustment in order to develop successful strategies. Evolution…

Machine Learning · Computer Science 2026-04-02 Adrian Martínez , Ananya Gupta , Hanka Goralija , Mario Rico , Saúl Fenollosa , Tamar Alphaidze

Evolutionary strategies have recently been shown to achieve competing levels of performance for complex optimization problems in reinforcement learning. In such problems, one often needs to optimize an objective function subject to a set of…

Neural and Evolutionary Computing · Computer Science 2022-02-23 Youssef Diouane , Aurelien Lucchi , Vihang Patil

Large Language Models (LLMs) exhibit world knowledge and inference capabilities, making them powerful tools for various applications. This paper proposes a feedback loop mechanism that leverages these capabilities to tune Evolution…

Machine Learning · Computer Science 2024-05-21 Oliver Kramer

Optimizing functions without access to gradients is the remit of black-box methods such as evolution strategies. While highly general, their learning dynamics are often times heuristic and inflexible - exactly the limitations that…

Neural and Evolutionary Computing · Computer Science 2023-03-03 Robert Tjarko Lange , Tom Schaul , Yutian Chen , Tom Zahavy , Valentin Dallibard , Chris Lu , Satinder Singh , Sebastian Flennerhag

Reinforcement learning (RL) is a machine learning approach that trains agents to maximize cumulative rewards through interactions with environments. The integration of RL with deep learning has recently resulted in impressive achievements…

Neural and Evolutionary Computing · Computer Science 2023-08-31 Hui Bai , Ran Cheng , Yaochu Jin

Optimum implementation of non-conventional wells allows us to increase considerably hydrocarbon recovery. By considering the high drilling cost and the potential improvement in well productivity, well placement decision is an important…

Computational Engineering, Finance, and Science · Computer Science 2010-11-25 Zyed Bouzarkouna , Didier Yu Ding , Anne Auger

Evolution Strategy (ES) algorithms have shown promising results in training complex robotic control policies due to their massive parallelism capability, simple implementation, effective parameter-space exploration, and fast training time.…

Robotics · Computer Science 2022-07-28 Kuang-Huei Lee , Ofir Nachum , Tingnan Zhang , Sergio Guadarrama , Jie Tan , Wenhao Yu

Although deep reinforcement learning methods can learn effective policies for challenging problems such as Atari games and robotics tasks, algorithms are complex, and training times are often long. This study investigates how Evolution…

Machine Learning · Computer Science 2024-07-25 Annie Wong , Jacob de Nobel , Thomas Bäck , Aske Plaat , Anna V. Kononova

Reinforcement learning (RL) has become a key training step for improving mathematical reasoning in large language models (LLMs), but it often has high GPU memory usage, which makes it hard to use in settings with limited resources. To…

Machine Learning · Computer Science 2026-05-11 Zhishen Sun , Sizhe Dang , Guang Dai , Haishan Ye

Differential evolution (DE) algorithm is recognized as one of the most effective evolutionary algorithms, demonstrating remarkable efficacy in black-box optimization due to its derivative-free nature. Numerous enhancements to the…

Neural and Evolutionary Computing · Computer Science 2025-03-25 Xu Yang , Rui Wang , Kaiwen Li , Ling Wang

We analyze the efficacy of modern neuro-evolutionary strategies for continuous control optimization. Overall, the results collected on a wide variety of qualitatively different benchmark problems indicate that these methods are generally…

Neural and Evolutionary Computing · Computer Science 2020-06-02 Paolo Pagliuca , Nicola Milano , Stefano Nolfi

We propose an improved evolution strategy (ES) using a novel nonlocal gradient operator for high-dimensional black-box optimization. Standard ES methods with $d$-dimensional Gaussian smoothing suffer from the curse of dimensionality due to…

Optimization and Control · Mathematics 2020-06-15 Jiaxin Zhang , Hoang Tran , Dan Lu , Guannan Zhang

Stein Variational Gradient Descent (SVGD) is a highly efficient method to sample from an unnormalized probability distribution. However, the SVGD update relies on gradients of the log-density, which may not always be available. Existing…

Machine Learning · Computer Science 2026-03-13 Cornelius V. Braun , Robert T. Lange , Marc Toussaint

Deep Reinforcement Learning (Deep RL) and Evolutionary Algorithms (EA) are two major paradigms of policy optimization with distinct learning principles, i.e., gradient-based v.s. gradient-free. An appealing research direction is integrating…

Neural and Evolutionary Computing · Computer Science 2023-07-03 Jianye Hao , Pengyi Li , Hongyao Tang , Yan Zheng , Xian Fu , Zhaopeng Meng

Considering the continuous-time Mean-Variance (MV) portfolio optimization problem, we study a regime-switching market setting and apply reinforcement learning (RL) techniques to assist informed exploration within the control space. We…

Portfolio Management · Quantitative Finance 2025-01-29 Yuling Max Chen , Bin Li , David Saunders