English
Related papers

Related papers: Hard-Thresholding Meets Evolution Strategies in Re…

200 papers

Evolution strategies (ESs) are zeroth-order stochastic black-box optimization heuristics invariant to monotonic transformations of the objective function. They evolve a multivariate normal distribution, from which candidate solutions are…

Numerical Analysis · Mathematics 2022-02-09 Youhei Akimoto , Anne Auger , Tobias Glasmachers , Daiki Morinaga

Efficient Natural Evolution Strategies (eNES) is a novel alternative to conventional evolutionary algorithms, using the natural gradient to adapt the mutation distribution. Unlike previous methods based on natural gradients, eNES uses a…

Artificial Intelligence · Computer Science 2012-09-27 Yi Sun , Daan Wierstra , Tom Schaul , Juergen Schmidhuber

Evolution Strategies (ES) have emerged as a scalable gradient-free alternative to reinforcement learning based LLM fine-tuning, but it remains unclear whether comparable task performance implies comparable solutions in parameter space. We…

Machine Learning · Computer Science 2026-04-03 William Hoy , Binxu Wang , Xu Pan

This paper presents two different evolutionary systems - Evolutionary Programming Network (EPNet) and Novel Evolutions Strategy (NES) Algorithm. EPNet does both training and architecture evolution simultaneously, whereas NES does a fixed…

Neural and Evolutionary Computing · Computer Science 2013-05-07 M. A. Khayer Azad , Md. Shafiqul Islam , M. M. A. Hashem

With the rapid development of quantum computers, several applications are being proposed for them. Quantum simulations, simulation of chemical reactions, solution of optimization problems and quantum neural networks (QNNs) are some…

Quantum Physics · Physics 2023-03-02 Lucas Friedrich , Jonas Maziero

Evolutionary algorithms have been used to evolve a population of actors to generate diverse experiences for training reinforcement learning agents, which helps to tackle the temporal credit assignment problem and improves the exploration…

Neural and Evolutionary Computing · Computer Science 2023-04-21 Chengpeng Hu , Jiyuan Pei , Jialin Liu , Xin Yao

Conventional deep network training generally optimizes all samples under a largely uniform learning paradigm, without explicitly modeling the heterogeneous competition among them. Such an oversimplified treatment can lead to several…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Ying Zheng , Yiyi Zhang , Yi Wang , Lap-Pui Chau

Feature Transformation is crucial for classic machine learning that aims to generate feature combinations to enhance the performance of downstream tasks from a data-centric perspective. Current methodologies, such as manual expert-driven…

Machine Learning · Computer Science 2025-03-27 Tianqi He , Xiaohan Huang , Yi Du , Qingqing Long , Ziyue Qiao , Min Wu , Yanjie Fu , Yuanchun Zhou , Meng Xiao

Evolution Strategies such as CMA-ES (covariance matrix adaptation evolution strategy) and NES (natural evolution strategy) have been widely used in machine learning applications, where an objective function is optimized without using its…

Optimization and Control · Mathematics 2019-10-28 Haishan Ye , Tong Zhang

Novelty search is a recent artificial evolution technique that challenges traditional evolutionary approaches. In novelty search, solutions are rewarded based on their novelty, rather than their quality with respect to a predefined…

Neural and Evolutionary Computing · Computer Science 2017-03-14 Jorge Gomes , Paulo Urbano , Anders Lyhne Christensen

We explore the capability of evolution strategies to train an agent with a policy based on a transformer architecture in a reinforcement learning setting. We performed experiments using OpenAI's highly parallelizable evolution strategy to…

Machine Learning · Computer Science 2025-07-31 Matyáš Lorenc , Roman Neruda

As sounds carry rich information, environmental sound classification (ESC) is crucial for numerous applications such as rare wild animals detection. However, our world constantly changes, asking ESC models to adapt to new sounds…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-22 Xinyi Chen , Xi Chen , Zhenyu Weng , Yang Xiao

We analyze the efficacy of modern neuro-evolutionary strategies for continuous control optimization. Overall, the results collected on a wide variety of qualitatively different benchmark problems indicate that these methods are generally…

Neural and Evolutionary Computing · Computer Science 2020-06-02 Paolo Pagliuca , Nicola Milano , Stefano Nolfi

Evolutionary Reinforcement Learning (ERL) that applying Evolutionary Algorithms (EAs) to optimize the weight parameters of Deep Neural Network (DNN) based policies has been widely regarded as an alternative to traditional reinforcement…

Neural and Evolutionary Computing · Computer Science 2023-02-01 Lan Tang , Xiaxi Li , Jinyuan Zhang , Guiying Li , Peng Yang , Ke Tang

Evolution Strategies (ES) are a powerful class of blackbox optimization techniques that recently became a competitive alternative to state-of-the-art policy gradient (PG) algorithms for reinforcement learning (RL). We propose a new method…

Neural and Evolutionary Computing · Computer Science 2020-03-16 Yunhao Tang , Krzysztof Choromanski , Alp Kucukelbir

Real-world reinforcement learning often faces environment drift, but most existing methods rely on static entropy coefficients/target entropy, causing over-exploration during stable periods and under-exploration after drift, and leaving…

Machine Learning · Computer Science 2026-05-19 Tongxi Wang , Zhuoyang Xia , Xinran Chen , Shan Liu

People make strategic decisions many times a day - during negotiations, when coordinating actions with others, or when choosing partners for cooperation. The resulting dynamics can be studied with learning theory and evolutionary game…

Populations and Evolution · Quantitative Biology 2026-03-26 Marta C. Couto , Fernando P. Santos , Christian Hilbe

Reinforcement learning has shown great potential in solving complex tasks when large amounts of data can be generated with little effort. In robotics, one approach to generate training data builds on simulations based on dynamics models…

A generic and scalable Reinforcement Learning scheme for Artificial Neural Networks is presented, providing a general purpose learning machine. By reference to a node threshold three features are described 1) A mechanism for Primary…

Machine Learning · Computer Science 2017-01-17 Thomas H. Ward

Hard-thresholding is an important type of algorithm in machine learning that is used to solve $\ell_0$ constrained optimization problems. However, the true gradient of the objective function can be difficult to access in certain scenarios,…

Artificial Intelligence · Computer Science 2026-05-19 Xinzhe Yuan , William de Vazelhes , Bin Gu , Huan Xiong