English
Related papers

Related papers: Theoretical foundation for CMA-ES from information…

200 papers

Pre-training a diverse set of neural network controllers in simulation has enabled robots to adapt online to damage in robot locomotion tasks. However, finding diverse, high-performing controllers requires expensive network training and…

Robotics · Computer Science 2023-09-19 Bryon Tjanaka , Matthew C. Fontaine , David H. Lee , Aniruddha Kalkar , Stefanos Nikolaidis

The natural gradient descent optimisation technique is an efficient optimising protocol for broad classes of classical and quantum systems that takes the underlying geometry of the parameter manifold into account by means of using either…

Quantum Physics · Physics 2026-04-08 Ankit Gill , Kunal Pal

We show that a large class of Estimation of Distribution Algorithms, including, but not limited to, Covariance Matrix Adaption, can be written as a Monte Carlo Expectation-Maximization algorithm, and as exact EM in the limit of infinite…

Machine Learning · Computer Science 2022-06-14 David H. Brookes , Akosua Busia , Clara Fannjiang , Kevin Murphy , Jennifer Listgarten

In the field of evolutionary computation, one of the most challenging topics is algorithm selection. Knowing which heuristics to use for which optimization problem is key to obtaining high-quality solutions. We aim to extend this research…

Neural and Evolutionary Computing · Computer Science 2019-04-17 Diederick Vermetten , Sander van Rijn , Thomas Bäck , Carola Doerr

In graph-based active learning, algorithms based on expected error minimization (EEM) have been popular and yield good empirical performance. The exact computation of EEM optimally balances exploration and exploitation. In practice,…

Machine Learning · Statistics 2016-09-06 Kwang-Sung Jun , Robert Nowak

A common view in evolutionary biology is that mutation rates are minimised. However, studies in combinatorial optimisation and search have shown a clear advantage of using variable mutation rates as a control parameter to optimise the…

Populations and Evolution · Quantitative Biology 2019-08-27 Roman V. Belavkin , Alastair Channon , Elizabeth Aston , John Aston , Rok Krasovec , Christopher G. Knight

We consider an inference on the eigenvalues of the covariance matrix of a multivariate normal distribution. The family of multivariate normal distributions with a fixed mean is seen as a Riemannian manifold with Fisher information metric.…

Statistics Theory · Mathematics 2018-10-12 Yo Sheena

We present a novel black box optimization algorithm called Hessian Estimation Evolution Strategy. The algorithm updates the covariance matrix of its sampling distribution by directly estimating the curvature of the objective function. This…

Machine Learning · Computer Science 2020-06-11 Tobias Glasmachers , Oswin Krause

An evolution strategy (ES) variant based on a simplification of a natural evolution strategy recently attracted attention because it performs surprisingly well in challenging deep reinforcement learning domains. It searches for neural…

Neural and Evolutionary Computing · Computer Science 2018-05-03 Joel Lehman , Jay Chen , Jeff Clune , Kenneth O. Stanley

The expectation-maximization (EM) algorithm is an iterative computational method to calculate the maximum likelihood estimators (MLEs) from the sample data. It converts a complicated one-time calculation for the MLE of the incomplete data…

Computation · Statistics 2016-08-08 Lingyao Meng

Efficient Natural Evolution Strategies (eNES) is a novel alternative to conventional evolutionary algorithms, using the natural gradient to adapt the mutation distribution. Unlike previous methods based on natural gradients, eNES uses a…

Artificial Intelligence · Computer Science 2012-09-27 Yi Sun , Daan Wierstra , Tom Schaul , Juergen Schmidhuber

The CSA-ES is an Evolution Strategy with Cumulative Step size Adaptation, where the step size is adapted measuring the length of a so-called cumulative path. The cumulative path is a combination of the previous steps realized by the…

Machine Learning · Computer Science 2013-02-19 Alexandre Chotard , Anne Auger , Nikolaus Hansen

The fitness landscape - the mapping between genotypes and fitness - determines properties of the process of adaptation. Several small genetic fitness landscapes have recently been built by selecting a handful of beneficial mutations and…

Populations and Evolution · Quantitative Biology 2014-05-15 François Blanquart , Guillaume Achaz , Thomas Bataillon , Olivier Tenaillon

In this article we present an automatic method for charge and mass identification of charged nuclear fragments produced in heavy ion collisions at intermediate energies. The algorithm combines a generative model of DeltaE - E relation and a…

Instrumentation and Detectors · Physics 2017-10-04 Katarzyna Schmidt , Oskar Wyszynski

Learning is a fundamental characteristic of living systems, enabling them to comprehend their environments and make informed decisions. These decision-making processes are inherently influenced by available information about their…

Disordered Systems and Neural Networks · Physics 2025-04-21 Arnab Barua , Haralampos Hatzikirou , Sumiyoshi Abe

Consider a mathematical model of evolutionary adaptation of fitness landscape and mutation matrix as a reaction to population changes. As a basis, we use an open quasispecies model, which is modified to include explicit death flow. We…

Populations and Evolution · Quantitative Biology 2020-11-25 Igor Samokhin , Tatiana Yakushkina , Alexander S. Bratus

Sewall Wright's adaptive landscape metaphor penetrates a significant part of evolutionary thinking. Supplemented with Fisher's fundamental theorem of natural selection and Kimura's maximum principle, it provides a unifying and intuitive…

Populations and Evolution · Quantitative Biology 2017-05-05 Alexander S. Bratus , Artem S. Novozhilov , Yuri S. Semenov

Artificial neural networks (ANNs) are powerful tools capable of approximating any arbitrary mathematical function, but their interpretability remains limited, rendering them as black box models. To address this issue, numerous methods have…

Machine Learning · Computer Science 2024-06-11 Abhiram Anand Thiruthummal , Eun-jin Kim , Sergiy Shelyag

Stacking calorimeters also refered as bremsstrahlung cannons widely used in inertial confinement fusion and ultra-intense laser plasma experiments have become essential diagnostics for characterizing short bursts of high-energy photons and…

Plasma Physics · Physics 2026-03-25 G. Fauvel , A. Arefiev , M. Manuel , K. Tangtartharakul , S. Weber , F. P. Condamine

Over the past decades, there has been a surge of interest in studying low-dimensional structures within high-dimensional data. Statistical factor models $-$ i.e., low-rank plus diagonal covariance structures $-$ offer a powerful framework…

Machine Learning · Statistics 2025-05-20 Daniel Cederberg