English
Related papers

Related papers: Multi-Level Evolution Strategies for High-Resoluti…

200 papers

Evolutionary Multitasking (EMT) paradigm, an emerging research topic in evolutionary computation, has been successfully applied in solving high-dimensional feature selection (FS) problems recently. However, existing EMT-based FS methods…

Neural and Evolutionary Computing · Computer Science 2024-01-04 Yinglan Feng , Liang Feng , Songbai Liu , Sam Kwong , Kay Chen Tan

The combination of policy search and deep neural networks holds the promise of automating a variety of decision-making tasks. Model Predictive Control (MPC) provides robust solutions to robot control tasks by making use of a dynamical model…

Robotics · Computer Science 2021-05-11 Yunlong Song , Davide Scaramuzza

We develop a new optimisation technique that combines multiresolution subdivision surfaces for boundary description with immersed finite elements for the discretisation of the primal and adjoint problems of optimisation. Similar to wavelets…

Numerical Analysis · Mathematics 2016-01-20 Kosala Bandara , Thomas Rüberg , Fehmi Cirak

Various variants of the well known Covariance Matrix Adaptation Evolution Strategy (CMA-ES) have been proposed recently, which improve the empirical performance of the original algorithm by structural modifications. However, in practice it…

Neural and Evolutionary Computing · Computer Science 2018-08-20 Sander van Rijn , Hao Wang , Matthijs van Leeuwen , Thomas Bäck

Optimizing a target function over the space of organic molecules is an important problem appearing in many fields of applied science, but also a very difficult one due to the vast number of possible molecular systems. We propose an…

Recent research in Cooperative Coevolution~(CC) have achieved promising progress in solving large-scale global optimization problems. However, existing CC paradigms have a primary limitation in that they require deep expertise for selecting…

Machine Learning · Computer Science 2025-04-25 Hongshu Guo , Wenjie Qiu , Zeyuan Ma , Xinglin Zhang , Jun Zhang , Yue-Jiao Gong

We present a geometric multilevel optimization approach that smoothly incorporates box constraints. Given a box constrained optimization problem, we consider a hierarchy of models with varying discretization levels. Finer models are…

Optimization and Control · Mathematics 2024-04-23 Sebastian Müller , Stefania Petra , Matthias Zisler

Deep reinforcement learning has achieved impressive success in control tasks. However, its policies, represented as opaque neural networks, are often difficult for humans to understand, verify, and debug, which undermines trust and hinders…

Machine Learning · Computer Science 2026-03-11 Qinglong Hu , Xialiang Tong , Mingxuan Yuan , Fei Liu , Zhichao Lu , Qingfu Zhang

This paper presents Natural Evolution Strategies (NES), a recent family of algorithms that constitute a more principled approach to black-box optimization than established evolutionary algorithms. NES maintains a parameterized distribution…

Machine Learning · Statistics 2011-06-23 Daan Wierstra , Tom Schaul , Tobias Glasmachers , Yi Sun , Jürgen Schmidhuber

Solving different types of optimization models (including parameters fitting) for support vector machines on large-scale training data is often an expensive computational task. This paper proposes a multilevel algorithmic framework that…

Machine Learning · Statistics 2014-10-14 Talayeh Razzaghi , Ilya Safro

Since Estimation of Distribution Algorithms (EDA) were proposed, many attempts have been made to improve EDAs' performance in the context of global optimization. So far, the studies or applications of multivariate probabilistic model based…

Neural and Evolutionary Computing · Computer Science 2011-11-10 Weishan Dong , Tianshi Chen , Peter Tino , Xin Yao

Evolutionary algorithms are particularly effective for optimisation problems with dynamic and stochastic components. We propose multi-objective evolutionary approaches for the knapsack problem with stochastic profits under static and…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Kokila Kasuni Perera , Aneta Neumann

We present a novel black box optimization algorithm called Hessian Estimation Evolution Strategy. The algorithm updates the covariance matrix of its sampling distribution by directly estimating the curvature of the objective function. This…

Machine Learning · Computer Science 2020-06-11 Tobias Glasmachers , Oswin Krause

Natural Evolution Strategies (NES) is a promising framework for black-box continuous optimization problems. NES optimizes the parameters of a probability distribution based on the estimated natural gradient, and one of the key parameters…

Neural and Evolutionary Computing · Computer Science 2022-02-08 Masahiro Nomura , Isao Ono

Modern machine learning uses more and more advanced optimization techniques to find optimal hyper parameters. Whenever the objective function is non-convex, non continuous and with potentially multiple local minima, standard gradient…

Machine Learning · Computer Science 2019-02-13 Eric Benhamou , Jamal Atif , Rida Laraki

This study modifies the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) algorithm for multi-modal optimization problems. The enhancements focus on addressing the challenges of multiple global minima, improving the algorithm's…

Neural and Evolutionary Computing · Computer Science 2024-07-02 Wathsala Karunarathne , Indu Bala , Dikshit Chauhan , Matthew Roughan , Lewis Mitchell

Natural lifeforms specialise to their environmental niches across many levels; from low-level features such as DNA and proteins, through to higher-level artefacts including eyes, limbs, and overarching body plans. We propose Multi-Level…

Most of the real-world problems are multimodal in nature that consists of multiple optimum values. Multimodal optimization is defined as the process of finding multiple global and local optima (as opposed to a single solution) of a…

Neural and Evolutionary Computing · Computer Science 2022-08-24 Shatendra Singh , Aruna Tiwari

The covariance matrix adaptation evolution strategy (CMA-ES) is a powerful optimization method for continuous black-box optimization problems. Several noise-handling methods have been proposed to bring out the optimization performance of…

Neural and Evolutionary Computing · Computer Science 2024-05-21 Kento Uchida , Kenta Nishihara , Shinichi Shirakawa

We develop new multilevel Monte Carlo (MLMC) methods to estimate the expectation of the smallest eigenvalue of a stochastic convection-diffusion operator with random coefficients. The MLMC method is based on a sequence of finite element…

Numerical Analysis · Mathematics 2024-02-13 Tiangang Cui , Hans De Sterck , Alexander D. Gilbert , Stanislav Polishchuk , Robert Scheichl