English
Related papers

Related papers: A Covariance Matrix Self-Adaptation Evolution Stra…

200 papers

In this paper we consider the problem of finding an evolution of a dynamical system that originates and terminates in given sets of states. However, if such an evolution exists then it is usually not unique. We investigate this problem and…

Optimization and Control · Mathematics 2017-09-21 Jan Kuratko , Stefan Ratschan

Solving constrained multi-objective optimization problems with evolutionary algorithms has attracted considerable attention. Various constrained multi-objective optimization evolutionary algorithms (CMOEAs) have been developed with the use…

Artificial Intelligence · Computer Science 2024-02-21 Fei Ming , Wenyin Gong , Ling Wang , Yaochu Jin

Robust iterative methods for solving large sparse systems of linear algebraic equations often suffer from the problem of optimizing the corresponding tuning parameters. To improve the performance of the problem of interest, specific…

Numerical Analysis · Mathematics 2023-10-18 Andrey Petrushov , Boris Krasnopolsky

The covariance matrix adaptation evolution strategy (CMA-ES) is a stochastic search algorithm using a multivariate normal distribution for continuous black-box optimization. In addition to strong empirical results, part of the CMA-ES can be…

Neural and Evolutionary Computing · Computer Science 2024-08-12 Ryoki Hamano , Shinichi Shirakawa , Masahiro Nomura

In this thesis, a Bayes linear methodology for the adjustment of covariance matrices is presented and discussed. A geometric framework for quantifying uncertainties about covariance matrices is set up, and an inner-product for spaces of…

bayes-an · Physics 2016-08-31 Darren J Wilkinson

Expectation-Maximization (EM) algorithm is a widely used iterative algorithm for computing (local) maximum likelihood estimate (MLE). It can be used in an extensive range of problems, including the clustering of data based on the Gaussian…

Machine Learning · Statistics 2023-03-28 Pierre Houdouin , Esa Ollila , Frederic Pascal

We present a framework to build a multiobjective algorithm from single-objective ones. This framework addresses the $p \times n$-dimensional problem of finding p solutions in an n-dimensional search space, maximizing an indicator by dynamic…

Optimization and Control · Mathematics 2019-04-19 Cheikh Touré , Nikolaus Hansen , Anne Auger , Dimo Brockhoff

This paper proposes an improved epsilon constraint-handling mechanism, and combines it with a decomposition-based multi-objective evolutionary algorithm (MOEA/D) to solve constrained multi-objective optimization problems (CMOPs). The…

Neural and Evolutionary Computing · Computer Science 2017-09-19 Zhun Fan , Wenji Li , Xinye Cai , Han Huang , Yi Fang , Yugen You , Jiajie Mo , Caimin Wei , Erik Goodman

The sine-cosine algorithm (SCA) is a new population-based meta-heuristic algorithm. In addition to exploiting sine and cosine functions to perform local and global searches (hence the name sine-cosine), the SCA introduces several random and…

Artificial Intelligence · Computer Science 2018-05-03 Kamal Z. Zamli , Fakhrud Din , Bestoun S. Ahmed , Miroslav Bures

This research concerns a type of configuration optimization problems frequently encountered in engineering design and manufacturing, where the envelope volume in space occupied by a number of components needs to be minimized along with…

Computational Engineering, Finance, and Science · Computer Science 2017-06-13 Pei Cao , Zhaoyan Fan , Robert X. Gao , Jiong Tang

The class of algorithms called Hessian Estimation Evolution Strategies (HE-ESs) update the covariance matrix of their sampling distribution by directly estimating the curvature of the objective function. The approach is practically…

Optimization and Control · Mathematics 2021-06-16 Tobias Glasmachers , Oswin Krause

This paper proposes a natural evolution strategy (NES) for mixed-integer black-box optimization (MI-BBO) that appears in real-world problems such as hyperparameter optimization of machine learning and materials design. This problem is…

Neural and Evolutionary Computing · Computer Science 2023-04-24 Koki Ikeda , Isao Ono

Robots that interact with humans must adapt to individual users' preferences to operate effectively in human-centered environments. An intuitive and effective technique to learn non-expert users' preferences is through rankings of robot…

Robotics · Computer Science 2026-03-11 Nathaniel Dennler , Zhonghao Shi , Yiran Tao , Andreea Bobu , Stefanos Nikolaidis , Maja Matarić

Recently, optimization has become an emerging tool for neuroscientists to study neural code. In the visual system, neurons respond to images with graded and noisy responses. Image patterns eliciting highest responses are diagnostic of the…

Neural and Evolutionary Computing · Computer Science 2022-04-15 Binxu Wang , Carlos R. Ponce

Designing evolutionary algorithms capable of uncovering highly evolvable representations is an open challenge; such evolvability is important because it accelerates evolution and enables fast adaptation to changing circumstances. This paper…

Neural and Evolutionary Computing · Computer Science 2019-07-16 Alexander Gajewski , Jeff Clune , Kenneth O. Stanley , Joel Lehman

This paper presents a novel stochastic gradient descent algorithm for constrained optimization. The proposed algorithm randomly samples constraints and components of the finite sum objective function and relies on a relaxed logarithmic…

Optimization and Control · Mathematics 2025-05-13 Naum Dimitrieski , Jing Cao , Christian Ebenbauer

Many science and engineering applications require finding solutions to planning and optimization problems by satisfying a set of constraints. These constraint problems (CPs) are typically NP-complete and can be formalized as constraint…

Neural and Evolutionary Computing · Computer Science 2024-02-13 Anuraganand Sharma

In practical optimisation the dominant characteristics of the problem are often not known prior. Therefore, there is a need to develop general solvers as it is not always possible to tailor a specialised approach to each application. The…

Neural and Evolutionary Computing · Computer Science 2021-04-23 P. A. Grudniewski , A. J. Sobey

Several real-world applications could be modeled as Mixed-Integer Non-Linear Programming (MINLP) problems, and some prominent examples include portfolio optimization, remote sensing technology, and so on. Most of the models for these…

Computational Engineering, Finance, and Science · Computer Science 2021-01-22 Yi Chen , Aimin Zhou , Swagatam Das

The expectation-maximization (EM) algorithm is an iterative method for finding maximum likelihood estimates when data are incomplete or are treated as being incomplete. The EM algorithm and its variants are commonly used for parameter…

Computation · Statistics 2013-06-26 Ryan P. Browne , Sanjeena Subedi , Paul McNicholas