中文
相关论文

相关论文: On-line Search History-assisted Restart Strategy f…

200 篇论文

Hyperparameters of deep neural networks are often optimized by grid search, random search or Bayesian optimization. As an alternative, we propose to use the Covariance Matrix Adaptation Evolution Strategy (CMA-ES), which is known for its…

神经与进化计算 · 计算机科学 2016-04-26 Ilya Loshchilov , Frank Hutter

This tutorial introduces the CMA Evolution Strategy (ES), where CMA stands for Covariance Matrix Adaptation. The CMA-ES is a stochastic, or randomized, method for real-parameter (continuous domain) optimization of non-linear, non-convex…

机器学习 · 计算机科学 2023-03-13 Nikolaus Hansen

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is a popular method to deal with nonconvex and/or stochastic optimization problems when the gradient information is not available. Being based on the CMA-ES, the recently proposed…

神经与进化计算 · 计算机科学 2017-05-19 Ilya Loshchilov , Tobias Glasmachers , Hans-Georg Beyer

One of the most challenging types of ill-posedness in global optimization is the presence of insensitivity regions in design parameter space, so the identification of their shape will be crucial, if ill-posedness is irrecoverable. Such…

神经与进化计算 · 计算机科学 2019-05-20 Jakub Sawicki , Maciej Smołka , Marcin Łoś , Robert Schaefer

Evolution-based neural architecture search requires high computational resources, resulting in long search time. In this work, we propose a framework of applying the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) to the neural…

神经与进化计算 · 计算机科学 2021-07-16 Nilotpal Sinha , Kuan-Wen Chen

Evolutionary optimization algorithms often face defects and limitations that complicate the evolution processes or even prevent them from reaching the global optimum. A notable constraint pertains to the considerable quantity of function…

神经与进化计算 · 计算机科学 2025-05-23 Farshid Farhadi Khouzani , Abdolreza Mirzaei , Paul La Plante , Laxmi Gewali

Contextual policy search (CPS) is a class of multi-task reinforcement learning algorithms that is particularly useful for robotic applications. A recent state-of-the-art method is Contextual Covariance Matrix Adaptation Evolution Strategies…

机器学习 · 计算机科学 2019-04-16 Alexander Fabisch

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is widely accepted as a robust derivative-free continuous optimization algorithm for non-linear and non-convex optimization problems. CMA-ES is well known to be almost…

神经与进化计算 · 计算机科学 2014-06-12 Ilya Loshchilov , Marc Schoenauer , Michèle Sebag , Nikolaus Hansen

Various variants of the well known Covariance Matrix Adaptation Evolution Strategy (CMA-ES) have been proposed recently, which improve the empirical performance of the original algorithm by structural modifications. However, in practice it…

神经与进化计算 · 计算机科学 2018-08-20 Sander van Rijn , Hao Wang , Matthijs van Leeuwen , Thomas Bäck

This paper addresses the development of a covariance matrix self-adaptation evolution strategy (CMSA-ES) for solving optimization problems with linear constraints. The proposed algorithm is referred to as Linear Constraint CMSA-ES…

神经与进化计算 · 计算机科学 2018-09-24 Patrick Spettel , Hans-Georg Beyer , Michael Hellwig

Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is a highly effective optimization technique. A primary challenge when applying CMA-ES in high dimensionality is sampling from a multivariate normal distribution with an arbitrary…

神经与进化计算 · 计算机科学 2026-01-05 Jarosław Arabas , Adam Stelmaszczyk , Eryk Warchulski , Dariusz Jagodziński , Rafał Biedrzycki

We propose a computationally efficient limited memory Covariance Matrix Adaptation Evolution Strategy for large scale optimization, which we call the LM-CMA-ES. The LM-CMA-ES is a stochastic, derivative-free algorithm for numerical…

神经与进化计算 · 计算机科学 2014-04-23 Ilya Loshchilov

In this paper, we propose an efficient approximated rank one update for covariance matrix adaptation evolution strategy (CMA-ES). It makes use of two evolution paths as simple as that of CMA-ES, while avoiding the computational matrix…

神经与进化计算 · 计算机科学 2017-10-24 Zhenhua Li , Qingfu Zhang

This paper proposes RCMAES, a novel variant of the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) for CEC benchmark optimization. RCMAES integrates a dimension-dependent nonlinear population-size reduction strategy with an…

神经与进化计算 · 计算机科学 2026-05-01 Khoirul Faiq Muzakka , Sören Möller , Martin Finsterbusch

We propose a novel constraint-handling technique for the covariance matrix adaptation evolution strategy (CMA-ES). The proposed technique is aimed at solving explicitly constrained black-box continuous optimization problems, in which the…

神经与进化计算 · 计算机科学 2022-05-11 Naoki Sakamoto , Youhei Akimoto

Recently it was shown by Nesterov (2011) that techniques form convex optimization can be used to successfully accelerate simple derivative-free randomized optimization methods. The appeal of those schemes lies in their low complexity, which…

最优化与控制 · 数学 2014-06-13 Sebastian U. Stich

The covariance matrix adaptive evolution strategy (CMA-ES) has been widely used in the field of 2D/3D registration in recent years. This optimization method exhibits exceptional robustness and usability for complex surgical scenarios.…

图像与视频处理 · 电气工程与系统科学 2024-05-17 Zhirun Zhang , Minheng Chen

The covariance matrix adaptation evolution strategy (CMA-ES) is a stochastic search algorithm using a multivariate normal distribution for continuous black-box optimization. In addition to strong empirical results, part of the CMA-ES can be…

神经与进化计算 · 计算机科学 2024-08-12 Ryoki Hamano , Shinichi Shirakawa , Masahiro Nomura

Optimum implementation of non-conventional wells allows us to increase considerably hydrocarbon recovery. By considering the high drilling cost and the potential improvement in well productivity, well placement decision is an important…

计算工程、金融与科学 · 计算机科学 2010-11-25 Zyed Bouzarkouna , Didier Yu Ding , Anne Auger

In this study, we consider a continuous min--max optimization problem $\min_{x \in \mathbb{X} \max_{y \in \mathbb{Y}}}f(x,y)$ whose objective function is a black-box. We propose a novel approach to minimize the worst-case objective function…

神经与进化计算 · 计算机科学 2023-03-29 Atsuhiro Miyagi , Yoshiki Miyauchi , Atsuo Maki , Kazuto Fukuchi , Jun Sakuma , Youhei Akimoto
‹ 上一页 1 2 3 10 下一页 ›