English
Related papers

Related papers: Evolutionary Approaches to Expensive Optimisation

200 papers

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Numerical Analysis · Mathematics 2022-08-12 Maarten V. de Hoop , Daniel Zhengyu Huang , Elizabeth Qian , Andrew M. Stuart

Current algorithms used to put a lattice gauge configuration into Landau gauge either suffer from the problem of critical slowing-down or involve an additional computational expense to overcome it. Evolutionary Algorithms (EAs), which have…

High Energy Physics - Lattice · Physics 2009-10-31 J. F. Markham , T. D. Kieu

Surrogate-assisted Evolutionary Algorithms~(SAEAs) have shown promising robustness in solving expensive optimization problems. A key aspect that impacts SAEAs' effectiveness is surrogate model selection, which in existing works is…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Yuxin Wu , Hongshu Guo , Ting Huang , Yue-Jiao Gong , Zeyuan Ma

Deep Reinforcement Learning (DRL) algorithms have been successfully applied to a range of challenging control tasks. However, these methods typically suffer from three core difficulties: temporal credit assignment with sparse rewards, lack…

Machine Learning · Computer Science 2018-10-30 Shauharda Khadka , Kagan Tumer

There is now significant historical data available on decision making in organizations, consisting of the decision problem, what decisions were made, and how desirable the outcomes were. Using this data, it is possible to learn a surrogate…

Neural and Evolutionary Computing · Computer Science 2020-04-23 Olivier Francon , Santiago Gonzalez , Babak Hodjat , Elliot Meyerson , Risto Miikkulainen , Xin Qiu , Hormoz Shahrzad

Evolution Strategies (ESs) have recently become popular for training deep neural networks, in particular on reinforcement learning tasks, a special form of controller design. Compared to classic problems in continuous direct search, deep…

Neural and Evolutionary Computing · Computer Science 2018-07-03 Nils Müller , Tobias Glasmachers

We present a novel approach to performing fitness approximation in genetic algorithms (GAs) using machine-learning (ML) models, through dynamic adaptation to the evolutionary state. Maintaining a dataset of sampled individuals along with…

Neural and Evolutionary Computing · Computer Science 2024-05-22 Itai Tzruia , Tomer Halperin , Moshe Sipper , Achiya Elyasaf

Gradient-free optimization methods, such as surrogate based optimization (SBO) methods, and genetic (GAs), or evolutionary (EAs) algorithms have gained popularity in the field of constrained optimization of expensive black-box functions.…

Optimization and Control · Mathematics 2021-07-22 Ahmed Abouhussein , Nusrat Islam , Yulia T. Peet

Many applications in machine learning require optimizing a function whose true gradient is unknown, but where surrogate gradient information (directions that may be correlated with, but not necessarily identical to, the true gradient) is…

Neural and Evolutionary Computing · Computer Science 2019-06-12 Niru Maheswaranathan , Luke Metz , George Tucker , Dami Choi , Jascha Sohl-Dickstein

This paper proposes a new method for hyperparameter optimization (HPO) that balances exploration and exploitation. While evolutionary algorithms (EAs) show promise in HPO, they often struggle with effective exploitation. To address this, we…

Neural and Evolutionary Computing · Computer Science 2025-04-11 Chul Kim , Inwhee Joe

Many global optimization algorithms of the memetic variety rely on some form of stochastic search, and yet they often lack a sound probabilistic basis. Without a recourse to the powerful tools of stochastic calculus, treading the fine…

Optimization and Control · Mathematics 2024-12-17 Rajdeep Dutta , T Venkatesh Varma , Saikat Sarkar , Mariya Mamajiwala , Noor Awad , Senthilnath Jayavelu , Debasish Roy

Known as two cornerstones of problem solving by search, exploitation and exploration are extensively discussed for implementation and application of evolutionary algorithms (EAs). However, only a few researches focus on evaluation and…

Neural and Evolutionary Computing · Computer Science 2020-01-30 Yu Chen , Jun He

Feature selection is an intractable problem, therefore practical algorithms often trade off the solution accuracy against the computation time. In this paper, we propose a novel multi-stage feature selection framework utilizing multiple…

Machine Learning · Computer Science 2021-11-18 Mohammed Ghaith Altarabichi , Sławomir Nowaczyk , Sepideh Pashami , Peyman Sheikholharam Mashhad

Chance constrained optimization problems allow to model problems where constraints involving stochastic components should only be violated with a small probability. Evolutionary algorithms have been applied to this scenario and shown to…

Neural and Evolutionary Computing · Computer Science 2024-08-23 Frank Neumann , Carsten Witt

Evolutionary artificial neural networks (EANNs) refer to a special class of artificial neural networks (ANNs) in which evolution is another fundamental form of adaptation in addition to learning. Evolutionary algorithms are used to adapt…

Artificial Intelligence · Computer Science 2016-11-17 Ajith Abraham

Evolutionary algorithms (EAs) are general-purpose optimisers that come with several parameters like the sizes of parent and offspring populations or the mutation rate. It is well known that the performance of EAs may depend drastically on…

Neural and Evolutionary Computing · Computer Science 2022-10-13 Mario Alejandro Hevia Fajardo , Dirk Sudholt

Data-driven optimization has found many successful applications in the real world and received increased attention in the field of evolutionary optimization. Most existing algorithms assume that the data used for optimization is always…

Neural and Evolutionary Computing · Computer Science 2021-06-24 Jinjin Xu , Yaochu Jin , Wenli Du

Evolutionary computation offers a variety of tools to solve complex real-world optimization problems. However, research often focuses on smaller, simplified problems and optimization algorithms that sometimes miss expectations in real-world…

In this paper, we consider a fitness-level model of a non-elitist mutation-only evolutionary algorithm (EA) with tournament selection. The model provides upper and lower bounds for the expected proportion of the individuals with fitness…

Neural and Evolutionary Computing · Computer Science 2016-08-29 Anton Eremeev

Intelligent techniques are urged to achieve automatic allocation of the computing resource in Open Radio Access Network (O-RAN), to save computing resource, increase utilization rate of them and decrease the delay. However, the existing…

Neural and Evolutionary Computing · Computer Science 2022-01-13 Gan Ruan , Leandro L. Minku , Zhao Xu , Xin Yao