English
Related papers

Related papers: Un-evaluated Solutions May Be Valuable in Expensiv…

200 papers

Many applications in machine learning require optimizing a function whose true gradient is unknown, but where surrogate gradient information (directions that may be correlated with, but not necessarily identical to, the true gradient) is…

Neural and Evolutionary Computing · Computer Science 2019-06-12 Niru Maheswaranathan , Luke Metz , George Tucker , Dami Choi , Jascha Sohl-Dickstein

Surrogate-Assisted Evolutionary Algorithms (SAEAs) are widely used for expensive Black-Box Optimization. However, their reliance on rigid, manually designed components such as infill criteria and evolutionary strategies during the search…

Neural and Evolutionary Computing · Computer Science 2025-11-20 Yukun Du , Haiyue Yu , Xiaotong Xie , Yan Zheng , Lixin Zhan , Yudong Du , Chongshuang Hu , Boxuan Wang , Jiang Jiang

This work aims at developing new methodologies to optimize computational costly complex systems (e.g., aeronautical engineering systems). The proposed surrogate-based method (often called Bayesian optimization) uses adaptive sampling to…

Decision support systems often rely on solving complex optimization problems that may require to estimate uncertain parameters beforehand. Recent studies have shown how using traditionally trained estimators for this task can lead to…

Machine Learning · Computer Science 2025-12-19 Gaetano Signorelli , Michele Lombardi

Context: Evolutionary algorithms typically require a large number of evaluations (of solutions) to converge - which can be very slow and expensive to evaluate.Objective: To solve search-based software engineering (SE) problems, using fewer…

Software Engineering · Computer Science 2017-09-19 Jianfeng Chen , Vivek Nair , Tim Menzies

Evolutionary Algorithms (EAs) have become the most popular tool for solving widely-existed multi-objective optimization problems. In Multi-Objective EAs (MOEAs), there is increasing interest in using an archive to store non-dominated…

Neural and Evolutionary Computing · Computer Science 2025-12-10 Shengjie Ren , Zimin Liang , Miqing Li , Chao Qian

Surrogate-based optimization relies on so-called infill criteria (acquisition functions) to decide which point to evaluate next. When Kriging is used as the surrogate model of choice (also called Bayesian optimization), one of the most…

Neural and Evolutionary Computing · Computer Science 2020-02-18 Frederik Rehbach , Martin Zaefferer , Boris Naujoks , Thomas Bartz-Beielstein

Metaheuristic search algorithms look for solutions that either maximise or minimise a set of objectives, such as cost or performance. However most real-world optimisation problems consist of nonlinear problems with complex constraints and…

Neural and Evolutionary Computing · Computer Science 2022-06-29 Manjinder Singh , Alexander E. I. Brownlee , David Cairns

Feature selection is an intractable problem, therefore practical algorithms often trade off the solution accuracy against the computation time. In this paper, we propose a novel multi-stage feature selection framework utilizing multiple…

Machine Learning · Computer Science 2021-11-18 Mohammed Ghaith Altarabichi , Sławomir Nowaczyk , Sepideh Pashami , Peyman Sheikholharam Mashhad

The integration of Reinforcement Learning (RL) and Evolutionary Algorithms (EAs) aims at simultaneously exploiting the sample efficiency as well as the diversity and robustness of the two paradigms. Recently, hybrid learning frameworks…

Neural and Evolutionary Computing · Computer Science 2022-11-08 Yuxing Wang , Tiantian Zhang , Yongzhe Chang , Bin Liang , Xueqian Wang , Bo Yuan

Recent decades have witnessed great advancements in multiobjective evolutionary algorithms (MOEAs) for multiobjective optimization problems (MOPs). However, these progressively improved MOEAs have not necessarily been equipped with scalable…

Neural and Evolutionary Computing · Computer Science 2023-02-28 Songbai Liu , Qiuzhen Lin , Jianqiang Li , Kay Chen Tan

In NeuroEvolution, the topologies of artificial neural networks are optimized with evolutionary algorithms to solve tasks in data regression, data classification, or reinforcement learning. One downside of NeuroEvolution is the large amount…

Neural and Evolutionary Computing · Computer Science 2019-02-12 Jörg Stork , Martin Zaefferer , Thomas Bartz-Beielstein

Most of the real-world problems are multimodal in nature that consists of multiple optimum values. Multimodal optimization is defined as the process of finding multiple global and local optima (as opposed to a single solution) of a…

Neural and Evolutionary Computing · Computer Science 2022-08-24 Shatendra Singh , Aruna Tiwari

Simulation-based optimization is a useful method for practical design problems. However, it is difficult for complicated problems due to expensive-computational costs. A popular way to overcome this issue is to use a surrogate model to save…

Signal Processing · Electrical Eng. & Systems 2019-12-11 Yu Li , Hu Wang , Ziming Wen , Xin Wang

Evolutionary Algorithms (EAs) play a crucial role in the architectural configuration and training of Artificial Deep Neural Networks (DNNs), a process known as neuroevolution. However, neuroevolution is hindered by its inherent…

Neural and Evolutionary Computing · Computer Science 2024-09-17 Fergal Stapleton , Edgar Galván

There is now significant historical data available on decision making in organizations, consisting of the decision problem, what decisions were made, and how desirable the outcomes were. Using this data, it is possible to learn a surrogate…

Neural and Evolutionary Computing · Computer Science 2020-04-23 Olivier Francon , Santiago Gonzalez , Babak Hodjat , Elliot Meyerson , Risto Miikkulainen , Xin Qiu , Hormoz Shahrzad

Chemical plant design and optimisation have proven challenging due to the complexity of these real-world systems. The resulting complexity translates into high computational costs for these systems' mathematical formulations and simulation…

Neural and Evolutionary Computing · Computer Science 2022-04-28 Liezl Stander , Matthew Woolway , Terence L. Van Zyl

Building local surrogates to accelerate stationary point searches on potential energy surfaces spans decades of effort. Done correctly, surrogates can reduce the number of expensive electronic structure evaluations by roughly an order of…

Machine Learning · Statistics 2026-04-30 Rohit Goswami

Multi-objective evolutionary algorithms (MOEAs) have become essential tools for solving multi-objective optimization problems (MOPs), making their running time analysis crucial for assessing algorithmic efficiency and guiding practical…

Neural and Evolutionary Computing · Computer Science 2025-07-04 Han Huang , Tianyu Wang , Chaoda Peng , Tongli He , Zhifeng Hao

Evolutionary Reinforcement Learning (ERL) that applying Evolutionary Algorithms (EAs) to optimize the weight parameters of Deep Neural Network (DNN) based policies has been widely regarded as an alternative to traditional reinforcement…

Neural and Evolutionary Computing · Computer Science 2023-02-01 Lan Tang , Xiaxi Li , Jinyuan Zhang , Guiying Li , Peng Yang , Ke Tang