English
Related papers

Related papers: Initial Steps Towards Tackling High-dimensional Su…

200 papers

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Numerical Analysis · Mathematics 2022-08-12 Maarten V. de Hoop , Daniel Zhengyu Huang , Elizabeth Qian , Andrew M. Stuart

High-performance scientific simulations, important for comprehension of complex systems, encounter computational challenges especially when exploring extensive parameter spaces. There has been an increasing interest in developing deep…

Machine Learning · Computer Science 2024-07-15 Pradeep Bajracharya , Javier Quetzalcóatl Toledo-Marín , Geoffrey Fox , Shantenu Jha , Linwei Wang

Inspired by more detailed modeling of biological neurons, Spiking neural networks (SNNs) have been investigated both as more biologically plausible and potentially more powerful models of neural computation, and also with the aim of…

Neural and Evolutionary Computing · Computer Science 2021-03-24 Bojian Yin , Federico Corradi , Sander M. Bohte

In reliability engineering, conventional surrogate models encounter the "curse of dimensionality" as the number of random variables increases. While the active learning Kriging surrogate approaches with high-dimensional model representation…

Machine Learning · Computer Science 2025-09-10 Wenxiong Li , Hanyu Liao , Suiyin Chen

Optimization algorithms are very different from human optimizers. A human being would gain more experiences through problem-solving, which helps her/him in solving a new unseen problem. Yet an optimization algorithm never gains any…

Neural and Evolutionary Computing · Computer Science 2024-10-28 Xunzhao Yu , Yan Wang , Ling Zhu , Dimitar Filev , Xin Yao

Neural Architecture Search (NAS) methods have been successfully applied to image tasks with excellent results. However, NAS methods are often complex and tend to converge to local minima as soon as generated architectures seem to yield good…

Machine Learning · Computer Science 2021-10-29 Vasco Lopes , Miguel Santos , Bruno Degardin , Luís A. Alexandre

Multi-Objective Evolutionary Algorithms (MOEAs) have proven effective at solving Multi-Objective Optimisation Problems (MOOPs). However, their performance can be significantly hindered when applied to computationally intensive industrial…

Neural and Evolutionary Computing · Computer Science 2026-01-30 Tiwonge Msulira Banda , Alexandru-Ciprian Zăvoianu

Surrogate models driven by sizeable datasets and scientific machine-learning methods have emerged as an attractive microstructure simulation tool with the potential to deliver predictive microstructure evolution dynamics with huge savings…

Materials Science · Physics 2024-01-22 Shaoxun Fan , Andrew L. Hitt , Ming Tang , Babak Sadigh , Fei Zhou

Surrogate-assisted Evolutionary Algorithms~(SAEAs) have shown promising robustness in solving expensive optimization problems. A key aspect that impacts SAEAs' effectiveness is surrogate model selection, which in existing works is…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Yuxin Wu , Hongshu Guo , Ting Huang , Yue-Jiao Gong , Zeyuan Ma

In the last years, reinforcement learning received a lot of attention. One method to solve reinforcement learning tasks is Neuroevolution, where neural networks are optimized by evolutionary algorithms. A disadvantage of Neuroevolution is…

Neural and Evolutionary Computing · Computer Science 2019-07-23 Jörg Stork , Martin Zaefferer , Thomas Bartz-Beielstein , A. E. Eiben

Recent developments in surrogate construction predominantly focused on two strategies to improve surrogate accuracy. Firstly, component-wise domain scaling informed by cross-validation. Secondly, regression to construct response surfaces…

Optimization and Control · Mathematics 2023-04-03 Johann Bouwer , Daniel N. Wilke , Schalk Kok

Evolutionary Reinforcement Learning (ERL), training the Reinforcement Learning (RL) policies with Evolutionary Algorithms (EAs), have demonstrated enhanced exploration capabilities and greater robustness than using traditional policy…

Machine Learning · Computer Science 2025-05-30 Bingdong Li , Mei Jiang , Hong Qian , Ke Tang , Aimin Zhou , Peng Yang

Neuromorphic hardware implementations of Spiking Neural Networks (SNNs) promise energy-efficient, low-latency AI through sparse, event-driven computation. Yet, training SNNs under fine temporal discretization remains a major challenge,…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Roel Koopman , Sebastian Otte , Sander Bohté

A surrogate model approximates the outputs of a solver of Partial Differential Equations (PDEs) with a low computational cost. In this article, we propose a method to build learning-based surrogates in the context of parameterized PDEs,…

Machine Learning · Computer Science 2024-06-28 Alejandro Ribés , Nawfal Benchekroun , Théo Delagnes

Feature selection is an intractable problem, therefore practical algorithms often trade off the solution accuracy against the computation time. In this paper, we propose a novel multi-stage feature selection framework utilizing multiple…

Machine Learning · Computer Science 2021-11-18 Mohammed Ghaith Altarabichi , Sławomir Nowaczyk , Sepideh Pashami , Peyman Sheikholharam Mashhad

Convolutional neural networks (CNNs) have gained remarkable success in recent years. However, their performance highly relies on the architecture hyperparameters, and finding proper hyperparameters for a deep CNN is a challenging…

Neural and Evolutionary Computing · Computer Science 2023-02-28 An Chen , Zhigang Ren , Muyi Wang , Hui Chen , Haoxi Leng , Shuai Liu

The estimation of unknown values of parameters (or hidden variables, control variables) that characterise a physical system often relies on the comparison of measured data with synthetic data produced by some numerical simulator of the…

Machine Learning · Computer Science 2019-01-28 Xi Chen , Mike Hobson

Computation using brain-inspired spiking neural networks (SNNs) with neuromorphic hardware may offer orders of magnitude higher energy efficiency compared to the current analog neural networks (ANNs). Unfortunately, training SNNs with the…

Neural and Evolutionary Computing · Computer Science 2020-06-09 Eimantas Ledinauskas , Julius Ruseckas , Alfonsas Juršėnas , Giedrius Buračas

Spiking Neural Networks (SNNs) have been proposed as biologically plausible and energy-efficient alternatives to conventional Artificial Neural Networks (ANNs). However, the training of SNN usually relies on surrogate gradients due to the…

Neural and Evolutionary Computing · Computer Science 2026-05-11 Himanshu Udupi , Xiaocong Yang , ChengXiang Zhai

Artificial Neural Networks (ANNs) have emerged as hot topics in the research community. Despite the success of ANNs, it is challenging to train and deploy modern ANNs on commodity hardware due to the ever-increasing model size and the…

Neural and Evolutionary Computing · Computer Science 2021-01-19 Shiwei Liu , Decebal Constantin Mocanu , Amarsagar Reddy Ramapuram Matavalam , Yulong Pei , Mykola Pechenizkiy