English
Related papers

Related papers: Surrogate Ensemble in Expensive Multi-Objective Op…

200 papers

Accurate simulations of the oceans are crucial in understanding the Earth system. Despite their efficiency, simulations at lower resolutions must rely on various uncertain parameterizations to account for unresolved processes. However,…

The remarkable performance of Large Language Models (LLMs) highly relies on crafted prompts. However, manual prompt engineering is a laborious process, creating a core bottleneck for practical application of LLMs. This phenomenon has led to…

Computation and Language · Computer Science 2025-11-21 Qing Zhang , Bing Xu , Xudong Zhang , Yifan Shi , Yang Li , Chen Zhang , Yik Chung Wu , Ngai Wong , Yijie Chen , Hong Dai , Xiansen Chen , Mian Zhang

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Numerical Analysis · Mathematics 2022-08-12 Maarten V. de Hoop , Daniel Zhengyu Huang , Elizabeth Qian , Andrew M. Stuart

Engineering problems that are modeled using sophisticated mathematical methods or are characterized by expensive-to-conduct tests or experiments, are encumbered with limited budget or finite computational resources. Moreover, practical…

Machine Learning · Computer Science 2021-12-24 Yonatan Ashenafi , Piyush Pandita , Sayan Ghosh

Machine learning surrogate emulators are needed in engineering design and optimization tasks to rapidly emulate computationally expensive physics-based models. In micromechanics problems the local full-field response variables are desired…

Computational Engineering, Finance, and Science · Computer Science 2024-05-17 Patxi Fernandez-Zelaia , Jason Mayeur , Jiahao Cheng , Yousub Lee , Kevin Knipe , Kai Kadau

Recent decades have witnessed great advancements in multiobjective evolutionary algorithms (MOEAs) for multiobjective optimization problems (MOPs). However, these progressively improved MOEAs have not necessarily been equipped with scalable…

Neural and Evolutionary Computing · Computer Science 2023-02-28 Songbai Liu , Qiuzhen Lin , Jianqiang Li , Kay Chen Tan

Using Neuroevolution combined with Novelty Search to promote behavioural diversity is capable of constructing high-performing ensembles for classification. However, using gradient descent to train evolved architectures during the search can…

Machine Learning · Computer Science 2022-02-09 Rui P. Cardoso , Emma Hart , David Burth Kurka , Jeremy V. Pitt

With the development of artificial intelligence, simulation-based optimization problems, which present a significant challenge in the process systems engineering community, are increasingly being addressed with the surrogate-based…

Optimization and Control · Mathematics 2025-01-30 Zixuan Zhang , Xiaowei Song , Yujiao Zeng , Jie Li , Yaling Nie , Min Zhu , Jianhua Chen , Linmin Wang , Xin Xiao

Feature selection is crucial in recommender systems for improving model efficiency and predictive performance. Conventional approaches typically employ surrogate models-such as decision trees or neural networks-to estimate feature…

Information Retrieval · Computer Science 2025-08-28 Pengyue Jia , Zhaocheng Du , Yichao Wang , Xiangyu Zhao , Xiaopeng Li , Yuhao Wang , Qidong Liu , Huifeng Guo , Ruiming Tang

Combinatorial optimization problems are notoriously challenging due to their discrete structure and exponentially large solution space. Recent advances in deep reinforcement learning (DRL) have enabled the learning heuristics directly from…

Machine Learning · Computer Science 2025-06-12 Shengda Gu , Kai Li , Junliang Xing , Yifan Zhang , Jian Cheng

One method to solve expensive black-box optimization problems is to use a surrogate model that approximates the objective based on previous observed evaluations. The surrogate, which is cheaper to evaluate, is optimized instead to find an…

Optimization and Control · Mathematics 2021-05-28 Rickard Karlsson , Laurens Bliek , Sicco Verwer , Mathijs de Weerdt

Hyperparameter optimization (HPO) is a central pillar in the automation of machine learning solutions and is mainly performed via Bayesian optimization, where a parametric surrogate is learned to approximate the black box response function…

Machine Learning · Computer Science 2021-01-20 Martin Wistuba , Josif Grabocka

Significant effort has been made to solve computationally expensive optimization problems in the past two decades, and various optimization methods incorporating surrogates into optimization have been proposed. Most research focuses on…

Optimization and Control · Mathematics 2022-04-11 Julian Blank , Kalyanmoy Deb

The optimization of expensive black-box simulators arises in a myriad of modern scientific and engineering applications. Bayesian optimization provides an appealing solution, by leveraging a fitted surrogate model to guide the selection of…

Many control problems require repeated tuning and adaptation of controllers across distinct closed-loop tasks, where data efficiency and adaptability are critical. We propose a hierarchical Bayesian optimization (BO) framework that is…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Sebastian Hirt , Lukas Theiner , Maik Pfefferkorn , Rolf Findeisen

The complex and computationally expensive nature of landscape evolution models pose significant challenges in the inference and optimisation of unknown parameters. Bayesian inference provides a methodology for estimation and uncertainty…

Machine Learning · Statistics 2020-06-30 Rohitash Chandra , Danial Azam , Arpit Kapoor , R. Dietmar Müller

Migration has been a universal phenomenon, which brings opportunities as well as challenges for global development. As the number of migrants (e.g., refugees) increases rapidly in recent years, a key challenge faced by each country is the…

Neural and Evolutionary Computing · Computer Science 2024-09-10 Dan-Xuan Liu , Yu-Ran Gu , Chao Qian , Xin Mu , Ke Tang

Evolutionary algorithms (EAs) have proven effective in exploring the vast solution spaces typical of graph-structured combinatorial problems. However, traditional encoding schemes, such as binary or numerical representations, often fail to…

Neural and Evolutionary Computing · Computer Science 2025-10-28 Jie Zhao , Kang Hao Cheong

The exploration of novel architectures requires physics-based simulation due to a lack of prior experience to start from, which introduces two specific challenges for optimization algorithms: evaluations become more expensive (in time) and…

Machine Learning · Computer Science 2025-04-14 Jasper Bussemaker , Paul Saves , Nathalie Bartoli , Thierry Lefebvre , Björn Nagel

Evolutionary Reinforcement Learning (ERL) that applying Evolutionary Algorithms (EAs) to optimize the weight parameters of Deep Neural Network (DNN) based policies has been widely regarded as an alternative to traditional reinforcement…

Neural and Evolutionary Computing · Computer Science 2023-02-01 Lan Tang , Xiaxi Li , Jinyuan Zhang , Guiying Li , Peng Yang , Ke Tang