English
Related papers

Related papers: A Methodology for Effective Surrogate Learning in …

200 papers

Recent Meta-Black-Box Optimization (MetaBBO) approaches have shown possibility of enhancing the optimization performance through learning meta-level policies to dynamically configure low-level optimizers. However, existing MetaBBO…

Machine Learning · Computer Science 2025-03-25 Zeyuan Ma , Zhiyang Huang , Jiacheng Chen , Zhiguang Cao , Yue-Jiao Gong

We investigate the effectiveness of a simple solution to the common problem of deep learning in medical image analysis with limited quantities of labeled training data. The underlying idea is to assign artificial labels to abundantly…

Computer Vision and Pattern Recognition · Computer Science 2019-01-28 Nima Tajbakhsh , Yufei Hu , Junli Cao , Xingjian Yan , Yi Xiao , Yong Lu , Jianming Liang , Demetri Terzopoulos , Xiaowei Ding

High-performance scientific simulations, important for comprehension of complex systems, encounter computational challenges especially when exploring extensive parameter spaces. There has been an increasing interest in developing deep…

Machine Learning · Computer Science 2024-07-15 Pradeep Bajracharya , Javier Quetzalcóatl Toledo-Marín , Geoffrey Fox , Shantenu Jha , Linwei Wang

Not being able to understand and predict the behavior of deep learning systems makes it hard to decide what architecture and algorithm to use for a given problem. In science and engineering, modeling is a methodology used to understand…

Machine Learning · Computer Science 2023-09-15 Michael Y. Li , Erin Grant , Thomas L. Griffiths

We present a framework for automatically structuring and training fast, approximate, deep neural surrogates of stochastic simulators. Unlike traditional approaches to surrogate modeling, our surrogates retain the interpretable structure and…

We propose an optimization algorithm to improve the design and performance of quantum communication networks. When physical architectures become too complex for analytical methods, numerical simulation becomes essential to study quantum…

Quantum Physics · Physics 2025-08-21 Luise Prielinger , Álvaro G. Iñesta , Gayane Vardoyan

In physics and engineering, many processes are modeled using non-differentiable black-box simulators, making the optimization of such functions particularly challenging. To address such cases, inspired by the Gradient Theorem, we propose…

Challenging problems of deep reinforcement learning systems with regard to the application on real systems are their adaptivity to changing environments and their efficiency w.r.t. computational resources and data. In the application of…

Machine Learning · Computer Science 2022-02-18 Maria Kalweit , Gabriel Kalweit , Moritz Werling , Joschka Boedecker

Explainable AI is a crucial component for edge services, as it ensures reliable decision making based on complex AI models. Surrogate models are a prominent approach of XAI where human-interpretable models, such as a linear regression…

Machine Learning · Computer Science 2025-03-12 Foivos Charalampakos , Thomas Tsouparopoulos , Iordanis Koutsopoulos

Artificial intelligence is transforming scientific computing with deep neural network surrogates that approximate solutions to partial differential equations (PDEs). Traditional off-line training methods face issues with storage and I/O…

Machine Learning · Computer Science 2024-10-10 Sofya Dymchenko , Abhishek Purandare , Bruno Raffin

Recently, several optimization methods have been successfully applied to the hyperparameter optimization of deep neural networks (DNNs). The methods work by modeling the joint distribution of hyperparameter values and corresponding error.…

Machine Learning · Computer Science 2016-08-02 Ilija Ilievski , Jiashi Feng

Decades of progress in simulation-based surrogate-assisted optimization and unprecedented growth in computational power have enabled researchers and practitioners to optimize previously intractable complex engineering problems. This paper…

Neural and Evolutionary Computing · Computer Science 2022-12-14 Qi Huang , Roy de Winter , Bas van Stein , Thomas Bäck , Anna V. Kononova

Optimal actuator and control design is studied as a multi-level optimisation problem, where the actuator design is evaluated based on the performance of the associated optimal closed loop. The evaluation of the optimal closed loop for a…

Optimization and Control · Mathematics 2024-02-13 Dante Kalise , Estefanía Loayza-Romero , Kirsten A. Morris , Zhengang Zhong

We present a probabilistic deep learning methodology that enables the construction of predictive data-driven surrogates for stochastic systems. Leveraging recent advances in variational inference with implicit distributions, we put forth a…

Machine Learning · Statistics 2019-01-16 Yibo Yang , Paris Perdikaris

The modeling and control of complex physical systems are essential in real-world problems. We propose a novel framework that is generally applicable to solving PDE-constrained optimal control problems by introducing surrogate models for PDE…

Optimization and Control · Mathematics 2023-12-27 Rakhoon Hwang , Jae Yong Lee , Jin Young Shin , Hyung Ju Hwang

Heuristic optimisation algorithms explore the search space by sampling solutions, evaluating their fitness, and biasing the search in the direction of promising solutions. However, in many cases, this fitness function involves executing…

Neural and Evolutionary Computing · Computer Science 2024-10-07 Pablo S. Naharro , Pablo Toharia , Antonio LaTorre , José-María Peña

Surrogate-based optimization, nature-inspired metaheuristics, and hybrid combinations have become state of the art in algorithm design for solving real-world optimization problems. Still, it is difficult for practitioners to get an overview…

Neural and Evolutionary Computing · Computer Science 2021-01-26 Jörg Stork , A. E. Eiben , Thomas Bartz-Beielstein

Multiscale problems are widely observed across diverse domains in physics and engineering. Translating these problems into numerical simulations and solving them using numerical schemes, e.g. the finite element method, is costly due to the…

Rapid urbanization and growing urban populations worldwide present significant challenges for cities, including increased traffic congestion and air pollution. Effective strategies are needed to manage traffic volumes and reduce emissions.…

Computational Engineering, Finance, and Science · Computer Science 2025-02-18 Elena Natterer , Roman Engelhardt , Sebastian Hörl , Klaus Bogenberger

We introduce a novel approach for end-to-end black-box optimization of high energy physics (HEP) detectors using local deep learning (DL) surrogates. These surrogates approximate a scalar objective function that encapsulates the complex…

Machine Learning · Computer Science 2025-03-19 Kinga Anna Wozniak , Stephen Mulligan , Jan Kieseler , Markus Klute , Francois Fleuret , Tobias Golling