English
Related papers

Related papers: Use of static surrogates in hyperparameter optimiz…

200 papers

Decision support systems often rely on solving complex optimization problems that may require to estimate uncertain parameters beforehand. Recent studies have shown how using traditionally trained estimators for this task can lead to…

Machine Learning · Computer Science 2025-12-19 Gaetano Signorelli , Michele Lombardi

This paper develops a surrogate model refinement approach for the simulation of dynamical systems and the solution of optimization problems governed by dynamical systems in which surrogates replace expensive-to-compute state- and…

Optimization and Control · Mathematics 2025-09-08 Jonathan R. Cangelosi , Matthias Heinkenschloss

We propose an optimization algorithm to improve the design and performance of quantum communication networks. When physical architectures become too complex for analytical methods, numerical simulation becomes essential to study quantum…

Quantum Physics · Physics 2025-08-21 Luise Prielinger , Álvaro G. Iñesta , Gayane Vardoyan

Surrogate models are used to reduce the burden of expensive-to-evaluate objective functions in optimization. By creating models which map genomes to objective values, these models can estimate the performance of unknown inputs, and so be…

Neural and Evolutionary Computing · Computer Science 2019-07-17 Alexander Hagg , Martin Zaefferer , Jörg Stork , Adam Gaier

In NeuroEvolution, the topologies of artificial neural networks are optimized with evolutionary algorithms to solve tasks in data regression, data classification, or reinforcement learning. One downside of NeuroEvolution is the large amount…

Neural and Evolutionary Computing · Computer Science 2019-02-12 Jörg Stork , Martin Zaefferer , Thomas Bartz-Beielstein

The automation of feature extraction of machine learning has been successfully realized by the explosive development of deep learning. However, the structures and hyperparameters of deep neural network architectures also make huge…

Machine Learning · Computer Science 2024-10-01 Wenzhu Shao

This paper presents a methodological framework for training, self-optimising, and self-organising surrogate models to approximate and speed up multiobjective optimisation of technical systems based on multiphysics simulations. At the hand…

Machine Learning · Computer Science 2024-04-04 Diego Botache , Jens Decke , Winfried Ripken , Abhinay Dornipati , Franz Götz-Hahn , Mohamed Ayeb , Bernhard Sick

Optimal actuator and control design is studied as a multi-level optimisation problem, where the actuator design is evaluated based on the performance of the associated optimal closed loop. The evaluation of the optimal closed loop for a…

Optimization and Control · Mathematics 2024-02-13 Dante Kalise , Estefanía Loayza-Romero , Kirsten A. Morris , Zhengang Zhong

This work is in the context of blackbox optimization where the functions defining the problem are expensive to evaluate and where no derivatives are available. A tried and tested technique is to build surrogates of the objective and the…

Optimization and Control · Mathematics 2022-08-18 Charles Audet , Sébastien Le Digabel , Renaud Saltet

In networked dynamical systems, inferring governing parameters is crucial for predicting nodal dynamics, such as gene expression levels, species abundance, or population density. While many parameter estimation techniques rely on…

Adaptation and Self-Organizing Systems · Physics 2025-03-25 Yanna Ding , Malik Magdon-Ismail , Jianxi Gao

There is a clear need for efficient algorithms to tune hyperparameters for statistical learning schemes, since the commonly applied search methods (such as grid search with N-fold cross-validation) are inefficient and/or approximate.…

Machine Learning · Computer Science 2020-04-07 Luis Miguel Lopez-Ramos , Baltasar Beferull-Lozano

This paper investigates lung nodule classification by using deep neural networks (DNNs). Hyperparameter optimization in DNNs is a computationally expensive problem, where evaluating a hyperparameter configuration may take several hours or…

Machine Learning · Computer Science 2019-01-03 Miao Zhang , Huiqi Li , Juan Lyu , Sai Ho Ling , Steven Su

Biophysical neural system simulations are among the most computationally demanding scientific applications, and their optimization requires navigating high-dimensional parameter spaces under numerous constraints that impose a binary…

The optimization of structural parameters, such as mass(m), stiffness(k), and damping coefficient(c), is critical for designing efficient, resilient, and stable structures. Conventional numerical approaches, including Finite Element Method…

Neural and Evolutionary Computing · Computer Science 2026-02-24 Sagnik Mukherjee , Indrajit Barua

We consider nonlinear optimization problems that involve surrogate models represented by neural networks. We demonstrate first how to directly embed neural network evaluation into optimization models, highlight a difficulty with this…

Optimization and Control · Mathematics 2021-11-23 Dominic Yang , Prasanna Balaprakash , Sven Leyffer

Spiking Neural Networks (SNN). SNNs are based on a more biologically inspired approach than usual artificial neural networks. Such models are characterized by complex dynamics between neurons and spikes. These are very sensitive to the…

Neural and Evolutionary Computing · Computer Science 2024-09-06 Thomas Firmin , Pierre Boulet , El-Ghazali Talbi

An accurate and efficient simulation of the hysteretic behavior of materials and components is essential for structural analysis. The surrogate model based on neural networks shows significant potential in balancing efficiency and accuracy.…

Machine Learning · Computer Science 2023-06-21 Yongjia Xu , Xinzheng Lu , Yifan Fei , Yuli Huang

Surrogates, models that mimic the behavior of programs, form the basis of a variety of development workflows. We study three surrogate-based design patterns, evaluating each in case studies on a large-scale CPU simulator. With surrogate…

Programming Languages · Computer Science 2021-12-14 Alex Renda , Yi Ding , Michael Carbin

In design, fabrication, and control problems, we are often faced with the task of synthesis, in which we must generate an object or configuration that satisfies a set of constraints while maximizing one or more objective functions. The…

Machine Learning · Computer Science 2021-11-08 Xingyuan Sun , Tianju Xue , Szymon Rusinkiewicz , Ryan P. Adams

A surrogate-based topology optimisation algorithm for linear elastic structures under parametric loads and boundary conditions is proposed. Instead of learning the parametric solution of the state (and adjoint) problems or the optimisation…

Numerical Analysis · Mathematics 2025-11-04 Matteo Giacomini , Antonio Huerta