English
Related papers

Related papers: Parallel Surrogate-assisted Optimization Using Mes…

200 papers

We present an algorithm for multi-objective optimization of computationally expensive problems. The proposed algorithm is based on solving a set of surrogate problems defined by models of the real one, so that only solutions estimated to be…

Neural and Evolutionary Computing · Computer Science 2021-04-20 Santiago Cuervo , Miguel Melgarejo , Angie Blanco-Cañon , Laura Reyes-Fajardo , Sergio Rojas-Galeano

This paper presents a methodological framework for training, self-optimising, and self-organising surrogate models to approximate and speed up multiobjective optimisation of technical systems based on multiphysics simulations. At the hand…

Machine Learning · Computer Science 2024-04-04 Diego Botache , Jens Decke , Winfried Ripken , Abhinay Dornipati , Franz Götz-Hahn , Mohamed Ayeb , Bernhard Sick

We consider the problem of offline black-box optimization, where the goal is to discover optimal designs (e.g., molecules or materials) from past experimental data. A key challenge in this setting is data scarcity: in many scientific…

Machine Learning · Computer Science 2026-05-22 Azza Fadhel , The Hung Tran , Trong Nghia Hoang , Jana Doppa

In recent years, attention has been focused on the relationship between black-box optimiza- tion problem and reinforcement learning problem. In this research, we propose the Mirror Descent Search (MDS) algorithm which is applicable both for…

Machine Learning · Computer Science 2018-05-15 Megumi Miyashita , Shiro Yano , Toshiyuki Kondo

Bayesian optimization has been shown to be a powerful tool for solving black box problems during online accelerator optimization. The major advantage of Bayesian based optimization techniques is the ability to include prior information…

Accelerator Physics · Physics 2022-11-17 Connie Xu , Ryan Roussel , Auralee Edelen

The architectural advancements in deep neural networks have led to remarkable leap-forwards across a broad array of computer vision tasks. Instead of relying on human expertise, neural architecture search (NAS) has emerged as a promising…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Zhichao Lu , Ran Cheng , Shihua Huang , Haoming Zhang , Changxiao Qiu , Fan Yang

In computer-aided engineering design, the goal of a designer is to find an optimal design on a given requirement using the numerical simulator in loop with an optimization method. In this design optimization process, a good design…

Machine Learning · Computer Science 2023-03-01 Harsh Vardhan , Peter Volgyesi , Janos Sztipanovits

Industries frequently adjust their facilities network by opening new branches in promising areas and closing branches in areas where they expect low profits. In this paper, we examine a particular class of facility location problems. Our…

Artificial Intelligence · Computer Science 2024-03-18 Saeid Amiri , Parisa Zehtabi , Danial Dervovic , Michael Cashmore

Many real-world decision-making processes rely on solving mixed-integer nonlinear programming (MINLP) problems. However, finding high-quality solutions to MINLPs is often computationally demanding. This has motivated the development of…

Optimization and Control · Mathematics 2025-10-17 Marina Cuesta , Claudia D'Ambrosio , María Durban , Vanesa Guerrero , Renan Spencer Trindade

Evolutionary algorithms provide gradient-free optimisation which is beneficial for models that have difficulty in obtaining gradients; for instance, geoscientific landscape evolution models. However, such models are at times computationally…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-28 Rohitash Chandra , Yash Vardhan Sharma

Hyperparameter optimization is the process of identifying the appropriate hyperparameter configuration of a given machine learning model with regard to a given learning task. For smaller data sets, an exhaustive search is possible; However,…

Machine Learning · Computer Science 2022-09-30 Blaž Škrlj , Adi Schwartz , Jure Ferlež , Davorin Kopič , Naama Ziporin

We consider minimizing functions for which it is expensive to compute the (possibly stochastic) gradient. Such functions are prevalent in reinforcement learning, imitation learning and adversarial training. Our target optimization framework…

Machine Learning · Computer Science 2023-06-09 Jonathan Wilder Lavington , Sharan Vaswani , Reza Babanezhad , Mark Schmidt , Nicolas Le Roux

In this paper, we propose a surrogate-assisted evolutionary algorithm (EA) for hyperparameter optimization of machine learning (ML) models. The proposed STEADE model initially estimates the objective function landscape using RadialBasis…

Neural and Evolutionary Computing · Computer Science 2020-12-14 Subhodip Biswas , Adam D Cobb , Andreea Sistrunk , Naren Ramakrishnan , Brian Jalaian

Performance complementarity of solvers available to tackle black-box optimization problems gives rise to the important task of algorithm selection (AS). Automated AS approaches can help replace tedious and labor-intensive manual selection,…

Neural and Evolutionary Computing · Computer Science 2023-07-03 Ana Kostovska , Anja Jankovic , Diederick Vermetten , Sašo Džeroski , Tome Eftimov , Carola Doerr

Real-world optimisation problems typically have objective functions which cannot be expressed analytically. These optimisation problems are evaluated through expensive physical experiments or simulations. Cheap approximations of the…

Neural and Evolutionary Computing · Computer Science 2022-11-01 Mohamed Z. Variawa , Terence L. Van Zyl , Matthew Woolway

In this contribution, we develop an efficient surrogate modeling framework for simulation-based optimization of enhanced oil recovery, where we particularly focus on polymer flooding. The computational approach is based on an adaptive…

Numerical Analysis · Mathematics 2022-03-04 Tim Keil , Hendrik Kleikamp , Rolf J Lorentzen , Micheal B Oguntola , Mario Ohlberger

Surrogate algorithms such as Bayesian optimisation are especially designed for black-box optimisation problems with expensive objectives, such as hyperparameter tuning or simulation-based optimisation. In the literature, these algorithms…

Machine Learning · Computer Science 2024-03-14 Laurens Bliek , Arthur Guijt , Rickard Karlsson , Sicco Verwer , Mathijs de Weerdt

Discrete optimization belongs to the set of $\mathcal{NP}$-hard problems, spanning fields such as mixed-integer programming and combinatorial optimization. A current standard approach to solving convex discrete optimization problems is the…

Machine Learning · Computer Science 2024-02-28 Kyle Mana , Fernando Acero , Stephen Mak , Parisa Zehtabi , Michael Cashmore , Daniele Magazzeni , Manuela Veloso

Surrogate models for partial-differential equations are widely used in the design of meta-materials to rapidly evaluate the behavior of composable components. However, the training cost of accurate surrogates by machine learning can rapidly…

Machine Learning · Computer Science 2020-11-04 Raphaël Pestourie , Youssef Mroueh , Thanh V. Nguyen , Payel Das , Steven G. Johnson

Multi-Objective Evolutionary Algorithms (MOEAs) have proven effective at solving Multi-Objective Optimisation Problems (MOOPs). However, their performance can be significantly hindered when applied to computationally intensive industrial…

Neural and Evolutionary Computing · Computer Science 2026-01-30 Tiwonge Msulira Banda , Alexandru-Ciprian Zăvoianu