English
Related papers

Related papers: Surrogate-based categorical neighborhoods for mixe…

200 papers

This work introduces the StoMADS-PB algorithm for constrained stochastic blackbox optimization, which is an extension of the mesh adaptive direct-search (MADS) method originally developed for deterministic blackbox optimization under…

Optimization and Control · Mathematics 2022-07-29 Kwassi Joseph Dzahini , Michael Kokkolaras , Sébastien Le Digabel

Bayesian Optimization is a popular tool for tuning algorithms in automatic machine learning (AutoML) systems. Current state-of-the-art methods leverage Random Forests or Gaussian processes to build a surrogate model that predicts algorithm…

Machine Learning · Computer Science 2021-01-08 Jeroen van Hoof , Joaquin Vanschoren

A mathematical framework for modelling constrained mixed-variable optimization problems is presented in a blackbox optimization context. The framework introduces a new notation and allows solution strategies. The notation framework allows…

Optimization and Control · Mathematics 2022-04-05 Charles Audet , Edward Hallé-Hannan , Sébastien Le Digabel

The interest in accelerating black-box optimizers has resulted in several surrogate model-assisted version of the Covariance Matrix Adaptation Evolution Strategy, a state-of-the-art continuous black-box optimizer. The version called…

Neural and Evolutionary Computing · Computer Science 2017-10-02 Jakub Repicky , Lukas Bajer , Zbynek Pitra , Martin Holena

Simulation-based problems involving mixed-variable inputs frequently feature domains that are hierarchical, conditional, heterogeneous, or tree-structured. These characteristics pose challenges for data representation, modeling, and…

Machine Learning · Computer Science 2026-01-21 Paul Saves , Edward Hallé-Hannan , Jasper Bussemaker , Youssef Diouane , Nathalie Bartoli

The exploration of novel architectures requires physics-based simulation due to a lack of prior experience to start from, which introduces two specific challenges for optimization algorithms: evaluations become more expensive (in time) and…

Machine Learning · Computer Science 2025-04-14 Jasper Bussemaker , Paul Saves , Nathalie Bartoli , Thierry Lefebvre , Björn Nagel

Stochastic unit commitment models typically handle uncertainties in forecast demand by considering a finite number of realizations from a stochastic process model for loads. Accurate evaluations of expectations or higher moments for the…

Systems and Control · Computer Science 2014-07-09 Cosmin Safta , Richard L. Chen , Habib N. Najm , Ali Pinar , Jean-paul watson

The present work investigates surrogate model-based optimization for real-time curbside traffic management operations. An optimization problem is formulated to minimize the congestion on roadway segments caused by vehicles stopping on the…

Systems and Control · Electrical Eng. & Systems 2023-10-09 Suyash C. Vishnoi , Michele D. Simoni

For developing innovative systems architectures, modeling and optimization techniques have been central to frame the architecting process and define the optimization and modeling problems. In this context, for system-of-systems the use of…

Artificial Intelligence · Computer Science 2026-05-07 Paul Saves , Jasper Bussemaker , Rémi Lafage , Thierry Lefebvre , Nathalie Bartoli , Youssef Diouane , Joseph Morlier

The data-centric construction of inexpensive surrogates for fine-grained, physical models has been at the forefront of computational physics due to its significant utility in many-query tasks such as uncertainty quantification. Recent…

Machine Learning · Statistics 2021-03-17 Maximilian Rixner , Phaedon-Stelios Koutsourelakis

The computational burden of running a complex computer model can make optimization impractical. Gaussian Processes (GPs) are statistical surrogates (also known as emulators) that alleviate this issue since they cheaply replace the computer…

Computation · Statistics 2019-09-11 Theodoros Mathikolonis , Serge Guillas

Surrogate models provide a quick-to-evaluate approximation to complex computational models and are essential for multi-query problems like design optimisation. The inputs of current deterministic computational models are usually…

Applications · Statistics 2024-10-15 Thomas A. Archbold , Ieva Kazlauskaite , Fehmi Cirak

Global optimization of large-scale, complex systems such as multi-physics black-box simulations and real-world industrial systems is important but challenging. This work presents a novel Surrogate-Based Optimization framework based on…

Machine Learning · Computer Science 2026-01-13 Maaz Ahmad , Iftekhar A. Karimi

Surrogate models provide compact relations between user-defined input parameters and output quantities of interest, enabling the efficient evaluation of complex parametric systems in many-query settings. Such capabilities are essential in a…

Numerical Analysis · Mathematics 2026-03-16 Matteo Giacomini , Pedro Díez

Gradient-free optimization methods, such as surrogate based optimization (SBO) methods, and genetic (GAs), or evolutionary (EAs) algorithms have gained popularity in the field of constrained optimization of expensive black-box functions.…

Optimization and Control · Mathematics 2021-07-22 Ahmed Abouhussein , Nusrat Islam , Yulia T. Peet

The energy transition entails a rapid uptake of renewable energy sources. Besides physical changes within the grid infrastructure, energy storage devices and their smart operation are key measures to master the resulting challenges like,…

Optimization and Control · Mathematics 2019-11-13 Manuel Baumann , Sara Grundel , Philipp Sauerteig , Karl Worthmann

We present a multi-objective evolutionary optimization algorithm that uses Gaussian process (GP) regression-based models to select trial solutions in a multi-generation iterative procedure. In each generation, a surrogate model is…

Neural and Evolutionary Computing · Computer Science 2020-05-22 Xiaobiao Huang , Minghao Song , Zhe Zhang

Polynomial chaos and Gaussian process emulation are methods for surrogate-based uncertainty quantification, and have been developed independently in their respective communities over the last 25 years. Despite tackling similar problems in…

Statistics Theory · Mathematics 2017-01-16 N. E. Owen , P. Challenor , P. P. Menon , S. Bennani

This work introduces StoMADS, a stochastic variant of the mesh adaptive direct-search (MADS) algorithm originally developed for deterministic blackbox optimization. StoMADS considers the unconstrained optimization of an objective function f…

Optimization and Control · Mathematics 2019-11-05 Charles Audet , Kwassi Joseph Dzahini , Michael Kokkolaras , Sébastien Le Digabel

Optimizing expensive black-box systems with limited data is an extremely challenging problem. As a resolution, we present a new surrogate optimization approach by addressing two gaps in prior research -- unimportant input variables and…

Optimization and Control · Mathematics 2021-09-10 Hadis Anahideh , Jay Rosenberger , Victoria Chen