English
Related papers

Related papers: Efficient Global Optimization using Deep Gaussian …

200 papers

The Efficient Global Optimization (EGO) algorithm uses a conditional Gaus-sian Process (GP) to approximate an objective function known at a finite number of observation points and sequentially adds new points which maximize the Expected…

Optimization and Control · Mathematics 2016-03-09 Hossein Mohammadi , Rodolphe Le Riche , Eric Touboul

Bayesian Optimization using Gaussian Processes is a popular approach to deal with the optimization of expensive black-box functions. However, because of the a priori on the stationarity of the covariance matrix of classic Gaussian…

Machine Learning · Statistics 2019-05-10 Ali Hebbal , Loic Brevault , Mathieu Balesdent , El-Ghazali Talbi , Nouredine Melab

Efficient Global Optimization (EGO) is the canonical form of Bayesian optimization that has been successfully applied to solve global optimization of expensive-to-evaluate black-box problems. However, EGO struggles to scale with dimension,…

Optimization and Control · Mathematics 2022-04-26 Youssef Diouane , Victor Picheny , Rodolphe Le Riche , Alexandre Scotto Di Perrotolo

Efficient global optimization is a popular algorithm for the optimization of expensive multimodal black-box functions. One important reason for its popularity is its theoretical foundation of global convergence. However, as the budgets in…

Optimization and Control · Mathematics 2017-04-20 Simon Wessing , Mike Preuss

Optimization of very expensive black-box functions requires utilization of maximum information gathered by the process of optimization. Model Guided Sampling Optimization (MGSO) forms a more robust alternative to Jones'…

Neural and Evolutionary Computing · Computer Science 2015-09-01 Lukas Bajer , Martin Holena

Efficient global optimization (EGO) is one of the most widely used noise-free Bayesian optimization algorithms.It comprises the Gaussian process (GP) surrogate model and expected improvement (EI) acquisition function. In practice, when EGO…

Machine Learning · Statistics 2026-03-27 Jingyi Wang , Haowei Wang , Nai-Yuan Chiang , Juliane Mueller , Tucker Hartland , Cosmin G. Petra

We study the problem of constrained efficient global optimization, where both the objective and constraints are expensive black-box functions that can be learned with Gaussian processes. We propose CONFIG (CONstrained efFIcient Global…

Optimization and Control · Mathematics 2025-02-07 Wenjie Xu , Yuning Jiang , Bratislav Svetozarevic , Colin N. Jones

In this paper, we investigate the capability of the universal Kriging (UK) model for single-objective global optimization applied within an efficient global optimization (EGO) framework. We implemented this combined UK-EGO framework and…

Machine Learning · Statistics 2018-03-26 Pramudita Satria Palar , Koji Shimoyama

In many global optimization problems motivated by engineering applications, the number of function evaluations is severely limited by time or cost. To ensure that each evaluation contributes to the localization of good candidates for the…

Numerical Analysis · Mathematics 2025-10-20 Julien Villemonteix , Emmanuel Vazquez , Eric Walter

Gaussian processes~(Kriging) are interpolating data-driven models that are frequently applied in various disciplines. Often, Gaussian processes are trained on datasets and are subsequently embedded as surrogate models in optimization…

Optimization and Control · Mathematics 2024-01-17 Artur M. Schweidtmann , Dominik Bongartz , Daniel Grothe , Tim Kerkenhoff , Xiaopeng Lin , Jaromil Najman , Alexander Mitsos

A new technique of global optimization and its applications in particular to neural networks are presented. The algorithm is also compared to other global optimization algorithms such as Gradient descent (GD), Monte Carlo (MC), Genetic…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-18 Homayoun Valafar , Okan K. Ersoy , Faramarz Valafar

Due to the increasing demand for high performance and cost reduction within the framework of complex system design, numerical optimization of computationally costly problems is an increasingly popular topic in most engineering fields. In…

Optimization and Control · Mathematics 2018-06-12 Julien Pelamatti , Loïc Brevault , Mathieu Balesdent , El-Ghazali Talbi , Yannick Guerin

The objective of this Philosophiae Doctor (Ph.D) thesis is to propose an efficient approach for optimizing a multidisciplinary black-box model when the optimization problem is constrained and involves a large number of mixed integer design…

Optimization and Control · Mathematics 2025-07-24 Paul Saves

Bayesian optimization (BO) is a powerful framework for optimizing expensive black-box objectives, yet extending it to graph-structured domains remains challenging due to the discrete and combinatorial nature of graphs. Existing approaches…

Machine Learning · Computer Science 2025-11-12 Shu Hong , Yongsheng Mei , Mahdi Imani , Tian Lan

Gaussian process (GP) based Bayesian optimization (BO) is a powerful method for optimizing black-box functions efficiently. The practical performance and theoretical guarantees of this approach depend on having the correct GP hyperparameter…

Machine Learning · Statistics 2024-06-07 Huong Ha , Vu Nguyen , Hung Tran-The , Hongyu Zhang , Xiuzhen Zhang , Anton van den Hengel

Bayesian Optimization is a popular approach for optimizing expensive black-box functions. Its key idea is to use a surrogate model to approximate the objective and, importantly, quantify the associated uncertainty that allows a sequential…

Machine Learning · Statistics 2025-02-05 Haoxian Chen , Henry Lam

Compared with the fixed-run designs, the sequential adaptive designs (SAD) are thought to be more efficient and effective. Efficient global optimization (EGO) is one of the most popular SAD methods for expensive black-box optimization…

Machine Learning · Computer Science 2020-10-22 Jianhui Ning , Yao Xiao , Zikang Xiong

Design optimization under uncertainty is notoriously difficult when the objective function is expensive to evaluate. State-of-the-art techniques, e.g, stochastic optimization or sampling average approximation, fail to learn exploitable…

Optimization and Control · Mathematics 2019-06-20 Piyush Pandita , Ilias Bilionis , Jitesh Panchal

This paper considers global optimization with a black-box unknown objective function that can be non-convex and non-differentiable. Such a difficult optimization problem arises in many real-world applications, such as parameter tuning in…

Optimization and Control · Mathematics 2016-07-19 Kenji Kawaguchi , Yu Maruyama , Xiaoyu Zheng

Bayesian optimization (BO) has well-documented merits for optimizing black-box functions with an expensive evaluation cost. Such functions emerge in applications as diverse as hyperparameter tuning, drug discovery, and robotics. BO hinges…

Machine Learning · Statistics 2026-05-28 Qin Lu , Konstantinos D. Polyzos , Bingcong Li , Georgios B. Giannakis
‹ Prev 1 2 3 10 Next ›