English
Related papers

Related papers: Finding Optimal Points for Expensive Functions Usi…

200 papers

This paper proposes a novel global optimization algorithm, Particle Filter-Based Optimization (PFO), designed for a class of stochastic optimization problems in which the objective function lacks an analytical form and is subject to noisy…

Optimization and Control · Mathematics 2025-06-23 Mostafa Eslami , Maryam Babazadeh

Bayesian optimization (BO) has become an indispensable tool for autonomous decision-making across diverse applications from autonomous vehicle control to accelerated drug and materials discovery. With the growing interest in self-driving…

Machine Learning · Computer Science 2025-08-22 Gary Tom , Stanley Lo , Samantha Corapi , Alan Aspuru-Guzik , Benjamin Sanchez-Lengeling

With the growing computational power available for high-resolution ensemble simulations in scientific fields such as cosmology and oceanology, storage and computational demands present significant challenges. Current surrogate models fall…

Graphics · Computer Science 2025-04-22 Yi-Tang Chen , Haoyu Li , Neng Shi , Xihaier Luo , Wei Xu , Han-Wei Shen

Problem decomposition plays a vital role when applying cooperative coevolution (CC) to large scale global optimization problems. However, most learning-based decomposition algorithms either only apply to additively separable problems or…

Neural and Evolutionary Computing · Computer Science 2021-01-20 An Chen , Zhigang Ren , Muyi Wang , Yongsheng Liang , Hanqing Liu , Wenhao Du

We propose a new globalization strategy that can be used in unconstrained optimization algorithms to support rapid convergence from remote starting points. Our approach is based on using multiple points at each iteration to build a…

Optimization and Control · Mathematics 2017-05-16 Figen Öztoprak , Ş. İlker Birbil

We propose and test the first Reduced Radial Basis Function Method (R$^2$BFM) for solving parametric partial differential equations on irregular domains. The two major ingredients are a stable Radial Basis Function (RBF) solver that has an…

Numerical Analysis · Mathematics 2014-10-09 Yanlai Chen , Sigal Gottlieb , Alfa Heryudono , Akil Narayan

This paper integrates manifold learning techniques within a \emph{Gaussian process upper confidence bound} algorithm to optimize an objective function on a manifold. Our approach is motivated by applications where a full representation of…

Machine Learning · Statistics 2023-11-10 Hwanwoo Kim , Daniel Sanz-Alonso , Ruiyi Yang

Basis Function (BF) expansions are a cornerstone of any engineer's toolbox for computational function approximation which shares connections with both neural networks and Gaussian processes. Even though BF expansions are an intuitive and…

Signal Processing · Electrical Eng. & Systems 2024-08-15 Anton Kullberg , Frida Viset , Isaac Skog , Gustaf Hendeby

Multi-fidelity optimization employs surrogate models that integrate information from varying levels of fidelity to guide efficient exploration of complex design spaces while minimizing the reliance on (expensive) high-fidelity objective…

Bayesian Optimization using Gaussian Processes is a popular approach to deal with the optimization of expensive black-box functions. However, because of the a priori on the stationarity of the covariance matrix of classic Gaussian…

Machine Learning · Statistics 2019-05-10 Ali Hebbal , Loic Brevault , Mathieu Balesdent , El-Ghazali Talbi , Nouredine Melab

Bayesian optimization is normally performed within fixed variable bounds. In cases like hyperparameter tuning for machine learning algorithms, setting the variable bounds is not trivial. It is hard to guarantee that any fixed bounds will…

Optimization and Control · Mathematics 2020-01-15 Wei Chen , Mark Fuge

Bayesian optimization is a powerful framework for optimizing functions that are expensive or time-consuming to evaluate. Recent work has considered Bayesian optimization of function networks (BOFN), where the objective function is given by…

The paper addresses Bayesian inferences in inverse problems with uncertainty quantification involving a computationally expensive forward map associated with solving a partial differential equations. To mitigate the computational cost, the…

Methodology · Statistics 2023-12-18 A. Galaviz , J. A. Christen , A. Capella

Bayesian optimization has emerged as a prominent methodology for optimizing expensive black-box functions by leveraging Gaussian process surrogates, which focus on capturing the global characteristics of the objective function. However, in…

Machine Learning · Computer Science 2026-03-03 Qiyu Wei , Haowei Wang , Richard Allmendinger , Mauricio A. Álvarez

The use of surrogate models instead of computationally expensive simulation codes is very convenient in engineering. Roughly speaking, there are two kinds of surrogate models: the deterministic and the probabilistic ones. These last are…

Applications · Statistics 2015-12-24 Malek Ben Salem , Olivier Roustant , Fabrice Gamboa , Lionel Tomaso

Optimal design under uncertainty has gained much attention in the past ten years due to the ever increasing need for manufacturers to build robust systems at the lowest cost. Reliability-based design optimization (RBDO) allows the analyst…

Methodology · Statistics 2017-04-13 V. Dubourg , J. -M. Bourinet , B. Sudret

It has been shown that cooperative coevolution (CC) can effectively deal with large scale optimization problems (LSOPs) through a divide-and-conquer strategy. However, its performance is severely restricted by the current…

Neural and Evolutionary Computing · Computer Science 2018-03-05 Bei Pang , Zhigang Ren , Yongsheng Liang , An Chen

Gradient-based methods are well-suited for derivative-free optimization (DFO), where finite-difference (FD) estimates are commonly used as gradient surrogates. Traditional stochastic approximation methods, such as Kiefer-Wolfowitz (KW) and…

Optimization and Control · Mathematics 2025-03-03 Guo Liang , Guangwu Liu , Kun Zhang

Reasoning about uncertainty is vital in many real-life autonomous systems. However, current state-of-the-art planning algorithms cannot either reason about uncertainty explicitly, or do so with a high computational burden. Here, we focus on…

Artificial Intelligence · Computer Science 2022-01-31 Moran Barenboim , Vadim Indelman

Surrogate assisted evolutionary algorithms (EA) are rapidly gaining popularity where applications of EA in complex real world problem domains are concerned. Although EAs are powerful global optimizers, finding optimal solution to complex…

Neural and Evolutionary Computing · Computer Science 2013-03-13 Maumita Bhattacharya