English
Related papers

Related papers: Hyper-optimization with Gaussian Process and Diffe…

200 papers

Design optimisation offers the potential to develop lightweight aircraft structures with reduced environmental impact. Due to the high number of design variables and constraints, these challenges are typically addressed using gradient-based…

Computational Engineering, Finance, and Science · Computer Science 2025-08-04 Hauke F. Maathuis , Roeland De Breuker , Saullo G. P. Castro

The classical approach to inverse problems is based on the optimization of a misfit function. Despite its computational appeal, such an approach suffers from many shortcomings, e.g., non-uniqueness of solutions, modeling prior knowledge,…

Machine Learning · Statistics 2014-10-22 Panagiotis Tsilifis , Ilias Bilionis , Ioannis Katsounaros , Nicholas Zabaras

Population-based evolutionary algorithms are often considered when approaching computationally expensive black-box optimization problems. They employ a selection mechanism to choose the best solutions from a given population after comparing…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Judith Echevarrieta , Etor Arza , Aritz Pérez

Accelerator physics relies on numerical algorithms to solve optimization problems in online accelerator control and tasks such as experimental design and model calibration in simulations. The effectiveness of optimization algorithms in…

Bayesian optimization is proposed for automatic learning of optimal controller parameters from experimental data. A probabilistic description (a Gaussian process) is used to model the unknown function from controller parameters to a…

Systems and Control · Computer Science 2019-01-24 Matthias Neumann-Brosig , Alonso Marco , Dieter Schwarzmann , Sebastian Trimpe

Existing high-dimensional Bayesian optimization (BO) methods aim to overcome the curse of dimensionality by carefully encoding structural assumptions, from locality to sparsity to smoothness, into the optimization procedure. Surprisingly,…

Machine Learning · Computer Science 2026-04-10 Colin Doumont , Donney Fan , Natalie Maus , Jacob R. Gardner , Henry Moss , Geoff Pleiss

Many functions have approximately-known upper and/or lower bounds, potentially aiding the modeling of such functions. In this paper, we introduce Gaussian process models for functions where such bounds are (approximately) known. More…

Machine Learning · Computer Science 2022-10-20 Vu Nguyen , Marc Peter Deisenroth , Michael A. Osborne

One way to reduce the time of conducting optimization studies is to evaluate designs in parallel rather than just one-at-a-time. For expensive-to-evaluate black-boxes, batch versions of Bayesian optimization have been proposed. They work by…

Optimization and Control · Mathematics 2023-04-04 Mickael Binois , Nicholson Collier , Jonathan Ozik

Bayesian Optimization has become the reference method for the global optimization of black box, expensive and possibly noisy functions. Bayesian Op-timization learns a probabilistic model about the objective function, usually a Gaussian…

Machine Learning · Statistics 2020-03-10 Antonio Candelieri , Ilaria Giordani , Riccardo Perego , Francesco Archetti

Bilevel optimization problems can be used to represent the collaborative interaction between a power system and grid-connected entities, called the followers, such as data centers. Most existing approaches assume that such followers'…

Systems and Control · Electrical Eng. & Systems 2022-02-09 Yang Liu , Yu Weng , Rufan Yang , Quoc-Tuan Tran , Hung D. Nguyen

In order to improve the performance of Bayesian optimisation, we develop a modified Gaussian process upper confidence bound (GP-UCB) acquisition function. This is done by sampling the exploration-exploitation trade-off parameter from a…

Machine Learning · Computer Science 2020-06-09 Julian Berk , Sunil Gupta , Santu Rana , Svetha Venkatesh

Existing Bayesian Optimization (BO) methods typically balance exploration and exploitation to optimize costly objective functions. However, these methods often suffer from a significant one-step bias, which may lead to convergence towards…

Machine Learning · Computer Science 2025-10-23 Ruiyao Miao , Junren Xiao , Shiya Tsang , Hui Xiong , Yingnian Wu

Computer experiments can emulate the physical systems, help computational investigations, and yield analytic solutions. They have been widely employed with many engineering applications (e.g., aerospace, automotive, energy systems.…

Methodology · Statistics 2022-08-23 Yan Wang , Meng Wang , Areej AlBahar , Xiaowei Yue

We propose an algorithm for Bayesian functional optimisation - that is, finding the function to optimise a process - guided by experimenter beliefs and intuitions regarding the expected characteristics (length-scale, smoothness, cyclicity…

Machine Learning · Computer Science 2020-09-09 Alistair Shilton , Sunil Gupta , Santu Rana , Svetha Venkatesh

For developing innovative systems architectures, modeling and optimization techniques have been central to frame the architecting process and define the optimization and modeling problems. In this context, for system-of-systems the use of…

Artificial Intelligence · Computer Science 2026-05-07 Paul Saves , Jasper Bussemaker , Rémi Lafage , Thierry Lefebvre , Nathalie Bartoli , Youssef Diouane , Joseph Morlier

We propose an efficient optimization algorithm for selecting a subset of training data to induce sparsity for Gaussian process regression. The algorithm estimates an inducing set and the hyperparameters using a single objective, either the…

Machine Learning · Computer Science 2013-11-12 Yanshuai Cao , Marcus A. Brubaker , David J. Fleet , Aaron Hertzmann

Computing a Gaussian process (GP) posterior has a computational cost cubical in the number of historical points. A reformulation of the same GP posterior highlights that this complexity mainly depends on how many \emph{unique} historical…

Machine Learning · Statistics 2022-02-01 Daniele Calandriello , Luigi Carratino , Alessandro Lazaric , Michal Valko , Lorenzo Rosasco

There are a large number of optimization problems in physical models where the relationships between model parameters and outputs are unknown or hard to track. These models are named as black-box models in general because they can only be…

Machine Learning · Computer Science 2021-04-07 Zhongkai Shangguan , Lei Lin , Wencheng Wu , Beilei Xu

Bayesian optimization (BO) is a powerful approach to sample-efficient optimization of black-box functions. However, in settings with very few function evaluations, a successful application of BO may require transferring information from…

Machine Learning · Computer Science 2024-09-10 Aryan Deshwal , Sait Cakmak , Yuhou Xia , David Eriksson

Bayesian methods in machine learning, such as Gaussian processes, have great advantages com-pared to other techniques. In particular, they provide estimates of the uncertainty associated with a prediction. Extending the Bayesian approach to…

Quantum Physics · Physics 2019-05-20 Zhikuan Zhao , Alejandro Pozas-Kerstjens , Patrick Rebentrost , Peter Wittek