English
Related papers

Related papers: Efficient Global Optimization using Deep Gaussian …

200 papers

Gaussian process regression is a well-established Bayesian machine learning method. We propose a new approach to Gaussian process regression using quantum kernels based on parameterized quantum circuits. By employing a hardware-efficient…

Quantum Physics · Physics 2024-02-06 Frederic Rapp , Marco Roth

Machine learning algorithms frequently require careful tuning of model hyperparameters, regularization terms, and optimization parameters. Unfortunately, this tuning is often a "black art" that requires expert experience, unwritten rules of…

Machine Learning · Statistics 2012-08-30 Jasper Snoek , Hugo Larochelle , Ryan P. Adams

Many engineering problems involve the optimization of computationally expensive models for which derivative information is not readily available. The Bayesian optimization (BO) framework is a particularly promising approach for solving…

Optimization and Control · Mathematics 2022-02-10 Joel A. Paulson , Congwen Lu

This paper proposes a new class of real-time optimization schemes to overcome system-model mismatch of uncertain processes. This work's novelty lies in integrating derivative-free optimization schemes and multi-fidelity Gaussian processes…

Machine Learning · Computer Science 2021-11-11 Panagiotis Petsagkourakis , Benoit Chachuat , Ehecatl Antonio del Rio-Chanona

Bayesian optimization (BO) has become a popular strategy for global optimization of expensive real-world functions. Contrary to a common expectation that BO is suited to optimizing black-box functions, it actually requires domain knowledge…

Machine Learning · Computer Science 2024-08-06 Zi Wang , George E. Dahl , Kevin Swersky , Chansoo Lee , Zachary Nado , Justin Gilmer , Jasper Snoek , Zoubin Ghahramani

Diverse domains of science and engineering use parameterised mechanistic models. Engineers and scientists can often hypothesise several rival models to explain a specific process or phenomenon. Consider a model discrimination setting where…

Machine Learning · Computer Science 2021-11-02 Simon Olofsson , Eduardo S. Schultz , Adel Mhamdi , Alexander Mitsos , Marc Peter Deisenroth , Ruth Misener

Pose Graph Optimization (PGO) is the problem of estimating a set of poses from pairwise relative measurements. PGO is a nonconvex problem, and currently no known technique can guarantee the computation of an optimal solution. In this paper,…

Robotics · Computer Science 2015-05-14 Giuseppe Calafiore , Luca Carlone , Frank Dellaert

In many real-world optimization problems, we have prior information about what objective function values are achievable. In this paper, we study the scenario that we have either exact knowledge of the minimum value or a, possibly inexact,…

Machine Learning · Computer Science 2025-09-26 Hanyang Wang , Juergen Branke , Matthias Poloczek

A cooperative group optimization (CGO) system is presented to implement CGO cases by integrating the advantages of the cooperative group and low-level algorithm portfolio design. Following the nature-inspired paradigm of a cooperative…

Neural and Evolutionary Computing · Computer Science 2018-08-07 Xiao-Feng Xie , Jiming Liu , Zun-Jing Wang

Optimization problems routinely depend on uncertain parameters that must be predicted before a decision is made. Classical robust and regret formulations are designed to handle erroneous predictions and can provide statistical error bounds…

Optimization and Control · Mathematics 2026-03-30 Jannis Kurtz , Bart P. G. van Parys

Bayesian optimization (BO) is a popular approach for expensive black-box optimization, with applications including parameter tuning, experimental design, robotics. BO usually models the objective function by a Gaussian process (GP), and…

Machine Learning · Statistics 2020-01-22 Chao Qian , Hang Xiong , Ke Xue

Gaussian Process (GP) models are widely used for Robotic Information Gathering (RIG) in exploring unknown environments due to their ability to model complex phenomena with non-parametric flexibility and accurately quantify prediction…

Robotics · Computer Science 2024-06-07 Weizhe Chen , Lantao Liu , Roni Khardon

Many expensive black-box optimisation problems are sensitive to their inputs. In these problems it makes more sense to locate a region of good designs, than a single-possibly fragile-optimal design. Expensive black-box functions can be…

Machine Learning · Computer Science 2021-12-16 Nicholas D. Sanders , Richard M. Everson , Jonathan E. Fieldsend , Alma A. M. Rahat

Bayesian Optimization (BO) is a widely used approach for blackbox optimization that leverages a Gaussian process (GP) model and an acquisition function to guide future sampling. While effective in low-dimensional settings, BO faces…

Machine Learning · Computer Science 2025-11-26 Pavankumar Koratikere , Leifur Leifsson

Gaussian processes (GPs) are the main surrogate functions used for sequential modelling such as Bayesian Optimization and Active Learning. Their drawbacks are poor scaling with data and the need to run an optimization loop when using a…

Machine Learning · Computer Science 2022-11-03 Paul E. Chang , Prakhar Verma , ST John , Victor Picheny , Henry Moss , Arno Solin

High-fidelity simulations and physical experiments are essential for engineering analysis and design, yet their high cost often makes two critical tasks--global sensitivity analysis (GSA) and optimization--prohibitively expensive. This…

Machine Learning · Computer Science 2026-01-01 Bach Do , Nafeezat A. Ajenifuja , Taiwo A. Adebiyi , Ruda Zhang

Artificial neural networks (ANNs) are used in various applications for data-driven black-box modeling and subsequent optimization. Herein, we present an efficient method for deterministic global optimization of ANN embedded optimization…

Optimization and Control · Mathematics 2018-10-16 Artur M Schweidtmann , Alexander Mitsos

The accurate prediction of time-changing variances is an important task in the modeling of financial data. Standard econometric models are often limited as they assume rigid functional relationships for the variances. Moreover, function…

Methodology · Statistics 2014-02-14 Yue Wu , Jose Miguel Hernandez Lobato , Zoubin Ghahramani

We consider the problem of global optimization with noisy zeroth order oracles - a well-motivated problem useful for various applications ranging from hyper-parameter tuning for deep learning to new material design. Existing work relies on…

Machine Learning · Computer Science 2023-07-21 Chong Liu , Yu-Xiang Wang

This paper presents a multi-staged approach to nonmyopic adaptive Gaussian process optimization (GPO) for Bayesian optimization (BO) of unknown, highly complex objective functions that, in contrast to existing nonmyopic adaptive BO…

Machine Learning · Computer Science 2020-02-25 Dmitrii Kharkovskii , Chun Kai Ling , Kian Hsiang Low