English
Related papers

Related papers: Gaussian Process Optimization with Mutual Informat…

200 papers

Bayesian optimization (BO) with Gaussian processes (GP) as surrogate models is widely used to optimize analytically unknown and expensive-to-evaluate functions. In this paper, we propose Prior-mean-RObust Bayesian Optimization (PROBO) that…

Artificial Intelligence · Computer Science 2021-11-17 Julian Rodemann , Thomas Augustin

We consider sequential optimization of an unknown function in a reproducing kernel Hilbert space. We propose a Gaussian process-based algorithm and establish its order-optimal regret performance (up to a poly-logarithmic factor). This is…

Machine Learning · Statistics 2021-11-01 Sudeep Salgia , Sattar Vakili , Qing Zhao

We consider the continuum-armed bandits problem, under a novel setting of recommending the best arms within a fixed budget under aggregated feedback. This is motivated by applications where the precise rewards are impossible or expensive to…

Machine Learning · Computer Science 2021-12-28 Mengyan Zhang , Russell Tsuchida , Cheng Soon Ong

Bayesian optimization is a popular formalism for global optimization, but its computational costs limit it to expensive-to-evaluate functions. A competing, computationally more efficient, global optimization framework is optimistic…

Machine Learning · Computer Science 2022-09-05 Julia Grosse , Cheng Zhang , Philipp Hennig

Can one parallelize complex exploration exploitation tradeoffs? As an example, consider the problem of optimal high-throughput experimental design, where we wish to sequentially design batches of experiments in order to simultaneously learn…

Machine Learning · Computer Science 2012-07-03 Thomas Desautels , Andreas Krause , Joel Burdick

In the kernelized bandit problem, a learner aims to sequentially compute the optimum of a function lying in a reproducing kernel Hilbert space given only noisy evaluations at sequentially chosen points. In particular, the learner aims to…

Machine Learning · Computer Science 2023-08-15 Justin Whitehouse , Zhiwei Steven Wu , Aaditya Ramdas

Consider the sequential optimization of a continuous, possibly non-convex, and expensive to evaluate objective function $f$. The problem can be cast as a Gaussian Process (GP) bandit where $f$ lives in a reproducing kernel Hilbert space…

Machine Learning · Statistics 2021-08-23 Sattar Vakili , Nacime Bouziani , Sepehr Jalali , Alberto Bernacchia , Da-shan Shiu

In this paper, we consider the time-varying Bayesian optimization problem. The unknown function at each time is assumed to lie in an RKHS (reproducing kernel Hilbert space) with a bounded norm. We adopt the general variation budget model to…

Machine Learning · Computer Science 2021-05-04 Xingyu Zhou , Ness Shroff

The ability of Gaussian processes (GPs) to predict the behavior of dynamical systems as a more sample-efficient alternative to parametric models seems promising for real-world robotics research. However, the computational complexity of GPs…

Robotics · Computer Science 2022-03-01 Abdolreza Taheri , Joni Pajarinen , Reza Ghabcheloo

Gaussian process (GP) bandits provide a powerful framework for performing blackbox optimization of unknown functions. The characteristics of the unknown function depend heavily on the assumed GP prior. Most work in the literature assume…

Machine Learning · Computer Science 2026-03-13 Jack Sandberg , Morteza Haghir Chehreghani

In this paper, we study the problem of Gaussian process (GP) bandits under relaxed optimization criteria stating that any function value above a certain threshold is "good enough". On the theoretical side, we study various {\em lenient…

Machine Learning · Statistics 2021-05-27 Xu Cai , Selwyn Gomes , Jonathan Scarlett

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementation of the classical…

Machine Learning · Computer Science 2024-07-18 Hwanwoo Kim , Daniel Sanz-Alonso

Gaussian processes~(Kriging) are interpolating data-driven models that are frequently applied in various disciplines. Often, Gaussian processes are trained on datasets and are subsequently embedded as surrogate models in optimization…

Optimization and Control · Mathematics 2024-01-17 Artur M. Schweidtmann , Dominik Bongartz , Daniel Grothe , Tim Kerkenhoff , Xiaopeng Lin , Jaromil Najman , Alexander Mitsos

Scalable Gaussian process (GP) inference is essential for sequential decision-making tasks, yet improving GP scalability remains a challenging problem with many open avenues of research. This paper focuses on iterative GPs, where iterative…

Machine Learning · Computer Science 2025-11-21 Alan Yufei Dong , Jihao Andreas Lin , José Miguel Hernández-Lobato

This paper proposes a new family of algorithms for the online optimisation of composite objectives. The algorithms can be interpreted as the combination of the exponentiated gradient and $p$-norm algorithm. Combined with algorithmic ideas…

Optimization and Control · Mathematics 2022-08-09 Weijia Shao , Fikret Sivrikaya , Sahin Albayrak

Bayesian optimisation has gained great popularity as a tool for optimising the parameters of machine learning algorithms and models. Somewhat ironically, setting up the hyper-parameters of Bayesian optimisation methods is notoriously hard.…

Machine Learning · Statistics 2014-07-01 Ziyu Wang , Nando de Freitas

Gaussian process (GP) based Bayesian optimization (BO) is a powerful method for optimizing black-box functions efficiently. The practical performance and theoretical guarantees of this approach depend on having the correct GP hyperparameter…

Machine Learning · Statistics 2024-06-07 Huong Ha , Vu Nguyen , Hung Tran-The , Hongyu Zhang , Xiuzhen Zhang , Anton van den Hengel

A novel multi-task Gaussian process (GP) framework is proposed, by using a common mean process for sharing information across tasks. In particular, we investigate the problem of time series forecasting, with the objective to improve…

Computation · Statistics 2022-05-25 Arthur Leroy , Pierre Latouche , Benjamin Guedj , Servane Gey

This work focuses on Bayesian optimization (BO) under reward model uncertainty. We propose the first BO algorithm that achieves no-regret guarantee in a general reward setting, requiring only Lipschitz continuity of the objective function…

Machine Learning · Computer Science 2026-02-10 Zishi Zhang , Tao Ren , Yijie Peng

Due to the increasing demand for high performance and cost reduction within the framework of complex system design, numerical optimization of computationally costly problems is an increasingly popular topic in most engineering fields. In…

Optimization and Control · Mathematics 2018-06-12 Julien Pelamatti , Loïc Brevault , Mathieu Balesdent , El-Ghazali Talbi , Yannick Guerin