English
Related papers

Related papers: Optimization for Gaussian Processes via Chaining

200 papers

Bayesian optimization (BO) has been widely used to optimize expensive and black-box functions across various domains. However, existing BO methods have not addressed tensor-output functions. To fill this gap, we propose a novel…

Machine Learning · Computer Science 2026-03-03 Jingru Huang , Haijie Xu , Jie Guo , Manrui Jiang , Chen Zhang

In many real world problems, we are faced with the problem of selecting the best among a finite number of alternatives, where the best alternative is determined based on context specific information. In this work, we study the contextual…

Optimization and Control · Mathematics 2022-01-20 Sait Cakmak , Siyang Gao , Enlu Zhou

Bayesian hyperparameter optimization relies heavily on Gaussian Process (GP) surrogates, due to robust distributional posteriors and strong performance on limited training samples. GPs however underperform in categorical hyperparameter…

Machine Learning · Computer Science 2025-09-23 Riccardo Doyle

Efficient optimisation of black-box problems that comprise both continuous and categorical inputs is important, yet poses significant challenges. We propose a new approach, Continuous and Categorical Bayesian Optimisation (CoCaBO), which…

Machine Learning · Statistics 2020-08-11 Binxin Ru , Ahsan S. Alvi , Vu Nguyen , Michael A. Osborne , Stephen J Roberts

In this paper, we consider the problem of sequentially optimizing a black-box function $f$ based on noisy samples and bandit feedback. We assume that $f$ is smooth in the sense of having a bounded norm in some reproducing kernel Hilbert…

Machine Learning · Statistics 2018-06-01 Jonathan Scarlett , Ilijia Bogunovic , Volkan Cevher

This paper proposes a stochastic model predictive control method for linear systems affected by additive Gaussian disturbances that optimizes over disturbance feedback matrices online. Closed-loop satisfaction of probabilistic constraints…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Marcell Bartos , Alexandre Didier , Jerome Sieber , Johannes Köhler , Melanie N. Zeilinger

We study the generalized linear bandit (GLB) problem, a contextual multi-armed bandit framework that extends the classical linear model by incorporating a non-linear link function, thereby modeling a broad class of reward distributions such…

Machine Learning · Computer Science 2025-10-31 Yu-Jie Zhang , Sheng-An Xu , Peng Zhao , Masashi Sugiyama

Motivated by applications of bandit algorithms in education, we consider a stochastic multi-armed bandit problem with $\varepsilon$-contaminated rewards. We allow an adversary to give arbitrary unbounded contaminated rewards with full…

Machine Learning · Statistics 2020-06-19 Laura Niss , Ambuj Tewari

We consider the framework of methods for unconstrained minimization that are, in each iteration, restricted to a model that is only a valid approximation to the objective function on some affine subspace containing an incumbent point. These…

Optimization and Control · Mathematics 2025-11-26 Matt Menickelly

We consider the contextual bandit problem, where a player sequentially makes decisions based on past observations to maximize the cumulative reward. Although many algorithms have been proposed for contextual bandit, most of them rely on…

Machine Learning · Computer Science 2021-06-08 Qin Ding , Cho-Jui Hsieh , James Sharpnack

This paper analyzes the problem of Gaussian process (GP) bandits with deterministic observations. The analysis uses a branch and bound algorithm that is related to the UCB algorithm of (Srinivas et al, 2010). For GPs with Gaussian…

Machine Learning · Computer Science 2012-07-03 Nando de Freitas , Alex Smola , Masrour Zoghi

This paper considers stochastic linear bandits with general nonlinear constraints. The objective is to maximize the expected cumulative reward over horizon $T$ subject to a set of constraints in each round $\tau\leq T$. We propose a…

Machine Learning · Computer Science 2021-11-11 Xin Liu , Bin Li , Pengyi Shi , Lei Ying

Optimization of expensive computer models with the help of Gaussian process emulators in now commonplace. However, when several (competing) objectives are considered, choosing an appropriate sampling strategy remains an open question. We…

Optimization and Control · Mathematics 2013-10-03 Victor Picheny

Current methods for stochastic hyperparameter learning in Gaussian Processes (GPs) rely on approximations, such as computing biased stochastic gradients or using inducing points in stochastic variational inference. However, when using such…

Machine Learning · Computer Science 2025-08-29 Neta Shoham , Haim Avron

We propose Grab-UCB, a graph-kernel multi-arms bandit algorithm to learn online the optimal source placement in large scale networks, such that the reward obtained from a priori unknown network processes is maximized. The uncertainty calls…

Machine Learning · Computer Science 2023-07-10 Laura Toni , Pascal Frossard

In this paper, we study the stochastic multi-armed bandit problem with graph feedback. Motivated by the clinical trials and recommendation problem, we assume that two arms are connected if and only if they are similar (i.e., their means are…

Machine Learning · Computer Science 2024-05-21 Han Qi , Guo Fei , Li Zhu

In this paper we adapt the nearest neighbour rule to the contextual bandit problem. Our algorithm handles the fully adversarial setting in which no assumptions at all are made about the data-generation process. When combined with a…

Machine Learning · Computer Science 2024-03-11 Stephen Pasteris , Chris Hicks , Vasilios Mavroudis

Developing efficient sequential bidding strategies for repeated auctions is an important practical challenge in various marketing tasks. In this setting, the bidding agent obtains information, on both the value of the item at sale and the…

Machine Learning · Computer Science 2021-03-01 Juliette Achddou , Olivier Cappé , Aurélien Garivier

Bayesian optimization is a powerful tool to optimize a black-box function, the evaluation of which is time-consuming or costly. In this paper, we propose a new approach to Bayesian optimization called GP-MGC, which maximizes multiscale…

Machine Learning · Computer Science 2021-03-18 Takuya Kanazawa

The expected improvement (EI) algorithm is one of the most popular strategies for optimization under uncertainty due to its simplicity and efficiency. Despite its popularity, the theoretical aspects of this algorithm have not been properly…

Machine Learning · Computer Science 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Svetha Venkatesh