中文
相关论文

相关论文: Optimization for Gaussian Processes via Chaining

200 篇论文

Kernelized bandits, also known as Bayesian optimization (BO), has been a prevalent method for optimizing complicated black-box reward functions. Various BO algorithms have been theoretically shown to enjoy upper bounds on their cumulative…

机器学习 · 计算机科学 2023-10-10 Zhongxiang Dai , Gregory Kang Ruey Lau , Arun Verma , Yao Shu , Bryan Kian Hsiang Low , Patrick Jaillet

In this paper, the problem of maximizing a black-box function $f:\mathcal{X} \to \mathbb{R}$ is studied in the Bayesian framework with a Gaussian Process (GP) prior. In particular, a new algorithm for this problem is proposed, and high…

机器学习 · 统计学 2018-01-09 Shubhanshu Shekhar , Tara Javidi

We consider the continuum-armed bandits problem, under a novel setting of recommending the best arms within a fixed budget under aggregated feedback. This is motivated by applications where the precise rewards are impossible or expensive to…

机器学习 · 计算机科学 2021-12-28 Mengyan Zhang , Russell Tsuchida , Cheng Soon Ong

In this paper, we study the problem of Gaussian process (GP) bandits under relaxed optimization criteria stating that any function value above a certain threshold is "good enough". On the theoretical side, we study various {\em lenient…

机器学习 · 统计学 2021-05-27 Xu Cai , Selwyn Gomes , Jonathan Scarlett

Gaussian process upper confidence bound (GP-UCB) is a theoretically promising approach for black-box optimization; however, the confidence parameter $\beta$ is considerably large in the theorem and chosen heuristically in practice. Then,…

机器学习 · 计算机科学 2023-06-13 Shion Takeno , Yu Inatsu , Masayuki Karasuyama

Bayesian optimization is a framework for global search via maximum a posteriori updates rather than simulated annealing, and has gained prominence for decision-making under uncertainty. In this work, we cast Bayesian optimization as a…

机器学习 · 计算机科学 2022-03-24 Amrit Singh Bedi , Dheeraj Peddireddy , Vaneet Aggarwal , Brian M. Sadler , Alec Koppel

This paper discusses a scenario approach to robust optimization of a blackbox function in a bandit setting. We assume that the blackbox function can be modeled as a Gaussian Process (GP) for every realization of the uncertain parameter. We…

最优化与控制 · 数学 2018-05-01 Shaunak D. Bopardikar , Vaibhav Srivastava

By enabling constraint-aware online model adaptation, model predictive control using Gaussian process (GP) regression has exhibited impressive performance in real-world applications and received considerable attention in the learning-based…

最优化与控制 · 数学 2024-09-17 Amon Lahr , Andrea Zanelli , Andrea Carron , Melanie N. Zeilinger

We consider Bayesian optimization using Gaussian Process models, also referred to as kernel-based bandit optimization. We study the methodology of exploring the domain using random samples drawn from a distribution. We show that this random…

机器学习 · 计算机科学 2024-02-05 Sudeep Salgia , Sattar Vakili , Qing Zhao

We consider the problem of optimising functions in the reproducing kernel Hilbert space (RKHS) of a Mat\'ern kernel with smoothness parameter $\nu$ over the domain $[0,1]^d$ under noisy bandit feedback. Our contribution, the $\pi$-GP-UCB…

机器学习 · 计算机科学 2023-02-28 David Janz , David R. Burt , Javier González

We consider the combinatorial volatile Gaussian process (GP) semi-bandit problem. Each round, an agent is provided a set of available base arms and must select a subset of them to maximize the long-term cumulative reward. We study the…

机器学习 · 计算机科学 2025-02-13 Jack Sandberg , Niklas Åkerblom , Morteza Haghir Chehreghani

We provide a simple method to combine stochastic bandit algorithms. Our approach is based on a "meta-UCB" procedure that treats each of $N$ individual bandit algorithms as arms in a higher-level $N$-armed bandit problem that we solve with a…

机器学习 · 计算机科学 2020-12-25 Ashok Cutkosky , Abhimanyu Das , Manish Purohit

Consider the sequential optimization of an expensive to evaluate and possibly non-convex objective function $f$ from noisy feedback, that can be considered as a continuum-armed bandit problem. Upper bounds on the regret performance of…

机器学习 · 统计学 2021-03-11 Sattar Vakili , Kia Khezeli , Victor Picheny

Sequential optimization of black-box functions from noisy evaluations has been widely studied, with Gaussian Process bandit algorithms such as GP-UCB guaranteeing no-regret in stationary settings. However, for time-varying objectives, it is…

机器学习 · 统计学 2025-12-04 Eliabelle Mauduit , Eloïse Berthier , Andrea Simonetto

Gaussian process optimization is a successful class of algorithms(e.g. GP-UCB) to optimize a black-box function through sequential evaluations. However, for functions with continuous domains, Gaussian process optimization has to rely on…

机器学习 · 计算机科学 2022-03-15 Marco Rando , Luigi Carratino , Silvia Villa , Lorenzo Rosasco

We tackle the problem of online reward maximisation over a large finite set of actions described by their contexts. We focus on the case when the number of actions is too big to sample all of them even once. However we assume that we have…

机器学习 · 计算机科学 2013-09-27 Michal Valko , Nathaniel Korda , Remi Munos , Ilias Flaounas , Nelo Cristianini

In this work, we address the open problem of finding low-complexity near-optimal multi-armed bandit algorithms for sequential decision making problems. Existing bandit algorithms are either sub-optimal and computationally simple (e.g.,…

机器学习 · 计算机科学 2018-04-18 Fang Liu , Sinong Wang , Swapna Buccapatnam , Ness Shroff

This paper investigates stochastic and adversarial combinatorial multi-armed bandit problems. In the stochastic setting under semi-bandit feedback, we derive a problem-specific regret lower bound, and discuss its scaling with the dimension…

机器学习 · 计算机科学 2015-11-09 Richard Combes , M. Sadegh Talebi , Alexandre Proutiere , Marc Lelarge

In order to improve the performance of Bayesian optimisation, we develop a modified Gaussian process upper confidence bound (GP-UCB) acquisition function. This is done by sampling the exploration-exploitation trade-off parameter from a…

机器学习 · 计算机科学 2020-06-09 Julian Berk , Sunil Gupta , Santu Rana , Svetha Venkatesh

We consider sequential optimization of an unknown function in a reproducing kernel Hilbert space. We propose a Gaussian process-based algorithm and establish its order-optimal regret performance (up to a poly-logarithmic factor). This is…

机器学习 · 统计学 2021-11-01 Sudeep Salgia , Sattar Vakili , Qing Zhao