中文
相关论文

相关论文: Regret Bounds for Safe Gaussian Process Bandit Opt…

200 篇论文

Gaussian process upper confidence bound (GP-UCB) is a theoretically promising approach for black-box optimization; however, the confidence parameter $\beta$ is considerably large in the theorem and chosen heuristically in practice. Then,…

机器学习 · 计算机科学 2023-06-13 Shion Takeno , Yu Inatsu , Masayuki Karasuyama

Sequential optimization of black-box functions from noisy evaluations has been widely studied, with Gaussian Process bandit algorithms such as GP-UCB guaranteeing no-regret in stationary settings. However, for time-varying objectives, it is…

机器学习 · 统计学 2025-12-04 Eliabelle Mauduit , Eloïse Berthier , Andrea Simonetto

I present the first algorithm for stochastic finite-armed bandits that simultaneously enjoys order-optimal problem-dependent regret and worst-case regret. Besides the theoretical results, the new algorithm is simple, efficient and…

机器学习 · 计算机科学 2016-02-25 Tor Lattimore

This paper analyses the problem of Gaussian process (GP) bandits with deterministic observations. The analysis uses a branch and bound algorithm that is related to the UCB algorithm of (Srinivas et al., 2010). For GPs with Gaussian…

机器学习 · 计算机科学 2012-03-12 Nando de Freitas , Alex Smola , Masrour Zoghi

In this paper, we consider the problem of stochastic optimization under a bandit feedback model. We generalize the GP-UCB algorithm [Srinivas and al., 2012] to arbitrary kernels and search spaces. To do so, we use a notion of localized…

机器学习 · 统计学 2015-10-20 Emile Contal , Cédric Malherbe , Nicolas Vayatis

In this paper, we consider the problem of black-box optimization using Gaussian Process (GP) bandit optimization with a small number of batches. Assuming the unknown function has a low norm in the Reproducing Kernel Hilbert Space (RKHS), we…

机器学习 · 统计学 2022-02-23 Zihan Li , Jonathan Scarlett

Many physical systems have underlying safety considerations that require that the strategy deployed ensures the satisfaction of a set of constraints. Further, often we have only partial information on the state of the system. We study the…

Bayesian optimization (BO) is a widely used iterative black-box optimization method that utilizes Gaussian process (GP) surrogate models. In practice, BO is typically terminated after a fixed evaluation budget is exhausted, which can incur…

机器学习 · 计算机科学 2026-05-22 Haowei Wang , Jingyi Wang , Qiyu Wei

We consider the stochastic bandit problem with a continuous set of arms, with the expected reward function over the arms assumed to be fixed but unknown. We provide two new Gaussian process-based algorithms for continuous bandit…

机器学习 · 计算机科学 2017-05-18 Sayak Ray Chowdhury , Aditya Gopalan

We consider the problem of optimizing an unknown (typically non-convex) function with a bounded norm in some Reproducing Kernel Hilbert Space (RKHS), based on noisy bandit feedback. We consider a novel variant of this problem in which the…

机器学习 · 统计学 2020-03-05 Ilija Bogunovic , Andreas Krause , Jonathan Scarlett

We address the problem of Gaussian Process (GP) optimization in the presence of unknown and potentially varying adversarial perturbations. Unlike traditional robust optimization approaches that focus on maximizing performance under…

机器学习 · 计算机科学 2025-12-12 Artun Saday , Yaşar Cahit Yıldırım , Cem Tekin

We consider the problem of sequentially maximizing an unknown function $f$ over a set of actions of the form $(s,\mathbf{x})$, where the selected actions must satisfy a safety constraint with respect to an unknown safety function $g$. We…

机器学习 · 统计学 2024-06-06 Arpan Losalka , Jonathan Scarlett

In federated multi-armed bandit problems, maximizing global reward while satisfying minimum privacy requirements to protect clients is the main goal. To formulate such problems, we consider a combinatorial contextual bandit setting with…

机器学习 · 计算机科学 2023-07-11 Sepehr Elahi , Baran Atalar , Sevda Öğüt , Cem Tekin

I introduce and analyse an anytime version of the Optimally Confident UCB (OCUCB) algorithm designed for minimising the cumulative regret in finite-armed stochastic bandits with subgaussian noise. The new algorithm is simple, intuitive (in…

机器学习 · 计算机科学 2016-05-09 Tor Lattimore

We study a time-varying Bayesian optimization problem with bandit feedback, where the reward function belongs to a Reproducing Kernel Hilbert Space (RKHS). We approach the problem via an upper-confidence bound Gaussian Process algorithm,…

最优化与控制 · 数学 2025-10-27 Eliabelle Mauduit , Eloïse Berthier , Andrea Simonetto

We study stage-wise conservative linear stochastic bandits: an instance of bandit optimization, which accounts for (unknown) safety constraints that appear in applications such as online advertising and medical trials. At each stage, the…

机器学习 · 计算机科学 2020-10-02 Ahmadreza Moradipari , Christos Thrampoulidis , Mahnoosh Alizadeh

Consider a decision-maker that can pick one out of $K$ actions to control an unknown system, for $T$ turns. The actions are interpreted as different configurations or policies. Holding the same action fixed, the system asymptotically…

机器学习 · 计算机科学 2023-02-28 Siddharth Chandak , Ilai Bistritz , Nicholas Bambos

We consider the problem of optimizing a black-box function based on noisy bandit feedback. Kernelized bandit algorithms have shown strong empirical and theoretical performance for this problem. They heavily rely on the assumption that the…

机器学习 · 计算机科学 2021-11-10 Ilija Bogunovic , Andreas Krause

This paper analyzes the problem of Gaussian process (GP) bandits with deterministic observations. The analysis uses a branch and bound algorithm that is related to the UCB algorithm of (Srinivas et al, 2010). For GPs with Gaussian…

机器学习 · 计算机科学 2012-07-03 Nando de Freitas , Alex Smola , Masrour Zoghi

This paper discusses a scenario approach to robust optimization of a blackbox function in a bandit setting. We assume that the blackbox function can be modeled as a Gaussian Process (GP) for every realization of the uncertain parameter. We…

最优化与控制 · 数学 2018-05-01 Shaunak D. Bopardikar , Vaibhav Srivastava