中文
相关论文

相关论文: Finite-Time Analysis of Kernelised Contextual Band…

200 篇论文

Cooperative multi-agent decision making involves a group of agents cooperatively solving learning problems while communicating over a network with delays. In this paper, we consider the kernelised contextual bandit problem, where the reward…

机器学习 · 计算机科学 2020-08-17 Abhimanyu Dubey , Alex Pentland

Contextual bandits are a rich model for sequential decision making given side information, with important applications, e.g., in recommender systems. We propose novel algorithms for contextual bandits harnessing neural networks to…

机器学习 · 统计学 2022-03-01 Parnian Kassraie , Andreas Krause

We consider the stochastic bandit problem with a continuous set of arms, with the expected reward function over the arms assumed to be fixed but unknown. We provide two new Gaussian process-based algorithms for continuous bandit…

机器学习 · 计算机科学 2017-05-18 Sayak Ray Chowdhury , Aditya Gopalan

We study a generalization of the problem of online learning in adversarial linear contextual bandits by incorporating loss functions that belong to a reproducing kernel Hilbert space, which allows for a more flexible modeling of complex…

机器学习 · 统计学 2023-10-04 Gergely Neu , Julia Olkhovskaya , Sattar Vakili

We study the stochastic contextual bandit problem, where the reward is generated from an unknown function with additive noise. No assumption is made about the reward function other than boundedness. We propose a new algorithm, NeuralUCB,…

机器学习 · 计算机科学 2020-07-03 Dongruo Zhou , Lihong Li , Quanquan Gu

We study the regret minimization problem in the novel setting of generalized kernelized bandits (GKBs), where we optimize an unknown function $f^*$ belonging to a reproducing kernel Hilbert space (RKHS) having access to samples generated by…

机器学习 · 计算机科学 2025-12-12 Alberto Maria Metelli , Simone Drago , Marco Mussi

We consider the kernelized contextual bandit problem with a large feature space. This problem involves $K$ arms, and the goal of the forecaster is to maximize the cumulative rewards through learning the relationship between the contexts and…

机器学习 · 统计学 2025-05-21 Shogo Iwazaki , Junpei Komiyama , Masaaki Imaizumi

We study the kernelized bandit problem, that involves designing an adaptive strategy for querying a noisy zeroth-order-oracle to efficiently learn about the optimizer of an unknown function $f$ with a norm bounded by $M<\infty$ in a…

机器学习 · 计算机科学 2022-03-15 Shubhanshu Shekhar , Tara Javidi

We study contextual bandits with budget and time constraints, referred to as constrained contextual bandits.The time and budget constraints significantly complicate the exploration and exploitation tradeoff because they introduce complex…

机器学习 · 计算机科学 2015-10-20 Huasen Wu , R. Srikant , Xin Liu , Chong Jiang

Safety is a desirable property that can immensely increase the applicability of learning algorithms in real-world decision-making problems. It is much easier for a company to deploy an algorithm that is safe, i.e., guaranteed to perform at…

机器学习 · 统计学 2017-03-07 Abbas Kazerouni , Mohammad Ghavamzadeh , Yasin Abbasi-Yadkori , Benjamin Van Roy

Multi-armed bandit algorithms provide solutions for sequential decision-making where learning takes place by interacting with the environment. In this work, we model a distributed optimization problem as a multi-agent kernelized multi-armed…

机器学习 · 计算机科学 2023-12-11 Ayush Rai , Shaoshuai Mou

This paper presents a finite-time analysis of the KL-UCB algorithm, an online, horizon-free index policy for stochastic bandit problems. We prove two distinct results: first, for arbitrary bounded rewards, the KL-UCB algorithm satisfies a…

统计理论 · 数学 2013-08-30 Aurélien Garivier , Olivier Cappé

In this paper, we consider the problem of black-box optimization with noisy feedback revealed in batches, where the unknown function to optimize has a bounded norm in some Reproducing Kernel Hilbert Space (RKHS). We refer to this as the…

机器学习 · 统计学 2026-03-16 Chenkai Ma , Keqin Chen , Jonathan Scarlett

In the kernelized bandit problem, a learner aims to sequentially compute the optimum of a function lying in a reproducing kernel Hilbert space given only noisy evaluations at sequentially chosen points. In particular, the learner aims to…

机器学习 · 计算机科学 2023-08-15 Justin Whitehouse , Zhiwei Steven Wu , Aaditya Ramdas

This paper presents a new algorithm for neural contextual bandits (CBs) that addresses the challenge of delayed reward feedback, where the reward for a chosen action is revealed after a random, unknown delay. This scenario is common in…

机器学习 · 计算机科学 2025-04-17 Mohammadali Moghimi , Sharu Theresa Jose , Shana Moothedath

Many sequential decision-making problems in communication networks can be modeled as contextual bandit problems, which are natural extensions of the well-known multi-armed bandit problem. In contextual bandit problems, at each time, an…

机器学习 · 计算机科学 2016-05-10 Pranav Sakulkar , Bhaskar Krishnamachari

Confidence intervals are a crucial building block in the analysis of various online learning problems. The analysis of kernel based bandit and reinforcement learning problems utilize confidence intervals applicable to the elements of a…

机器学习 · 统计学 2021-11-01 Sattar Vakili , Jonathan Scarlett , Tara Javidi

We consider a contextual bandit problem with $S$ contexts and $K$ actions. In each round $t=1,2,\dots$, the learner observes a random context and chooses an action based on its past experience. The learner then observes a random reward…

机器学习 · 计算机科学 2023-11-29 Chung-Wei Lee , Qinghua Liu , Yasin Abbasi-Yadkori , Chi Jin , Tor Lattimore , Csaba Szepesvári

We consider a contextual bandit problem with a combinatorial action set and time-varying base arm availability. At the beginning of each round, the agent observes the set of available base arms and their contexts and then selects an action…

机器学习 · 计算机科学 2025-09-26 Andi Nika , Sepehr Elahi , Cem Tekin

We consider a kernelized bandit problem with a compact arm set ${X} \subset \mathbb{R}^d $ and a fixed but unknown reward function $f^*$ with a finite norm in some Reproducing Kernel Hilbert Space (RKHS). We propose a class of…

机器学习 · 计算机科学 2025-06-13 Bingshan Hu , Zheng He , Danica J. Sutherland
‹ 上一页 1 2 3 10 下一页 ›