中文
相关论文

相关论文: Kernel Methods for Cooperative Multi-Agent Context…

200 篇论文

In this paper, we consider algorithm-independent lower bounds for the problem of black-box optimization of functions having a bounded norm is some Reproducing Kernel Hilbert Space (RKHS), which can be viewed as a non-Bayesian Gaussian…

机器学习 · 统计学 2021-05-25 Xu Cai , Jonathan Scarlett

We study the piecewise stationary combinatorial semi-bandit problem with causally related rewards. In our nonstationary environment, variations in the base arms' distributions, causal relationships between rewards, or both, change the…

机器学习 · 计算机科学 2023-07-27 Behzad Nourani-Koliji , Steven Bilaj , Amir Rezaei Balef , Setareh Maghsudi

We address the problem of learning in an online setting where the learner repeatedly observes features, selects among a set of actions, and receives reward for the action taken. We provide the first efficient algorithm with an optimal…

机器学习 · 计算机科学 2011-06-17 Miroslav Dudik , Daniel Hsu , Satyen Kale , Nikos Karampatziakis , John Langford , Lev Reyzin , Tong Zhang

The contextual bandit problem, where agents arrive sequentially with personal contexts and the system adapts its arm allocation decisions accordingly, has recently garnered increasing attention for enabling more personalized outcomes.…

机器学习 · 计算机科学 2025-05-06 Yiting Hu , Lingjie Duan

In the kernelized bandit problem, a learner aims to sequentially compute the optimum of a function lying in a reproducing kernel Hilbert space given only noisy evaluations at sequentially chosen points. In particular, the learner aims to…

机器学习 · 计算机科学 2023-08-15 Justin Whitehouse , Zhiwei Steven Wu , Aaditya Ramdas

Multi-armed bandit (MAB) is a class of online learning problems where a learning agent aims to maximize its expected cumulative reward while repeatedly selecting to pull arms with unknown reward distributions. We consider a scenario where…

机器学习 · 统计学 2019-01-25 Yang Cao , Zheng Wen , Branislav Kveton , Yao Xie

Multi-armed bandit algorithms have become a reference solution for handling the explore/exploit dilemma in recommender systems, and many other important real-world problems, such as display advertisement. However, such algorithms usually…

机器学习 · 计算机科学 2018-05-25 Qingyun Wu , Naveen Iyer , Hongning Wang

In this paper, we propose and study opportunistic contextual bandits - a special case of contextual bandits where the exploration cost varies under different environmental conditions, such as network load or return variation in…

机器学习 · 计算机科学 2019-05-29 Xueying Guo , Xiaoxiao Wang , Xin Liu

The contextual bandit framework is widely used to solve sequential optimization problems where the reward of each decision depends on auxiliary context variables. In settings such as medicine, business, and engineering, the decision maker…

机器学习 · 统计学 2025-03-17 Kevin Li , Eric Laber

The problem of multi-armed bandits (MAB) asks to make sequential decisions while balancing between exploitation and exploration, and have been successfully applied to a wide range of practical scenarios. Various algorithms have been…

机器学习 · 计算机科学 2022-02-24 Xiaojin Zhang , Shuai Li , Weiwen Liu , Shengyu Zhang

In this paper, we address the stochastic contextual linear bandit problem, where a decision maker is provided a context (a random set of actions drawn from a distribution). The expected reward of each action is specified by the inner…

机器学习 · 统计学 2023-05-30 Osama A. Hanna , Lin F. Yang , Christina Fragouli

We study the problem of information sharing and cooperation in Multi-Player Multi-Armed bandits. We propose the first algorithm that achieves logarithmic regret for this problem when the collision reward is unknown. Our results are based on…

机器学习 · 计算机科学 2022-10-04 Aldo Pacchiano , Peter Bartlett , Michael I. Jordan

The matrix contextual bandit (CB), as an extension of the well-known multi-armed bandit, is a powerful framework that has been widely applied in sequential decision-making scenarios involving low-rank structure. In many real-world…

机器学习 · 计算机科学 2025-07-24 Yao Wang , Jiannan Li , Yue Kang , Shanxing Gao , Zhenxin Xiao

We present the first high-probability optimal regret bound for a policy optimization technique applied to the problem of stochastic contextual multi-armed bandit (CMAB) with general offline function approximation. Our algorithm is both…

机器学习 · 计算机科学 2026-02-17 Orin Levy , Yishay Mansour

In this paper, we consider the time-varying Bayesian optimization problem. The unknown function at each time is assumed to lie in an RKHS (reproducing kernel Hilbert space) with a bounded norm. We adopt the general variation budget model to…

机器学习 · 计算机科学 2021-05-04 Xingyu Zhou , Ness Shroff

In this work we investigate the relationship between kernel regularity and algorithmic performance in the bandit optimization of RKHS functions. While reproducing kernel Hilbert space (RKHS) methods traditionally rely on global kernel…

机器学习 · 统计学 2025-12-08 Madison Lee , Tara Javidi

Consider a requester who wishes to crowdsource a series of identical binary labeling tasks to a pool of workers so as to achieve an assured accuracy for each task, in a cost optimal way. The workers are heterogeneous with unknown but fixed…

计算机科学与博弈论 · 计算机科学 2015-06-18 Shweta Jain , Sujit Gujar , Satyanath Bhat , Onno Zoeter , Y. Narahari

In the classical multi-armed bandit problem, instance-dependent algorithms attain improved performance on "easy" problems with a gap between the best and second-best arm. Are similar guarantees possible for contextual bandits? While…

机器学习 · 计算机科学 2020-10-08 Dylan J. Foster , Alexander Rakhlin , David Simchi-Levi , Yunzong Xu

In this paper, we develop a kernel-based policy iteration functional learning framework for computing team-optimal strategies in traffic coordination problems. We consider a multi-agent discrete-time linear system with a cost function that…

系统与控制 · 电气工程与系统科学 2026-04-02 Weihao Sun , Gehui Xu , Alessio Moreschini , Thomas Parisini , Andreas A. Malikopoulos

We study distributed contextual linear bandits with stochastic contexts, where $N$ agents act cooperatively to solve a linear bandit-optimization problem with $d$-dimensional features over the course of $T$ rounds. For this problem, we…

机器学习 · 计算机科学 2022-12-09 Sanae Amani , Tor Lattimore , András György , Lin F. Yang