中文
相关论文

相关论文: Top-k Combinatorial Bandits with Full-Bandit Feedb…

200 篇论文

We study a decentralized cooperative stochastic multi-armed bandit problem with $K$ arms on a network of $N$ agents. In our model, the reward distribution of each arm is the same for each agent and rewards are drawn independently across…

机器学习 · 计算机科学 2019-10-25 David Martínez-Rubio , Varun Kanade , Patrick Rebeschini

We unify two prominent lines of work on multi-armed bandits: bandits with knapsacks (BwK) and combinatorial semi-bandits. The former concerns limited "resources" consumed by the algorithm, e.g., limited supply in dynamic pricing. The latter…

机器学习 · 计算机科学 2018-02-22 Karthik Abinav Sankararaman , Aleksandrs Slivkins

We consider the stochastic combinatorial semi-bandit problem with adversarial corruptions. We provide a simple combinatorial algorithm that can achieve a regret of $\tilde{O}\left(C+d^2K/\Delta_{min}\right)$ where $C$ is the total amount of…

机器学习 · 计算机科学 2021-06-15 Haike Xu , Jian Li

Combinatorial bandits extend the classical bandit framework to settings where the learner selects multiple arms in each round, motivated by applications such as online recommendation and assortment optimization. While extensions of upper…

机器学习 · 计算机科学 2025-10-29 Yuxiao Wen , Yanjun Han , Zhengyuan Zhou

We investigate the problem of stochastic, combinatorial multi-armed bandits where the learner only has access to bandit feedback and the reward function can be non-linear. We provide a general framework for adapting discrete offline…

机器学习 · 计算机科学 2023-10-13 Guanyu Nie , Yididiya Y Nadew , Yanhui Zhu , Vaneet Aggarwal , Christopher John Quinn

We study the combinatorial semi-bandit problem where an agent selects a subset of base arms and receives individual feedback. While this generalizes the classical multi-armed bandit and has broad applicability, its scalability is limited by…

机器学习 · 统计学 2025-10-27 Jung-hun Kim , Milan Vojnović , Min-hwan Oh

In this paper, we investigate a largely extended version of classical MAB problem, called networked combinatorial bandit problems. In particular, we consider the setting of a decision maker over a networked bandits as follows: each time a…

机器学习 · 计算机科学 2015-03-23 Shaojie Tang , Yaqin Zhou

Strategic behavior against sequential learning methods, such as "click framing" in real recommendation systems, have been widely observed. Motivated by such behavior we study the problem of combinatorial multi-armed bandits (CMAB) under…

机器学习 · 计算机科学 2021-11-22 Jing Dong , Ke Li , Shuai Li , Baoxiang Wang

Combinatorial online learning is a fundamental task for selecting the optimal action (or super arm) as a combination of base arms in sequential interactions with systems providing stochastic rewards. It is applicable to diverse domains such…

机器学习 · 计算机科学 2026-03-04 Seockbean Song , Youngsik Yoon , Siwei Wang , Wei Chen , Jungseul Ok

We consider a contextual combinatorial bandit problem where in each round a learning agent selects a subset of arms and receives feedback on the selected arms according to their scores. The score of an arm is an unknown function of the…

机器学习 · 统计学 2023-06-02 Taehyun Hwang , Kyuwook Chai , Min-hwan Oh

We propose and study the known-compensation multi-arm bandit (KCMAB) problem, where a system controller offers a set of arms to many short-term players for $T$ steps. In each step, one short-term player arrives to the system. Upon arrival,…

机器学习 · 计算机科学 2018-11-06 Siwei Wang , Longbo Huang

We study a decentralized cooperative multi-agent multi-armed bandit problem with $K$ arms and $N$ agents connected over a network. In our model, each arm's reward distribution is same for all agents, and rewards are drawn independently…

机器学习 · 统计学 2020-10-29 Anusha Lalitha , Andrea Goldsmith

We study the multi-armed bandit (MAB) problem with composite and anonymous feedback. In this model, the reward of pulling an arm spreads over a period of time (we call this period as reward interval) and the player receives partial rewards…

机器学习 · 计算机科学 2020-12-16 Siwei Wang , Haoyun Wang , Longbo Huang

Combinatorial Multi-Armed Bandit with fairness constraints is a framework where multiple arms form a super arm and can be pulled in each round under uncertainty to maximize cumulative rewards while ensuring the minimum average reward…

机器学习 · 计算机科学 2025-01-14 Xiaoyi Wu , Bo Ji , Bin Li

In federated multi-armed bandit problems, maximizing global reward while satisfying minimum privacy requirements to protect clients is the main goal. To formulate such problems, we consider a combinatorial contextual bandit setting with…

机器学习 · 计算机科学 2023-07-11 Sepehr Elahi , Baran Atalar , Sevda Öğüt , Cem Tekin

Recent works on Multi-Armed Bandits (MAB) and Combinatorial Multi-Armed Bandits (COM-MAB) show good results on a global accuracy metric. This can be achieved, in the case of recommender systems, with personalization. However, with a…

机器学习 · 计算机科学 2020-09-17 Alexandre Letard , Tassadit Amghar , Olivier Camp , Nicolas Gutowski

In combinatorial semi-bandits, a learner repeatedly selects from a combinatorial decision set of arms, receives the realized sum of rewards, and observes the rewards of the individual selected arms as feedback. In this paper, we extend this…

机器学习 · 计算机科学 2025-09-17 Yuxiao Wen

We consider the adversarial combinatorial multi-armed bandit (CMAB) problem, whose decision set can be exponentially large with respect to the number of given arms. To avoid dealing with such large decision sets directly, we propose an…

数据结构与算法 · 计算机科学 2017-07-27 Shinsaku Sakaue , Masakazu Ishihata , Shin-ichi Minato

We consider the Max $K$-Armed Bandit problem, where a learning agent is faced with several sources (arms) of items (rewards), and interested in finding the best item overall. At each time step the agent chooses an arm, and obtains a random…

机器学习 · 统计学 2015-08-25 Yahel David , Nahum Shimkin

The combinatorial multi-armed bandit model is designed to maximize cumulative rewards in the presence of uncertainty by activating a subset of arms in each round. This paper is inspired by two critical applications in wireless networks,…

机器学习 · 计算机科学 2025-09-17 Xiaoyi Wu , Bin Li