中文
相关论文

相关论文: Combinatorial Multi-Objective Multi-Armed Bandit P…

200 篇论文

Many real-world problems like Social Influence Maximization face the dilemma of choosing the best $K$ out of $N$ options at a given time instant. This setup can be modeled as a combinatorial bandit which chooses $K$ out of $N$ arms at each…

机器学习 · 计算机科学 2021-10-12 Mridul Agarwal , Vaneet Aggarwal , Christopher J. Quinn , Abhishek K. Umrawal

We present algorithms for reducing the Dueling Bandits problem to the conventional (stochastic) Multi-Armed Bandits problem. The Dueling Bandits problem is an online model of learning with ordinal feedback of the form "A is preferred to B"…

机器学习 · 计算机科学 2014-05-15 Nir Ailon , Thorsten Joachims , Zohar Karnin

We consider the combinatorial multi-armed bandit (CMAB) problem, where the reward function is nonlinear. In this setting, the agent chooses a batch of arms on each round and receives feedback from each arm of the batch. The reward that the…

机器学习 · 计算机科学 2020-06-09 Nadav Merlis , Shie Mannor

We investigate the use of a multi-agent multi-armed bandit (MA-MAB) setting for modeling repeated Cournot oligopoly games, where the firms acting as agents choose from the set of arms representing production quantity (a discrete value).…

计算机科学与博弈论 · 计算机科学 2022-01-05 Kshitija Taywade , Brent Harrison , Adib Bagh

We consider the stochastic linear (multi-armed) contextual bandit problem with the possibility of hidden simple multi-armed bandit structure in which the rewards are independent of the contextual information. Algorithms that are designed…

机器学习 · 统计学 2020-10-07 Niladri S. Chatterji , Vidya Muthukumar , Peter L. Bartlett

This paper is in the field of stochastic Multi-Armed Bandits (MABs), i.e. those sequential selection techniques able to learn online using only the feedback given by the chosen option (a.k.a. $arm$). We study a particular case of the rested…

机器学习 · 统计学 2024-11-28 Marco Fiandri , Alberto Maria Metelli , Francesco Trov`o

We study a structured multi-agent multi-armed bandit (MAMAB) problem in a dynamic environment. A graph reflects the information-sharing structure among agents, and the arms' reward distributions are piecewise-stationary with several unknown…

机器学习 · 计算机科学 2023-06-12 Xiaotong Cheng , Setareh Maghsudi

We study meta-learning for adversarial multi-armed bandits. We consider the online-within-online setup, in which a player (learner) encounters a sequence of multi-armed bandit episodes. The player's performance is measured as regret against…

机器学习 · 计算机科学 2022-07-13 Ilya Osadchiy , Kfir Y. Levy , Ron Meir

We consider a novel multi-armed bandit framework where the rewards obtained by pulling the arms are functions of a common latent random variable. The correlation between arms due to the common random source can be used to design a…

机器学习 · 统计学 2019-01-31 Samarth Gupta , Gauri Joshi , Osman Yağan

We consider combinatorial online learning with subset choices when only relative feedback information from subsets is available, instead of bandit or semi-bandit feedback which is absolute. Specifically, we study two regret minimisation…

机器学习 · 计算机科学 2020-02-28 Aadirupa Saha , Aditya Gopalan

We consider a rate-constrained contextual multi-armed bandit (RC-CMAB) problem, in which a group of agents are solving the same contextual multi-armed bandit (CMAB) problem. However, the contexts are observed by a remotely connected entity,…

机器学习 · 计算机科学 2022-04-28 Francesco Pase , Deniz Gündüz , Michele Zorzi

We investigate the problem of stochastic, combinatorial multi-armed bandits where the learner only has access to bandit feedback and the reward function can be non-linear. We provide a general framework for adapting discrete offline…

机器学习 · 计算机科学 2023-10-13 Guanyu Nie , Yididiya Y Nadew , Yanhui Zhu , Vaneet Aggarwal , Christopher John Quinn

This paper considers the problem of combinatorial multi-armed bandits with semi-bandit feedback and a cardinality constraint on the super-arm size. Existing algorithms for solving this problem typically involve two key sub-routines: (1) a…

机器学习 · 计算机科学 2025-08-14 Arpan Mukherjee , Shashanka Ubaru , Keerthiram Murugesan , Karthikeyan Shanmugam , Ali Tajer

In many platforms, user arrivals exhibit a self-reinforcing behavior: future user arrivals are likely to have preferences similar to users who were satisfied in the past. In other words, arrivals exhibit positive externalities. We study…

机器学习 · 计算机科学 2019-03-08 Virag Shah , Jose Blanchet , Ramesh Johari

In this paper, we consider the stochastic multi-armed bandits problem with adversarial corruptions, where the random rewards of the arms are partially modified by an adversary to fool the algorithm. We apply the policy gradient algorithm…

机器学习 · 计算机科学 2025-02-21 Jiayuan Liu , Siwei Wang , Zhixuan Fang

The multi-armed bandit (MAB) is a classical online optimization model for the trade-off between exploration and exploitation. The traditional MAB is concerned with finding the arm that minimizes the mean cost. However, minimizing the mean…

最优化与控制 · 数学 2018-09-17 Jianyu Xu , William B. Haskell , Zhisheng Ye

We study the multi-armed bandit (MAB) problem where the agent receives a vectorial feedback that encodes many possibly competing objectives to be optimized. The goal of the agent is to find a policy, which can optimize these objectives…

机器学习 · 计算机科学 2017-06-16 Robert Busa-Fekete , Balazs Szorenyi , Paul Weng , Shie Mannor

Multi-arm bandit (MAB) and stochastic linear bandit (SLB) are important models in reinforcement learning, and it is well-known that classical algorithms for bandits with time horizon $T$ suffer $\Omega(\sqrt{T})$ regret. In this paper, we…

机器学习 · 计算机科学 2022-05-31 Zongqi Wan , Zhijie Zhang , Tongyang Li , Jialin Zhang , Xiaoming Sun

Recently, there has been extensive study of cooperative multi-agent multi-armed bandits where a set of distributed agents cooperatively play the same multi-armed bandit game. The goal is to develop bandit algorithms with the optimal group…

机器学习 · 计算机科学 2023-08-09 Lin Yang , Xuchuang Wang , Mohammad Hajiesmaili , Lijun Zhang , John C. S. Lui , Don Towsley

We study the problem of selecting $K$ arms with the highest expected rewards in a stochastic $n$-armed bandit game. This problem has a wide range of applications, e.g., A/B testing, crowdsourcing, simulation optimization. Our goal is to…

机器学习 · 计算机科学 2017-06-06 Jiecao Chen , Xi Chen , Qin Zhang , Yuan Zhou