中文
相关论文

相关论文: Bandits with Delayed, Aggregated Anonymous Feedbac…

200 篇论文

We study small-loss bounds for adversarial multi-armed bandits with graph feedback, that is, adaptive regret bounds that depend on the loss of the best arm or related quantities, instead of the total number of rounds. We derive the first…

机器学习 · 计算机科学 2020-06-24 Chung-Wei Lee , Haipeng Luo , Mengxiao Zhang

This paper studies distributed online bandit learning of generalized Nash equilibria for online game, where cost functions of all players and coupled constraints are time-varying. The values rather than full information of cost and local…

最优化与控制 · 数学 2022-04-21 Min Meng , Xiuxian Li , Jie Chen

We consider stochastic bandit problems with $K$ arms, each associated with a bounded distribution supported on the range $[m,M]$. We do not assume that the range $[m,M]$ is known and show that there is a cost for learning this range.…

统计理论 · 数学 2022-06-16 Hédi Hadiji , Gilles Stoltz

We consider the restless multi-armed bandit (RMAB) problem with unknown dynamics in which a player chooses M out of N arms to play at each time. The reward state of each arm transits according to an unknown Markovian rule when it is played…

最优化与控制 · 数学 2011-12-30 Haoyang Liu , Keqin Liu , Qing Zhao

We consider a situation where an agent has $T$ ressources to be allocated to a larger number $N$ of actions. Each action can be completed at most once and results in a stochastic reward with unknown mean. The goal of the agent is to…

统计理论 · 数学 2020-11-04 Solenne Gaucher

In this work, we study sequential choice bandits with feedback. We propose bandit algorithms for a platform that personalizes users' experience to maximize its rewards. For each action directed to a given user, the platform is given a…

机器学习 · 统计学 2021-01-06 Anshuka Rangi , Massimo Franceschetti , Long Tran-Thanh

The multi-armed bandit is a concise model for the problem of iterated decision-making under uncertainty. In each round, a gambler must pull one of $K$ arms of a slot machine, without any foreknowledge of their payouts, except that they are…

数据结构与算法 · 计算机科学 2007-05-23 Varsha Dani , Thomas P. Hayes

Stochastic delays in feedback lead to unstable sequential learning using multi-armed bandits. Recently, empirical Bayesian shrinkage has been shown to improve reward estimation in bandit learning. Here, we propose a novel adaptation to…

机器学习 · 计算机科学 2021-06-23 Srivas Chennu , Jamie Martin , Puli Liyanagama , Phil Mohr

We consider a stochastic bandit problem with infinitely many arms. In this setting, the learner has no chance of trying all the arms even once and has to dedicate its limited number of samples only to a certain number of arms. All previous…

机器学习 · 计算机科学 2015-05-19 Alexandra Carpentier , Michal Valko

We study a decentralized multi-agent multi-armed bandit problem in which multiple clients are connected by time dependent random graphs provided by an environment. The reward distributions of each arm vary across clients and rewards are…

机器学习 · 计算机科学 2023-10-19 Mengfan Xu , Diego Klabjan

We consider the problem of stochastic $K$-armed dueling bandit in the contextual setting, where at each round the learner is presented with a context set of $K$ items, each represented by a $d$-dimensional feature vector, and the goal of…

机器学习 · 计算机科学 2021-05-11 Aadirupa Saha , Aditya Gopalan

We investigate a natural but surprisingly unstudied approach to the multi-armed bandit problem under safety risk constraints. Each arm is associated with an unknown law on safety risks and rewards, and the learner's goal is to maximise…

机器学习 · 计算机科学 2022-04-05 Tianrui Chen , Aditya Gangrade , Venkatesh Saligrama

There are many algorithms for regret minimisation in episodic reinforcement learning. This problem is well-understood from a theoretical perspective, providing that the sequences of states, actions and rewards associated with each episode…

机器学习 · 计算机科学 2023-04-07 Benjamin Howson , Ciara Pike-Burke , Sarah Filippi

We study a new stochastic multi-player multi-armed bandits (MP-MAB) problem, where the reward distribution changes if a collision occurs on the arm. Existing literature always assumes a zero reward for involved players if collision happens,…

信息论 · 计算机科学 2021-09-01 Chengshuai Shi , Cong Shen

We consider the combinatorial bandits problem with semi-bandit feedback under finite sampling budget constraints, in which the learner can carry out its action only for a limited number of times specified by an overall budget. The action is…

机器学习 · 计算机科学 2022-10-17 Jasmin Brandt , Viktor Bengs , Björn Haddenhorst , Eyke Hüllermeier

We investigate the stochastic Thresholding Bandit problem (TBP) under several shape constraints. On top of (i) the vanilla, unstructured TBP, we consider the case where (ii) the sequence of arm's means $(\mu_k)_k$ is monotonically…

机器学习 · 计算机科学 2021-02-24 James Cheshire , Pierre Menard , Alexandra Carpentier

We consider decentralized restless multi-armed bandit problems with unknown dynamics and multiple players. The reward state of each arm transits according to an unknown Markovian rule when it is played and evolves according to an arbitrary…

最优化与控制 · 数学 2011-02-16 Haoyang Liu , Keqin Liu , Qing Zhao

We consider an N-player multi-armed bandit game where each player chooses one out of M arms for T turns. Each player has different expected rewards for the arms, and the instantaneous rewards are independent and identically distributed or…

计算机科学与博弈论 · 计算机科学 2021-04-06 Ilai Bistritz , Amir Leshem

We consider the problem of online fair division of indivisible goods to players when there are a finite number of types of goods and player values are drawn from distributions with unknown means. Our goal is to maximize social welfare…

计算机科学与博弈论 · 计算机科学 2024-12-10 Ariel D. Procaccia , Benjamin Schiffer , Shirley Zhang

In several applications of the stochastic multi-armed bandit problem, the traditional objective of maximizing the expected total reward can be inappropriate. In this paper, motivated by certain operational concerns in online platforms, we…

机器学习 · 计算机科学 2024-10-16 Eren Ozbay , Vijay Kamble