中文
相关论文

相关论文: Stochastic Bandits with Delayed Composite Anonymou…

200 篇论文

We present differentially private algorithms for the stochastic Multi-Armed Bandit (MAB) problem. This is a problem for applications such as adaptive clinical trials, experiment design, and user-targeted advertising where private…

机器学习 · 统计学 2015-11-30 Aristide Tossou , Christos Dimitrakakis

We study a new stochastic multi-player multi-armed bandits (MP-MAB) problem, where the reward distribution changes if a collision occurs on the arm. Existing literature always assumes a zero reward for involved players if collision happens,…

信息论 · 计算机科学 2021-09-01 Chengshuai Shi , Cong Shen

For a wireless avionics communication system, a Multi-arm bandit game is mathematically formulated, which includes channel states, strategies, and rewards. The simple case includes only two agents sharing the spectrum which is fully studied…

信号处理 · 电气工程与系统科学 2017-11-15 Jingyang Lu , Lun Li , Dan Shen , Genshe Chen , Bin Jia , Erik Blasch , Khanh Pham

The stochastic generalised linear bandit is a well-understood model for sequential decision-making problems, with many algorithms achieving near-optimal regret guarantees under immediate feedback. However, the stringent requirement for…

机器学习 · 计算机科学 2023-04-12 Benjamin Howson , Ciara Pike-Burke , Sarah Filippi

We study the non-stationary stochastic multiarmed bandit (MAB) problem and propose two generic algorithms, namely, the limited memory deterministic sequencing of exploration and exploitation (LM-DSEE) and the Sliding-Window Upper Confidence…

机器学习 · 统计学 2018-04-25 Lai Wei , Vaibhav Srivastava

We study finite-armed stochastic bandits where the rewards of each arm might be correlated to those of other arms. We introduce a novel phased algorithm that exploits the given structure to build confidence sets over the parameters of the…

机器学习 · 计算机科学 2020-05-26 Andrea Tirinzoni , Alessandro Lazaric , Marcello Restelli

We study the corrupted bandit problem, i.e. a stochastic multi-armed bandit problem with $k$ unknown reward distributions, which are heavy-tailed and corrupted by a history-independent adversary or Nature. To be specific, the reward…

机器学习 · 计算机科学 2023-03-22 Debabrota Basu , Odalric-Ambrym Maillard , Timothée Mathieu

This paper presents a new algorithm for neural contextual bandits (CBs) that addresses the challenge of delayed reward feedback, where the reward for a chosen action is revealed after a random, unknown delay. This scenario is common in…

机器学习 · 计算机科学 2025-04-17 Mohammadali Moghimi , Sharu Theresa Jose , Shana Moothedath

The combinatorial stochastic semi-bandit problem is an extension of the classical multi-armed bandit problem in which an algorithm pulls more than one arm at each stage and the rewards of all pulled arms are revealed. One difference with…

机器学习 · 计算机科学 2016-12-07 Rémy Degenne , Vianney Perchet

Decision-making problems of sequential nature, where decisions made in the past may have an impact on the future, are used to model many practically important applications. In some real-world applications, feedback about a decision is…

机器学习 · 计算机科学 2023-03-02 Ronald C. van den Broek , Rik Litjens , Tobias Sagis , Luc Siecker , Nina Verbeeke , Pratik Gajane

A multi-user multi-armed bandit (MAB) framework is used to develop algorithms for uncoordinated spectrum access. The number of users is assumed to be unknown to each user. A stochastic setting is first considered, where the rewards on a…

机器学习 · 计算机科学 2019-01-31 Meghana Bande , Venugopal V. Veeravalli

In this paper, we study the stochastic multi-armed bandit problem with graph feedback. Motivated by applications in clinical trials and recommendation systems, we assume that two arms are connected if and only if they are similar (i.e.,…

机器学习 · 计算机科学 2025-09-18 Han Qi , Fei Guo , Li Zhu , Qiaosheng Zhang

We consider a sequential decision-making problem where an agent can take one action at a time and each action has a stochastic temporal extent, i.e., a new action cannot be taken until the previous one is finished. Upon completion, the…

机器学习 · 计算机科学 2020-03-26 P Sharoff , Nishant A. Mehta , Ravi Ganti

In this paper, we study multi-armed bandits (MAB) and stochastic linear bandits (SLB) with heavy-tailed rewards and quantum reward oracle. Unlike the previous work on quantum bandits that assumes bounded/sub-Gaussian distributions for…

机器学习 · 计算机科学 2023-01-25 Yulian Wu , Chaowen Guan , Vaneet Aggarwal , Di Wang

We consider a multi-armed bandit problem in a setting where each arm produces a noisy reward realization which depends on an observable random covariate. As opposed to the traditional static multi-armed bandit problem, this setting allows…

统计理论 · 数学 2013-05-27 Vianney Perchet , Philippe Rigollet

We investigate a nonstochastic bandit setting in which the loss of an action is not immediately charged to the player, but rather spread over the subsequent rounds in an adversarial way. The instantaneous loss observed by the player at the…

机器学习 · 计算机科学 2022-09-27 Nicolò Cesa-Bianchi , Tommaso Cesari , Roberto Colomboni , Claudio Gentile , Yishay Mansour

The stochastic multi-armed bandit (MAB) problem is one of the most fundamental models in sequential decision-making, with the core challenge being the trade-off between exploration and exploitation. Although algorithms such as Upper…

机器学习 · 计算机科学 2025-10-13 Di Zhang

The batched multi-armed bandit (MAB) problem, in which rewards are collected in batches, is crucial for applications such as clinical trials. Existing research predominantly assumes light-tailed reward distributions, yet many real-world…

机器学习 · 计算机科学 2026-03-24 Yunwen Guo , Yunlun Shu , Gongyi Zhuo , Tianyu Wang

Multi-arm bandit (MAB) and stochastic linear bandit (SLB) are important models in reinforcement learning, and it is well-known that classical algorithms for bandits with time horizon $T$ suffer $\Omega(\sqrt{T})$ regret. In this paper, we…

机器学习 · 计算机科学 2022-05-31 Zongqi Wan , Zhijie Zhang , Tongyang Li , Jialin Zhang , Xiaoming Sun

In this paper, we investigate a variant of the classical stochastic Multi-armed Bandit (MAB) problem, where the payoff received by an agent (either cost or reward) is both delayed, and directly corresponds to the magnitude of the delay.…

机器学习 · 计算机科学 2024-10-16 Ofir Schlisselberg , Ido Cohen , Tal Lancewicki , Yishay Mansour