中文
相关论文

相关论文: Perturbed-History Exploration in Stochastic Multi-…

200 篇论文

The stochastic generalised linear bandit is a well-understood model for sequential decision-making problems, with many algorithms achieving near-optimal regret guarantees under immediate feedback. However, the stringent requirement for…

机器学习 · 计算机科学 2023-04-12 Benjamin Howson , Ciara Pike-Burke , Sarah Filippi

We propose algorithms based on a multi-level Thompson sampling scheme, for the stochastic multi-armed bandit and its contextual variant with linear expected rewards, in the setting where arms are clustered. We show, both theoretically and…

机器学习 · 计算机科学 2022-06-16 Emil Carlsson , Devdatt Dubhashi , Fredrik D. Johansson

A challenging aspect of the bandit problem is that a stochastic reward is observed only for the chosen arm and the rewards of other arms remain missing. The dependence of the arm choice on the past context and reward pairs compounds the…

机器学习 · 统计学 2023-05-02 Wonyoung Kim , Gi-soo Kim , Myunghee Cho Paik

We present a modified tuning of the algorithm of Zimmert and Seldin [2020] for adversarial multiarmed bandits with delayed feedback, which in addition to the minimax optimal adversarial regret guarantee shown by Zimmert and Seldin…

机器学习 · 计算机科学 2022-07-01 Saeed Masoudian , Julian Zimmert , Yevgeny Seldin

We study the Linear Contextual Bandit problem in the hybrid reward setting. In this setting every arm's reward model contains arm specific parameters in addition to parameters shared across the reward models of all the arms. We can reduce…

机器学习 · 计算机科学 2024-09-05 Nirjhar Das , Gaurav Sinha

A stochastic multi-user multi-armed bandit framework is used to develop algorithms for uncoordinated spectrum access. In contrast to prior work, it is assumed that rewards can be non-zero even under collisions, thus allowing for the number…

信息论 · 计算机科学 2021-01-13 Meghana Bande , Akshayaa Magesh , Venugopal V. Veeravalli

We consider the thresholding bandit problem, whose goal is to find arms of mean rewards above a given threshold $\theta$, with a fixed budget of $T$ trials. We introduce LSA, a new, simple and anytime algorithm that aims to minimize the…

机器学习 · 计算机科学 2019-05-28 Chao Tao , Saùl Blanco , Jian Peng , Yuan Zhou

Mode estimation is a classical problem in statistics with a wide range of applications in machine learning. Despite this, there is little understanding in its robustness properties under possibly adversarial data contamination. In this…

机器学习 · 计算机科学 2020-03-09 Aldo Pacchiano , Heinrich Jiang , Michael I. Jordan

We propose a novel algorithm for multi-player multi-armed bandits without collision sensing information. Our algorithm circumvents two problems shared by all state-of-the-art algorithms: it does not need as an input a lower bound on the…

机器学习 · 统计学 2022-06-07 Wei Huang , Richard Combes , Cindy Trinh

In this paper we consider stochastic multiarmed bandit problems. Recently a policy, DMED, is proposed and proved to achieve the asymptotic bound for the model that each reward distribution is supported in a known bounded interval, e.g.…

统计理论 · 数学 2012-02-20 Junya Honda , Akimichi Takemura

In this paper, we investigate a largely extended version of classical MAB problem, called networked combinatorial bandit problems. In particular, we consider the setting of a decision maker over a networked bandits as follows: each time a…

机器学习 · 计算机科学 2015-03-23 Shaojie Tang , Yaqin Zhou

This paper studies the one-shot behavior of no-regret algorithms for stochastic bandits. Although many algorithms are known to be asymptotically optimal with respect to the expected regret, over a single run, their pseudo-regret seems to…

机器学习 · 计算机科学 2023-12-01 Victor Boone

This paper investigates the problem of combinatorial multiarmed bandits with stochastic submodular (in expectation) rewards and full-bandit delayed feedback, where the delayed feedback is assumed to be composite and anonymous. In other…

机器学习 · 计算机科学 2025-01-23 Mohammad Pedramfar , Vaneet Aggarwal

We consider the combinatorial bandits problem, where at each time step, the online learner selects a size-$k$ subset $s$ from the arms set $\mathcal{A}$, where $\left|\mathcal{A}\right| = n$, and observes a stochastic reward of each arm in…

机器学习 · 计算机科学 2021-03-05 Shuo Yang , Tongzheng Ren , Inderjit S. Dhillon , Sujay Sanghavi

We study a novel variant of the parameterized bandits problem in which the learner can observe additional auxiliary feedback that is correlated with the observed reward. The auxiliary feedback is readily available in many real-life…

机器学习 · 计算机科学 2023-11-07 Arun Verma , Zhongxiang Dai , Yao Shu , Bryan Kian Hsiang Low

We present differentially private algorithms for the stochastic Multi-Armed Bandit (MAB) problem. This is a problem for applications such as adaptive clinical trials, experiment design, and user-targeted advertising where private…

机器学习 · 统计学 2015-11-30 Aristide Tossou , Christos Dimitrakakis

We initiate the study of tradeoffs between exploration and exploitation in online learning of properties of quantum states. Given sequential oracle access to an unknown quantum state, in each round, we are tasked to choose an observable…

量子物理 · 物理学 2022-06-29 Josep Lumbreras , Erkka Haapasalo , Marco Tomamichel

We consider the Multi-Armed Bandit (MAB) problem, where an agent sequentially chooses actions and observes rewards for the actions it took. While the majority of algorithms try to minimize the regret, i.e., the cumulative difference between…

机器学习 · 计算机科学 2021-09-14 Nadav Merlis , Shie Mannor

We consider the problem of minimizing the regret in stochastic multi-armed bandit, when the measure of goodness of an arm is not the mean return, but some general function of the mean and the variance.We characterize the conditions under…

机器学习 · 计算机科学 2014-05-06 Alexander Zimin , Rasmus Ibsen-Jensen , Krishnendu Chatterjee

We study stochastic linear bandits with heavy-tailed rewards, where the rewards have a finite $(1+\epsilon)$-absolute central moment bounded by $\upsilon$ for some $\epsilon \in (0,1]$. We improve both upper and lower bounds on the minimax…

机器学习 · 计算机科学 2026-01-28 Artin Tajdini , Jonathan Scarlett , Kevin Jamieson
‹ 上一页 1 8 9 10 下一页 ›