中文
相关论文

相关论文: Deterministic Sequencing of Exploration and Exploi…

200 篇论文

We consider a stochastic multi-armed bandit setting and study the problem of constrained regret minimization over a given time horizon. Each arm is associated with an unknown, possibly multi-dimensional distribution, and the merit of an arm…

机器学习 · 计算机科学 2023-01-05 Anmol Kagrecha , Jayakrishnan Nair , Krishna Jagannathan

The multi-armed bandit problem is a popular model for studying exploration/exploitation trade-off in sequential decision problems. Many algorithms are now available for this well-studied problem. One of the earliest algorithms, given by W.…

机器学习 · 计算机科学 2012-04-10 Shipra Agrawal , Navin Goyal

The stochastic multi-arm bandit problem has been extensively studied under standard assumptions on the arm's distribution (e.g bounded with known support, exponential family, etc). These assumptions are suitable for many real-world problems…

机器学习 · 统计学 2021-11-19 Dorian Baudry , Patrick Saux , Odalric-Ambrym Maillard

This paper addresses the problem of unknown delays in adversarial multi-armed bandit (MAB) with multiple play. Existing work on similar game setting focused on only the case where the learner selects an arm in each round. However, there are…

机器学习 · 计算机科学 2020-10-02 Olusola T. Odeyomi

Standard Multi-Armed Bandit (MAB) problems assume that the arms are independent. However, in many application scenarios, the information obtained by playing an arm provides information about the remainder of the arms. Hence, in such…

机器学习 · 计算机科学 2014-10-30 Onur Atan , Cem Tekin , Mihaela van der Schaar

The stochastic multi-armed bandit problem is a well-known model for studying the exploration-exploitation trade-off. It has significant possible applications in adaptive clinical trials, which allow for dynamic changes in the treatment…

机器学习 · 计算机科学 2019-06-11 Hossein Aboutalebi , Doina Precup , Tibor Schuster

We consider the Scale-Free Adversarial Multi Armed Bandits(MAB) problem. At the beginning of the game, the player only knows the number of arms $n$. It does not know the scale and magnitude of the losses chosen by the adversary or the…

机器学习 · 计算机科学 2021-10-12 Sudeep Raja Putta , Shipra Agrawal

We consider a bandit problem where the buget is smaller than the number of arms, which may be infinite. In this regime, the usual objective in the literature is to minimize simple regret. To analyze broad classes of distributions with…

统计理论 · 数学 2025-11-04 Emmanuel Pilliat

We study a distributed decision-making problem in which multiple agents face the same multi-armed bandit (MAB), and each agent makes sequential choices among arms to maximize its own individual reward. The agents cooperate by sharing their…

最优化与控制 · 数学 2020-08-13 Peter Landgren , Vaibhav Srivastava , Naomi Ehrich Leonard

The classical multi-armed bandit (MAB) problem involves a learner and a collection of K independent arms, each with its own ex ante unknown independent reward distribution. At each one of a finite number of rounds, the learner selects one…

最优化与控制 · 数学 2024-05-07 Hongda Hu , Arthur Charpentier , Mario Ghossoub , Alexander Schied

We study the stochastic linear bandit problem with multiple arms over $T$ rounds, where the covariate dimension $d$ may exceed $T$, but each arm-specific parameter vector is $s$-sparse. We begin by analyzing the sequential estimation…

统计理论 · 数学 2025-05-26 Jingyu Liu , Yanglei Song

We consider a stochastic bandit problem with a possibly infinite number of arms. We write $p^*$ for the proportion of optimal arms and $\Delta$ for the minimal mean-gap between optimal and sub-optimal arms. We characterize the optimal…

机器学习 · 计算机科学 2021-11-08 Rianne de Heide , James Cheshire , Pierre Ménard , Alexandra Carpentier

In this paper we consider the problem of learning the optimal policy for uncontrolled restless bandit problems. In an uncontrolled restless bandit problem, there is a finite set of arms, each of which when pulled yields a positive reward.…

最优化与控制 · 数学 2015-01-30 Cem Tekin , Mingyan Liu

The multi-armed bandit (MAB) problems are widely studied in fields of operations research, stochastic optimization, and reinforcement learning. In this paper, we consider the classical MAB model with heavy-tailed reward distributions and…

机器学习 · 计算机科学 2025-09-16 Keqin Liu , Tianshuo Zheng , Zhi-Hua Zhou

We study the problem of minimising regret in two-armed bandit problems with Gaussian rewards. Our objective is to use this simple setting to illustrate that strategies based on an exploration phase (up to a stopping time) followed by…

统计理论 · 数学 2016-11-15 Aurélien Garivier , Emilie Kaufmann , Tor Lattimore

There is a rising interest in industrial online applications where data becomes available sequentially. Inspired by the recommendation of playlists to users where their preferences can be collected during the listening of the entire…

机器学习 · 计算机科学 2022-06-02 Giulia Romano , Andrea Agostini , Francesco Trovò , Nicola Gatti , Marcello Restelli

We consider the classical multi-armed bandit problem, but with strategic arms. In this context, each arm is characterized by a bounded support reward distribution and strategically aims to maximize its own utility by potentially retaining a…

机器学习 · 计算机科学 2025-01-28 Ahmed Ben Yahmed , Clément Calauzènes , Vianney Perchet

This paper is in the field of stochastic Multi-Armed Bandits (MABs), i.e., those sequential selection techniques able to learn online using only the feedback given by the chosen option (a.k.a. arm). We study a particular case of the rested…

机器学习 · 计算机科学 2022-12-08 Alberto Maria Metelli , Francesco Trovò , Matteo Pirola , Marcello Restelli

In this paper, we study multi-armed bandits (MAB) and stochastic linear bandits (SLB) with heavy-tailed rewards and quantum reward oracle. Unlike the previous work on quantum bandits that assumes bounded/sub-Gaussian distributions for…

机器学习 · 计算机科学 2023-01-25 Yulian Wu , Chaowen Guan , Vaneet Aggarwal , Di Wang

Multi-armed bandit problems are the most basic examples of sequential decision problems with an exploration-exploitation trade-off. This is the balance between staying with the option that gave highest payoffs in the past and exploring new…

机器学习 · 计算机科学 2012-11-06 Sébastien Bubeck , Nicolò Cesa-Bianchi