中文
相关论文

相关论文: Combinatorial Multi-Armed Bandits with Filtered Fe…

200 篇论文

We study a multi-armed bandit problem in a dynamic environment where arm rewards evolve in a correlated fashion according to a Markov chain. Different than much of the work on related problems, in our formulation a learning algorithm does…

机器学习 · 计算机科学 2019-03-05 Tanner Fiez , Shreyas Sekar , Lillian J. Ratliff

The contextual combinatorial semi-bandit problem with linear payoff functions is a decision-making problem in which a learner chooses a set of arms with the feature vectors in each round under given constraints so as to maximize the sum of…

This paper considers the contextual multi-armed bandit (CMAB) problem with fairness and privacy guarantees in a federated environment. We consider merit-based exposure as the desired fair outcome, which provides exposure to each action in…

机器学习 · 计算机科学 2024-02-07 Sambhav Solanki , Shweta Jain , Sujit Gujar

We introduce in this paper a new algorithm for Multi-Armed Bandit (MAB) problems. A machine learning paradigm popular within Cognitive Network related topics (e.g., Spectrum Sensing and Allocation). We focus on the case where the rewards…

机器学习 · 统计学 2012-04-10 Wassim Jouini , Christophe Moy

We propose a generalization of the best arm identification problem in stochastic multi-armed bandits (MAB) to the setting where every pull of an arm is associated with delayed feedback. The delay in feedback increases the effective sample…

We consider the query recommendation problem in closed loop interactive learning settings like online information gathering and exploratory analytics. The problem can be naturally modelled using the Multi-Armed Bandits (MAB) framework with…

In combinatorial semi-bandits, a learner repeatedly selects from a combinatorial decision set of arms, receives the realized sum of rewards, and observes the rewards of the individual selected arms as feedback. In this paper, we extend this…

机器学习 · 计算机科学 2025-09-17 Yuxiao Wen

This paper is in the field of stochastic Multi-Armed Bandits (MABs), i.e. those sequential selection techniques able to learn online using only the feedback given by the chosen option (a.k.a. $arm$). We study a particular case of the rested…

机器学习 · 统计学 2024-11-28 Marco Fiandri , Alberto Maria Metelli , Francesco Trov`o

The multi-armed bandits (MAB) framework is a widely used approach for sequential decision-making, where a decision-maker selects an arm in each round with the goal of maximizing long-term rewards. In many practical applications, such as…

机器学习 · 统计学 2026-05-21 Sakshi Arya , Hyebin Song

We study the combinatorial semi-bandit problem where an agent selects a subset of base arms and receives individual feedback. While this generalizes the classical multi-armed bandit and has broad applicability, its scalability is limited by…

机器学习 · 统计学 2025-10-27 Jung-hun Kim , Milan Vojnović , Min-hwan Oh

We consider the Max $K$-Armed Bandit problem, where a learning agent is faced with several sources (arms) of items (rewards), and interested in finding the best item overall. At each time step the agent chooses an arm, and obtains a random…

机器学习 · 统计学 2015-08-25 Yahel David , Nahum Shimkin

Traditional multi-armed bandit (MAB) formulations usually make certain assumptions about the underlying arms' distributions, such as bounds on the support or their tail behaviour. Moreover, such parametric information is usually 'baked'…

机器学习 · 计算机科学 2022-03-29 Anmol Kagrecha , Jayakrishnan Nair , Krishna Jagannathan

This paper investigates the fusion of absolute (reward) and relative (dueling) feedback in stochastic bandits, where both feedback types are gathered in each decision round. We derive a regret lower bound, demonstrating that an efficient…

机器学习 · 计算机科学 2025-04-23 Xuchuang Wang , Qirun Zeng , Jinhang Zuo , Xutong Liu , Mohammad Hajiesmaili , John C. S. Lui , Adam Wierman

Multi-armed bandit algorithms provide solutions for sequential decision-making where learning takes place by interacting with the environment. In this work, we model a distributed optimization problem as a multi-agent kernelized multi-armed…

机器学习 · 计算机科学 2023-12-11 Ayush Rai , Shaoshuai Mou

Multi-armed bandit problems are considered as a paradigm of the trade-off between exploring the environment to find profitable actions and exploiting what is already known. In the stationary case, the distributions of the rewards do not…

统计理论 · 数学 2008-12-18 Aurélien Garivier , Eric Moulines

We study a novel variant of the multi-armed bandit problem, where at each time step, the player observes an independently sampled context that determines the arms' mean rewards. However, playing an arm blocks it (across all contexts) for a…

机器学习 · 计算机科学 2020-06-18 Soumya Basu , Orestis Papadigenopoulos , Constantine Caramanis , Sanjay Shakkottai

We study \emph{multi-armed bandits} (MABs) augmented with \emph{best-action queries}, in which the learner may additionally query an oracle that reveals the best arm in the current round. This setting was recently characterized by Russo et…

机器学习 · 计算机科学 2026-05-12 Francesco Bacchiocchi , Matteo Castiglioni , Alberto Marchesi , Francesco Emanuele Stradi

In many web applications, a recommendation is not a single item suggested to a user but a list of possibly interesting contents that may be ranked in some contexts. The combinatorial bandit problem has been studied quite extensively these…

数据结构与算法 · 计算机科学 2016-05-27 Hossein Vahabi , Paul Lagrée , Claire Vernade , Olivier Cappé

A core element in decision-making under uncertainty is the feedback on the quality of the performed actions. However, in many applications, such feedback is restricted. For example, in recommendation systems, repeatedly asking the user to…

机器学习 · 计算机科学 2021-07-13 Yonathan Efroni , Nadav Merlis , Aadirupa Saha , Shie Mannor

This paper introduces the informational multi-armed bandit (IMAB) model in which at each round, a player chooses an arm, observes a symbol, and receives an unobserved reward in the form of the symbol's self-information. Thus, the expected…

信息论 · 计算机科学 2022-09-07 Nir Weinberger , Michal Yemini