中文
相关论文

相关论文: Safe Linear Leveling Bandits

200 篇论文

In many real-world applications such as recommendation systems, multiple learning agents must balance exploration and exploitation while maintaining safety guarantees to avoid catastrophic failures. We study the stochastic linear bandit…

机器学习 · 计算机科学 2026-02-16 Amirhossein Afsharrad , Ahmadreza Moradipari , Sanjay Lall

Understanding which parts of the retrieved context contribute to a large language model's generated answer is essential for building interpretable and trustworthy retrieval-augmented generation. We propose a novel framework that formulates…

人工智能 · 计算机科学 2026-04-23 Deng Pan , Keerthiram Murugesan , Ting Hua , Nuno Moniz , Nitesh Chawla

The multi-armed bandit problem is a popular model for studying exploration/exploitation trade-off in sequential decision problems. Many algorithms are now available for this well-studied problem. One of the earliest algorithms, given by W.…

机器学习 · 计算机科学 2012-04-10 Shipra Agrawal , Navin Goyal

Stochastic linear bandits are a natural and simple generalisation of finite-armed bandits with numerous practical applications. Current approaches focus on generalising existing techniques for finite-armed bandits, notably the optimism…

机器学习 · 统计学 2016-10-17 Tor Lattimore , Csaba Szepesvari

We study the multi-agent multi-armed bandit (MAMAB) problem, where $m$ agents are factored into $\rho$ overlapping groups. Each group represents a hyperedge, forming a hypergraph over the agents. At each round of interaction, the learner…

机器学习 · 计算机科学 2023-12-27 Tianyuan Jin , Hao-Lun Hsu , William Chang , Pan Xu

Contextual bandits are a form of multi-armed bandit in which the agent has access to predictive side information (known as the context) for each arm at each time step, and have been used to model personalized news recommendation, ad…

机器学习 · 统计学 2017-05-25 Aniket Anand Deshmukh , Urun Dogan , Clayton Scott

Motivated by applications such as online labor markets we consider a variant of the stochastic multi-armed bandit problem where we have a collection of arms representing strategic agents with different performance characteristics. The…

计算机科学与博弈论 · 计算机科学 2025-03-11 Seyed A. Esmaeili , Suho Shin , Aleksandrs Slivkins

We study the Improving Multi-Armed Bandit (IMAB) problem, where the reward obtained from an arm increases with the number of pulls it receives. This model provides an elegant abstraction for many real-world problems in domains such as…

机器学习 · 计算机科学 2022-08-22 Vishakha Patil , Vineet Nair , Ganesh Ghalme , Arindam Khan

In a multi-armed bandit problem, an online algorithm chooses from a set of strategies in a sequence of trials so as to maximize the total payoff of the chosen strategies. While the performance of bandit algorithms with a small finite…

数据结构与算法 · 计算机科学 2008-09-30 Robert Kleinberg , Aleksandrs Slivkins , Eli Upfal

The Multi-armed bandit offer the advantage to learn and exploit the already learnt knowledge at the same time. This capability allows this approach to be applied in different domains, going from clinical trials where the goal is…

机器学习 · 计算机科学 2021-01-05 Djallel Bouneffouf

The safe linear bandit problem (SLB) is an online approach to linear programming with unknown objective and unknown roundwise constraints, under stochastic bandit feedback of rewards and safety risks of actions. We study the tradeoffs…

机器学习 · 计算机科学 2024-07-02 Aditya Gangrade , Tianrui Chen , Venkatesh Saligrama

Recently multi-armed bandit problem arises in many real-life scenarios where arms must be sampled in batches, due to limited time the agent can wait for the feedback. Such applications include biological experimentation and online…

机器学习 · 统计学 2023-12-22 Shengyu Cao , Simai He , Ruoqing Jiang , Jin Xu , Hongsong Yuan

The Multi-Armed Bandits (MAB) framework highlights the tension between acquiring new knowledge (Exploration) and leveraging available knowledge (Exploitation). In the classical MAB problem, a decision maker must choose an arm at each time…

机器学习 · 统计学 2017-11-03 Nir Levine , Koby Crammer , Shie Mannor

We study the problem of online multi-task learning where the tasks are performed within similar but not necessarily identical multi-armed bandit environments. In particular, we study how a learner can improve its overall performance across…

机器学习 · 计算机科学 2022-06-20 Zhi Wang , Chicheng Zhang , Kamalika Chaudhuri

We consider a stochastic multi-armed bandit setting where reward must be actively queried for it to be observed. We provide tight lower and upper problem-dependent guarantees on both the regret and the number of queries. Interestingly, we…

机器学习 · 计算机科学 2022-10-28 Nadav Merlis , Yonathan Efroni , Shie Mannor

We consider the classical multi-armed bandit problem, but with strategic arms. In this context, each arm is characterized by a bounded support reward distribution and strategically aims to maximize its own utility by potentially retaining a…

机器学习 · 计算机科学 2025-01-28 Ahmed Ben Yahmed , Clément Calauzènes , Vianney Perchet

In this paper, we investigate a new multi-armed bandit (MAB) online learning model that considers real-world phenomena in many recommender systems: (i) the learning agent cannot pull the arms by itself and thus has to offer rewards to users…

机器学习 · 计算机科学 2021-06-01 Tianchen Zhou , Jia Liu , Chaosheng Dong , Jingyuan Deng

Early-phase clinical trials face the challenge of selecting optimal drug doses that balance safety and efficacy due to uncertain dose-response relationships and varied participant characteristics. Traditional randomized dose allocation…

统计方法学 · 统计学 2026-02-13 Rohit Kanrar , Chunlin Li , Zara Ghodsi , Margaret Gamalo

In recent years, multi-armed bandit (MAB) framework has attracted a lot of attention in various applications, from recommender systems and information retrieval to healthcare and finance, due to its stellar performance combined with certain…

机器学习 · 计算机科学 2019-04-24 Djallel Bouneffouf , Irina Rish

A latent bandit problem is one in which the learning agent knows the arm reward distributions conditioned on an unknown discrete latent state. The primary goal of the agent is to identify the latent state, after which it can act optimally.…

机器学习 · 计算机科学 2020-06-17 Joey Hong , Branislav Kveton , Manzil Zaheer , Yinlam Chow , Amr Ahmed , Craig Boutilier