中文
相关论文

相关论文: Local Clustering in Contextual Multi-Armed Bandits

200 篇论文

Contextual bandit algorithms are at the core of many applications, including recommender systems, clinical trials, and optimal portfolio selection. One of the most popular problems studied in the contextual bandit literature is to maximize…

机器学习 · 计算机科学 2023-10-24 Siddhant Chaudhary , Abhishek Sinha

We present substantial evidence demonstrating the benefits of integrating Large Language Models (LLMs) with a Contextual Multi-Armed Bandit framework. Contextual bandits have been widely used in recommendation systems to generate…

机器学习 · 计算机科学 2024-10-30 Parand A. Alamdari , Yanshuai Cao , Kevin H. Wilson

The deployment of Multi-Armed Bandits (MAB) has become commonplace in many economic applications. However, regret guarantees for even state-of-the-art linear bandit algorithms (such as Optimism in the Face of Uncertainty Linear bandit…

计量经济学 · 经济学 2023-02-28 Jingwen Zhang , Yifang Chen , Amandeep Singh

The classical multi-armed bandit (MAB) problem involves a learner and a collection of K independent arms, each with its own ex ante unknown independent reward distribution. At each one of a finite number of rounds, the learner selects one…

最优化与控制 · 数学 2024-05-07 Hongda Hu , Arthur Charpentier , Mario Ghossoub , Alexander Schied

Multi-armed Bandits (MABs) are increasingly employed in online platforms and e-commerce to optimize decision making for personalized user experiences. In this work, we focus on the Contextual Bandit problem with linear rewards, under…

机器学习 · 计算机科学 2024-09-17 Rowan Swiers , Subash Prabanantham , Andrew Maher

Contextual multi-armed bandits are a popular choice to model sequential decision-making. E.g., in a healthcare application we may perform various tests to asses a patient condition (exploration) and then decide on the best treatment to give…

机器学习 · 计算机科学 2025-04-08 Mirco Mutti , Jeongyeol Kwon , Shie Mannor , Aviv Tamar

Collaborative bandit learning, i.e., bandit algorithms that utilize collaborative filtering techniques to improve sample efficiency in online interactive recommendation, has attracted much research attention as it enjoys the best of both…

机器学习 · 计算机科学 2021-04-16 Chuanhao Li , Qingyun Wu , Hongning Wang

In this paper, we propose a new multi-objective contextual multi-armed bandit (MAB) problem with two objectives, where one of the objectives dominates the other objective. Unlike single-objective MAB problems in which the learner obtains a…

机器学习 · 计算机科学 2018-06-04 Cem Tekin , Eralp Turgay

This paper investigates learning-based caching in small-cell networks (SCNs) when user preference is unknown. The goal is to optimize the cache placement in each small base station (SBS) for minimizing the system long-term transmission…

网络与互联网体系结构 · 计算机科学 2020-01-15 Xianzhe Xu , Meixia Tao , Cong Shen

Bandit algorithms have various application in safety-critical systems, where it is important to respect the system constraints that rely on the bandit's unknown parameters at every round. In this paper, we formulate a linear stochastic…

机器学习 · 计算机科学 2019-08-19 Sanae Amani , Mahnoosh Alizadeh , Christos Thrampoulidis

Long-context modeling is critical for a wide range of real-world tasks, including long-context question answering, summarization, and complex reasoning tasks. Recent studies have explored fine-tuning Large Language Models (LLMs) with…

计算与语言 · 计算机科学 2026-04-10 Shaohua Duan , Pengcheng Huang , Xinze Li , Zhenghao Liu , Xiaoyuan Yi , Yukun Yan , Shuo Wang , Yu Gu , Ge Yu , Maosong Sun

Remote education has proliferated in the twenty-first century, yielding rise to intelligent tutoring systems. In particular, research has found multi-armed bandit (MAB) intelligent tutors to have notable abilities in traversing the…

计算机与社会 · 计算机科学 2024-08-15 Blake Castleman , Uzay Macar , Ansaf Salleb-Aouissi

We present an online tutoring system that learns to provide effective feedback to students after they answer questions incorrectly. Using data from one million students, the system learns which assistance action (e.g., one of multiple…

机器学习 · 计算机科学 2025-08-04 Robin Schmucker , Nimish Pachapurkar , Shanmuga Bala , Miral Shah , Tom Mitchell

Contextual bandit learning is a reinforcement learning problem where the learner repeatedly receives a set of features (context), takes an action and receives a reward based on the action and context. We consider this problem under a…

机器学习 · 计算机科学 2012-03-05 Alekh Agarwal , Miroslav Dudík , Satyen Kale , John Langford , Robert E. Schapire

Contextual Bandits is one of the widely popular techniques used in applications such as personalization, recommendation systems, mobile health, causal marketing etc . As a dynamic approach, it can be more efficient than standard A/B testing…

机器学习 · 计算机科学 2022-02-03 Praneet Dutta , Joe Cheuk , Jonathan S Kim , Massimo Mascaro

There are two variants of the classical multi-armed bandit (MAB) problem that have received considerable attention from machine learning researchers in recent years: contextual bandits and simple regret minimization. Contextual bandits are…

The problem of multi-armed bandits (MAB) asks to make sequential decisions while balancing between exploitation and exploration, and have been successfully applied to a wide range of practical scenarios. Various algorithms have been…

机器学习 · 计算机科学 2022-02-24 Xiaojin Zhang , Shuai Li , Weiwen Liu , Shengyu Zhang

The matrix contextual bandit (CB), as an extension of the well-known multi-armed bandit, is a powerful framework that has been widely applied in sequential decision-making scenarios involving low-rank structure. In many real-world…

机器学习 · 计算机科学 2025-07-24 Yao Wang , Jiannan Li , Yue Kang , Shanxing Gao , Zhenxin Xiao

Combinatorial online learning is a fundamental task for selecting the optimal action (or super arm) as a combination of base arms in sequential interactions with systems providing stochastic rewards. It is applicable to diverse domains such…

机器学习 · 计算机科学 2026-03-04 Seockbean Song , Youngsik Yoon , Siwei Wang , Wei Chen , Jungseul Ok

Contextual bandits are a common problem faced by machine learning practitioners in domains as diverse as hypothesis testing to product recommendations. There have been a lot of approaches in exploiting rich data representations for…

计算机视觉与模式识别 · 计算机科学 2020-03-20 Aniket Anand Deshmukh , Abhimanu Kumar , Levi Boyles , Denis Charles , Eren Manavoglu , Urun Dogan