中文
相关论文

相关论文: Fast Distributed Bandits for Online Recommendation…

200 篇论文

Bandits with feedback graphs are powerful online learning models that interpolate between the full information and classic bandit problems, capturing many real-life applications. A recent work by Zhang et al. (2023) studies the contextual…

机器学习 · 计算机科学 2024-02-14 Mengxiao Zhang , Yuheng Zhang , Haipeng Luo , Paul Mineiro

Contextual bandit learning is an increasingly popular approach to optimizing recommender systems via user feedback, but can be slow to converge in practice due to the need for exploring a large feature space. In this paper, we propose a…

机器学习 · 计算机科学 2012-07-03 Yisong Yue , Sue Ann Hong , Carlos Guestrin

Contextual bandits algorithms aim to choose the optimal arm with the highest reward out of a set of candidates based on the contextual information. Various bandit algorithms have been applied to real-world applications due to their ability…

机器学习 · 计算机科学 2023-08-22 Yunzhe Qi , Yikun Ban , Jingrui He

The demand for collaborative and private bandit learning across multiple agents is surging due to the growing quantity of data generated from distributed systems. Federated bandit learning has emerged as a promising framework for private,…

机器学习 · 计算机科学 2024-03-04 Ethan Blaser , Chuanhao Li , Hongning Wang

Efficient online decision-making in contextual bandits is challenging, as methods without informative priors often suffer from computational or statistical inefficiencies. In this work, we leverage pre-trained diffusion models as expressive…

机器学习 · 计算机科学 2025-10-29 Imad Aouali

Contextual linear bandits is a rich and theoretically important model that has many practical applications. Recently, this setup gained a lot of interest in applications over wireless where communication constraints can be a performance…

机器学习 · 计算机科学 2022-06-10 Osama A. Hanna , Lin F. Yang , Christina Fragouli

Real-world applications of contextual bandits often exhibit non-stationarity due to seasonality, serendipity, and evolving social trends. While a number of non-stationary contextual bandit learning algorithms have been proposed in the…

机器学习 · 计算机科学 2023-10-17 Zheqing Zhu , Yueyang Liu , Xu Kuang , Benjamin Van Roy

In today's business marketplace, many high-tech Internet enterprises constantly explore innovative ways to provide optimal online user experiences for gaining competitive advantages. The great needs of developing intelligent interactive…

信息检索 · 计算机科学 2021-07-02 Qing Wang

In a multi-armed bandit (MAB) problem, an online algorithm makes a sequence of choices. In each round it chooses from a time-invariant set of alternatives and receives the payoff associated with this alternative. While the case of small…

数据结构与算法 · 计算机科学 2014-05-21 Aleksandrs Slivkins

Contextual bandit algorithms have become popular for online recommendation systems such as Digg, Yahoo! Buzz, and news recommendation in general. \emph{Offline} evaluation of the effectiveness of new algorithms in these applications is…

机器学习 · 计算机科学 2015-03-13 Lihong Li , Wei Chu , John Langford , Xuanhui Wang

In stochastic contextual bandit (SCB) problems, an agent selects an action based on certain observed context to maximize the cumulative reward over iterations. Recently there have been a few studies using a deep neural network (DNN) to…

机器学习 · 计算机科学 2021-04-23 Tan Zhu , Guannan Liang , Chunjiang Zhu , Haining Li , Jinbo Bi

This paper presents a new algorithm for neural contextual bandits (CBs) that addresses the challenge of delayed reward feedback, where the reward for a chosen action is revealed after a random, unknown delay. This scenario is common in…

机器学习 · 计算机科学 2025-04-17 Mohammadali Moghimi , Sharu Theresa Jose , Shana Moothedath

Online recommendation/advertising is ubiquitous in web business. Image displaying is considered as one of the most commonly used formats to interact with customers. Contextual multi-armed bandit has shown success in the application of…

机器学习 · 计算机科学 2022-02-11 Yikun Ban , Jingrui He

In stochastic contextual bandits, an agent sequentially makes actions from a time-dependent action set based on past experience to minimize the cumulative regret. Like many other machine learning algorithms, the performance of bandits…

机器学习 · 计算机科学 2024-04-09 Yue Kang , Cho-Jui Hsieh , Thomas C. M. Lee

Contextual bandit algorithms are essential for solving real-world decision making problems. In practice, collecting a contextual bandit's feedback from different domains may involve different costs. For example, measuring drug reaction from…

机器学习 · 计算机科学 2025-04-08 Ziyan Wang , Xiaoming Huo , Hao Wang

This paper offers a comprehensive analysis of collaborative bandit algorithms and provides a thorough comparison of their performance. Collaborative bandits aim to improve the performance of contextual bandits by introducing relationships…

机器学习 · 计算机科学 2025-10-07 Eren Ozbay , Ashkan Golgoon

Contextual bandits provide an effective way to model the dynamic data problem in ML by leveraging online (incremental) learning to continuously adjust the predictions based on changing environment. We explore details on contextual bandits,…

机器学习 · 计算机科学 2020-09-24 Dattaraj Rao

We consider the problem where M agents collaboratively interact with an instance of a stochastic K-armed contextual bandit, where K>>M. The goal of the agents is to simultaneously minimize the cumulative regret over all the agents over a…

机器学习 · 计算机科学 2022-11-16 Jiabin Lin , Shana Moothedath

In the dynamic landscape of online businesses, recommender systems are pivotal in enhancing user experiences. While traditional approaches have relied on static supervised learning, the quest for adaptive, user-centric recommendations has…

信息检索 · 计算机科学 2023-12-22 Yikun Ban , Yunzhe Qi , Jingrui He

While distributional reinforcement learning (DistRL) has been empirically effective, the question of when and why it is better than vanilla, non-distributional RL has remained unanswered. This paper explains the benefits of DistRL through…

机器学习 · 计算机科学 2023-09-26 Kaiwen Wang , Kevin Zhou , Runzhe Wu , Nathan Kallus , Wen Sun