中文
相关论文

相关论文: Neural Contextual Bandits for Personalized Recomme…

200 篇论文

Recommendation systems are a key modern application of machine learning, but they have the downside that they often draw upon sensitive user information in making their predictions. We show how to address this deficiency by basing a…

机器学习 · 计算机科学 2021-12-03 Naveen Durvasula , Franklyn Wang , Scott Duke Kominers

Neural contextual bandits are vulnerable to adversarial attacks, where subtle perturbations to rewards, actions, or contexts induce suboptimal decisions. We introduce AdvBandit, a black-box adaptive attack that formulates context poisoning…

机器学习 · 计算机科学 2026-03-03 Ray Telikani , Amir H. Gandomi

Contextual multi-armed bandits (CMAB) have been widely used for learning to filter and prioritize information according to a user's interest. In this work, we analyze top-K ranking under the CMAB framework where the top-K arms are chosen…

机器学习 · 计算机科学 2022-01-31 Michael Rawson , Jade Freeman

We study offline data poisoning attacks in contextual bandits, a class of reinforcement learning problems with important applications in online recommendation and adaptive medical treatment, among others. We provide a general attack…

机器学习 · 计算机科学 2018-08-27 Yuzhe Ma , Kwang-Sung Jun , Lihong Li , Xiaojin Zhu

In stochastic contextual bandits, an agent sequentially makes actions from a time-dependent action set based on past experience to minimize the cumulative regret. Like many other machine learning algorithms, the performance of bandits…

机器学习 · 计算机科学 2024-04-09 Yue Kang , Cho-Jui Hsieh , Thomas C. M. Lee

Decision making is a challenging task in online recommender systems. The decision maker often needs to choose a contextual item at each step from a set of candidates. Contextual bandit algorithms have been successfully deployed to such…

机器学习 · 计算机科学 2019-03-05 Feiyang Pan , Qingpeng Cai , Pingzhong Tang , Fuzhen Zhuang , Qing He

Interactive recommender systems that enable the interactions between users and the recommender system have attracted increasing research attentions. Previous methods mainly focus on optimizing recommendation accuracy. However, they usually…

信息检索 · 计算机科学 2019-07-04 Yong Liu , Yingtai Xiao , Qiong Wu , Chunyan Miao , Juyong Zhang

Recent works on neural contextual bandits have achieved compelling performances due to their ability to leverage the strong representation power of neural networks (NNs) for reward prediction. Many applications of contextual bandits involve…

机器学习 · 计算机科学 2023-03-02 Zhongxiang Dai , Yao Shu , Arun Verma , Flint Xiaofeng Fan , Bryan Kian Hsiang Low , Patrick Jaillet

We study the sequential batch learning problem in linear contextual bandits with finite action sets, where the decision maker is constrained to split incoming individuals into (at most) a fixed number of batches and can only observe…

机器学习 · 计算机科学 2020-04-15 Yanjun Han , Zhengqing Zhou , Zhengyuan Zhou , Jose Blanchet , Peter W. Glynn , Yinyu Ye

We consider the problem of contextual bandits with stochastic experts, which is a variation of the traditional stochastic contextual bandit with experts problem. In our problem setting, we assume access to a class of stochastic experts,…

机器学习 · 统计学 2021-03-04 Rajat Sen , Karthikeyan Shanmugam , Nihal Sharma , Sanjay Shakkottai

We consider contextual linear bandits over networks, a class of sequential decision-making problems where learning occurs simultaneously across multiple locations and the reward distributions share structural similarities while also…

机器学习 · 计算机科学 2025-08-26 Chuyun Deng , Huiwen Jia

We address the cold start problem in recommendation systems assuming no contextual information is available neither about users, nor items. We consider the case in which we only have access to a set of ratings of items by users. Most of the…

机器学习 · 计算机科学 2014-07-11 Jérémie Mary , Romaric Gaudel , Preux Philippe

The contextual bandit problem, which is a type of reinforcement learning tasks, provides an effective framework for solving challenges in recommendation systems, such as satisfying real-time requirements, enabling personalization,…

机器学习 · 计算机科学 2025-01-16 Shogo Ito , Tatsuji Takahashi , Yu Kono

Standard contextual bandit problem assumes that all the relevant contexts are observed before the algorithm chooses an arm. This modeling paradigm, while useful, often falls short when dealing with problems in which valuable additional…

机器学习 · 计算机科学 2023-09-26 Chaoqi Wang , Ziyu Ye , Zhe Feng , Ashwinkumar Badanidiyuru , Haifeng Xu

We consider the contextual bandit problem where at each time, the agent only has access to a noisy version of the context and the error variance (or an estimator of this variance). This setting is motivated by a wide range of applications…

机器学习 · 统计学 2024-03-19 Yongyi Guo , Ziping Xu , Susan Murphy

As large language models (LLMs) become increasingly popular, there is a growing need to predict which out of a set of LLMs will yield a successful answer to a given query at low cost. This problem promises to become even more relevant as…

计算与语言 · 计算机科学 2026-04-23 Baran Atalar , Eddie Zhang , Carlee Joe-Wong

We study a general class of contextual bandits, where each context-action pair is associated with a raw feature vector, but the reward generating function is unknown. We propose a novel learning algorithm that transforms the raw feature…

机器学习 · 计算机科学 2020-12-04 Pan Xu , Zheng Wen , Handong Zhao , Quanquan Gu

Relevance ranking and result diversification are two core areas in modern recommender systems. Relevance ranking aims at building a ranked list sorted in decreasing order of item relevance, while result diversification focuses on generating…

机器学习 · 计算机科学 2020-08-13 Chang Li , Haoyun Feng , Maarten de Rijke

Contextual bandits algorithms have become essential in real-world user interaction problems in recent years. However, these algorithms rely on context as attribute value representation, which makes them unfeasible for real-world domains…

机器学习 · 计算机科学 2020-12-18 Ashutosh Kakadiya , Sriraam Natarajan , Balaraman Ravindran

Contextual multi-armed bandit (MAB) achieves cutting-edge performance on a variety of problems. When it comes to real-world scenarios such as recommendation system and online advertising, however, it is essential to consider the resource…

机器学习 · 计算机科学 2020-04-07 Mengyue Yang , Qingyang Li , Zhiwei Qin , Jieping Ye