中文
相关论文

相关论文: Enhancing Bandit Algorithms with LLMs for Time-var…

200 篇论文

Cold start scenarios present fundamental obstacles to effective recommendation generation, particularly when dealing with users lacking interaction history or items with sparse metadata. This research proposes an innovative hybrid framework…

计算与语言 · 计算机科学 2026-03-05 Nikita Zmanovskii

Bandit algorithms are guaranteed to solve diverse sequential decision-making problems, provided that a sufficient exploration budget is available. However, learning from scratch is often too costly for personalization tasks where a single…

机器学习 · 计算机科学 2025-08-08 Newton Mwai , Emil Carlsson , Fredrik D. Johansson

Prompt-based offline methods are commonly used to optimize large language model (LLM) responses, but evaluating these responses is computationally intensive and often fails to accommodate diverse response styles. This study introduces a…

人机交互 · 计算机科学 2025-11-12 Xiangxiang Dai , Yuejin Xie , Maoli Liu , Xuchuang Wang , Zhuohua Li , Huanyu Wang , John C. S. Lui

Sequential decision-making algorithms such as multi-armed bandits can find optimal personalized decisions, but are notoriously sample-hungry. In personalized medicine, for example, training a bandit from scratch for every patient is…

机器学习 · 计算机科学 2026-05-12 Ahmet Zahid Balcıoğlu , Newton Mwai , Emil Carlsson , Fredrik D. Johansson

Conversational recommender systems proactively query users with relevant "key terms" and leverage the feedback to elicit users' preferences for personalized recommendations. Conversational contextual bandits, a prevalent approach in this…

机器学习 · 计算机科学 2025-05-28 Maoli Liu , Zhuohua Li , Xiangxiang Dai , John C. S. Lui

The burgeoning presence of Large Language Models (LLM) is propelling the development of personalized recommender systems. Most existing LLM-based methods fail to sufficiently explore the multi-view graph structure correlations inherent in…

信息检索 · 计算机科学 2025-07-30 Xu Guo , Tong Zhang , Yuanzhi Wang , Chenxu Wang , Fuyun Wang , Xudong Wang , Xiaoya Zhang , Xin Liu , Zhen Cui

Conversational recommendation systems elicit user preferences by interacting with users to obtain their feedback on recommended commodities. Such systems utilize a multi-armed bandit framework to learn user preferences in an online manner…

机器学习 · 计算机科学 2024-07-29 Shuhua Yang , Hui Yuan , Xiaoying Zhang , Mengdi Wang , Hong Zhang , Huazheng Wang

Personalized web services strive to adapt their services (advertisements, news articles, etc) to individual users by making use of both content and user information. Despite a few recent advances, this problem remains challenging for at…

机器学习 · 计算机科学 2012-03-05 Lihong Li , Wei Chu , John Langford , Robert E. Schapire

Contextual bandit algorithms are commonly used in digital health to recommend personalized treatments. However, to ensure the effectiveness of the treatments, patients are often requested to take actions that have no immediate benefit to…

机器学习 · 计算机科学 2024-03-14 Kyra Gan , Esmaeil Keyvanshokooh , Xueqing Liu , Susan Murphy

Actively inferring user preferences, for example by asking good questions, is important for any human-facing decision-making system. Active inference allows such systems to adapt and personalize themselves to nuanced individual preferences.…

计算与语言 · 计算机科学 2024-06-27 Wasu Top Piriyakulkij , Volodymyr Kuleshov , Kevin Ellis

In this paper, we study a cold-start problem in recommendation systems where we have completely new users entered the systems. There is not any interaction or feedback of the new users with the systems previoustly, thus no ratings are…

信息检索 · 计算机科学 2014-05-30 Hai Thanh Nguyen , Jérémie Mary , Philippe Preux

We consider a sequential assortment selection problem where the user choice is given by a multinomial logit (MNL) choice model whose parameters are unknown. In each period, the learning agent observes a $d$-dimensional contextual…

机器学习 · 统计学 2021-03-26 Min-hwan Oh , Garud Iyengar

We propose a model for learning with bandit feedback while accounting for deterministically evolving and unobservable states that we call Bandits with Deterministically Evolving States ($B$-$DES$). The workhorse applications of our model…

机器学习 · 计算机科学 2025-01-29 Khashayar Khosravi , Renato Paes Leme , Chara Podimata , Apostolis Tsorvantzis

Automated red-teaming has emerged as a scalable approach for auditing Large Language Models (LLMs) prior to deployment, yet existing approaches lack mechanisms to efficiently adapt to model-specific vulnerabilities at inference. We…

计算与语言 · 计算机科学 2026-05-19 Christos Ziakas , Nicholas Loo , Nishita Jain , Alessandra Russo

Most bandit policies are designed to either minimize regret in any problem instance, making very few assumptions about the underlying environment, or in a Bayesian sense, assuming a prior distribution over environment parameters. The former…

机器学习 · 计算机科学 2021-01-07 Branislav Kveton , Martin Mladenov , Chih-Wei Hsu , Manzil Zaheer , Csaba Szepesvari , Craig Boutilier

Behavior change interventions are important to coordinate societal action across a wide array of important applications, including the adoption of electrified vehicles to reduce emissions. Prior work has demonstrated that interventions for…

In this work, we study sequential choice bandits with feedback. We propose bandit algorithms for a platform that personalizes users' experience to maximize its rewards. For each action directed to a given user, the platform is given a…

机器学习 · 统计学 2021-01-06 Anshuka Rangi , Massimo Franceschetti , Long Tran-Thanh

An effective online recommendation system should jointly capture users' long-term and short-term preferences in both users' internal behaviors (from the target recommendation task) and external behaviors (from other tasks). However, it is…

信息检索 · 计算机科学 2021-11-29 Ruobing Xie , Yalong Wang , Rui Wang , Yuanfu Lu , Yuanhang Zou , Feng Xia , Leyu Lin

Learning in multi-player games can model a large variety of practical scenarios, where each player seeks to optimize its own local objective function, which at the same time relies on the actions taken by others. Motivated by the frequent…

最优化与控制 · 数学 2023-09-08 Yuanhanqing Huang , Jianghai Hu

Personalizing large language models (LLMs) to individual user preferences is a critical step beyond generating generically helpful responses. However, current personalization methods are ill-suited for new users, as they typically require…

机器学习 · 计算机科学 2025-09-30 Zikun Qu , Min Zhang , Mingze Kong , Xiang Li , Zhiwei Shang , Zhiyong Wang , Yikun Ban , Shuang Qiu , Yao Shu , Zhongxiang Dai