English
Related papers

Related papers: Interactive Recommendation Agent with Active User …

200 papers

Large-scale industrial recommenders typically use a fixed multi-stage pipeline (recall, ranking, re-ranking) and have progressed from collaborative filtering to deep and large pre-trained models. However, both multi-stage and so-called One…

Information Retrieval · Computer Science 2026-04-10 Jinxin Hu , Hao Deng , Lingyu Mu , Hao Zhang , Shizhun Wang , Yu Zhang , Xiaoyi Zeng

Prompting is central to interaction with AI systems, yet many users struggle to explore alternative directions, articulate creative intent, or understand how variations in prompts shape model outputs. We introduce prompt recommender systems…

Human-Computer Interaction · Computer Science 2026-01-23 Jason Kim , Maria Teleki , James Caverlee

In recommender systems, online A/B testing is a crucial method for evaluating the performance of different models. However, conducting online A/B testing often presents significant challenges, including substantial economic costs, user…

A centerpiece of the ever-popular reinforcement learning from human feedback (RLHF) approach to fine-tuning autoregressive language models is the explicit training of a reward model to emulate human feedback, distinct from the language…

Computation and Language · Computer Science 2023-05-22 Wanqiao Xu , Shi Dong , Dilip Arumugam , Benjamin Van Roy

Recommender systems play a central role in numerous real-life applications, yet evaluating their performance remains a significant challenge due to the gap between offline metrics and online behaviors. Given the scarcity and limits (e.g.,…

Information Retrieval · Computer Science 2025-04-18 Nicolas Bougie , Narimasa Watanabe

Recommender systems are widely used in online services, with embedding-based models being particularly popular due to their expressiveness in representing complex signals. However, these models often function as a black box, making them…

Information Retrieval · Computer Science 2024-06-25 Yuxuan Lei , Jianxun Lian , Jing Yao , Xu Huang , Defu Lian , Xing Xie

The new kind of Agent-oriented information system, exemplified by GPTs, urges us to inspect the information system infrastructure to support Agent-level information processing and to adapt to the characteristics of Large Language Model…

Information Retrieval · Computer Science 2024-03-06 Jizhi Zhang , Keqin Bao , Wenjie Wang , Yang Zhang , Wentao Shi , Wanhong Xu , Fuli Feng , Tat-Seng Chua

Recently, interactive recommender systems are becoming increasingly popular. The insight is that, with the interaction between users and the system, (1) users can actively intervene the recommendation results rather than passively receive…

Information Retrieval · Computer Science 2019-07-04 Yu Zhu , Yu Gong , Qingwen Liu , Yingcai Ma , Wenwu Ou , Junxiong Zhu , Beidou Wang , Ziyu Guan , Deng Cai

Recently, substantial research has been conducted on sequential recommendation, with the objective of forecasting the subsequent item by leveraging a user's historical sequence of interacted items. Prior studies employ both capsule networks…

Information Retrieval · Computer Science 2025-05-01 Zhikai Wang , Yanyan Shen

We introduce a new benchmark, LLF-Bench (Learning from Language Feedback Benchmark; pronounced as "elf-bench"), to evaluate the ability of AI agents to interactively learn from natural language feedback and instructions. Learning from…

Artificial Intelligence · Computer Science 2023-12-14 Ching-An Cheng , Andrey Kolobov , Dipendra Misra , Allen Nie , Adith Swaminathan

Reinforcement Learning from Human Feedback (RLHF) has become the standard for aligning Large Language Models (LLMs), yet its efficacy is bottlenecked by the high cost of acquiring preference data, especially in low-resource and expert…

Machine Learning · Computer Science 2026-03-11 Davit Melikidze , Marian Schneider , Jessica Lam , Martin Wertich , Ido Hakimi , Barna Pásztor , Andreas Krause

Conversational recommender systems (CRS) based on Large Language Models (LLMs) need to constantly be aligned to the user preferences to provide satisfying and context-relevant item recommendations. The traditional supervised fine-tuning…

Machine Learning · Computer Science 2025-08-08 Zhongheng Yang , Aijia Sun , Yushang Zhao , Yinuo Yang , Dannier Li , Chengrui Zhou

Large language model (LLM) based recommendation agents personalize what they know through evolving per-user semantic memory, yet how they reason remains a universal, static system prompt shared identically across all users. This asymmetry…

Information Retrieval · Computer Science 2026-04-22 Zhen Tao , Riwei Lai , Chenyun Yu , Weixin Chen , Li Chen , Beibei Kong , Lei Cheng , Chengxiang Zhuo , Zang Li , Qingqiang Sun

An Intelligent Personal Agent (IPA) is an agent that has the purpose of helping the user to gain information through reliable resources with the help of knowledge navigation techniques and saving time to search the best content. The agent…

Artificial Intelligence · Computer Science 2017-05-01 Amit Kumar , Rahul Dutta , Harbhajan Rai

Recommender systems are pivotal in Internet social platforms, yet they often cater to users' historical interests, leading to critical issues like echo chambers. To broaden user horizons, proactive recommender systems aim to guide user…

Information Retrieval · Computer Science 2025-05-02 Mingze Wang , Shuxian Bi , Wenjie Wang , Chongming Gao , Yangyang Li , Fuli Feng

Interactive reinforcement learning has shown promise in learning complex robotic tasks. However, the process can be human-intensive due to the requirement of a large amount of interactive feedback. This paper presents a new method that uses…

Robotics · Computer Science 2023-08-08 Shukai Liu , Chenming Wu , Ying Li , Liangjun Zhang

How to extract meaningful information in user historical behavior plays a crucial role in recommendation. User behavior sequence often contains multiple conceptually distinct items that belong to different item groups and the number of the…

Information Retrieval · Computer Science 2022-01-14 Weiqi Shao , Xu Chen , Jiashu Zhao , Long Xia , Dawei Yin

Interactive recommender system (IRS) has drawn huge attention because of its flexible recommendation strategy and the consideration of optimal long-term user experiences. To deal with the dynamic user preference and optimize accumulative…

Information Retrieval · Computer Science 2020-06-19 Sijin Zhou , Xinyi Dai , Haokun Chen , Weinan Zhang , Kan Ren , Ruiming Tang , Xiuqiang He , Yong Yu

The emerging meta- and multi-verse landscape is yet another step towards the more prevalent use of already ubiquitous online markets. In such markets, recommender systems play critical roles by offering items of interest to the users,…

Information Retrieval · Computer Science 2022-09-28 Ehsan Gholami , Mohammad Motamedi , Ashwin Aravindakshan

While interest in conversational recommender systems has been on the rise, operational systems suitable for serving as research platforms for comprehensive studies are currently lacking. This paper introduces an enhanced version of the IAI…

Information Retrieval · Computer Science 2024-03-04 Nolwenn Bernard , Ivica Kostric , Krisztian Balog