English
Related papers

Related papers: Latent Preference Modeling for Cross-Session Perso…

200 papers

Aligning large language models (LLMs) with diverse and multifaceted user preferences is a fundamental challenge in personalized AI systems. Existing multi-objective alignment methods either rely on costly training or require pre-trained…

Computation and Language · Computer Science 2026-05-26 Linhao Luo , Thuy-Trang Vu , Van-Anh Nguyen , Junae Kim , Gholamreza Haffari , Dinh Phung

Large language models (LLMs) have enhanced conventional recommendation models via user profiling, which generates representative textual profiles from users' historical interactions. However, their direct application to session-based…

Information Retrieval · Computer Science 2026-04-16 Gyuseok Lee , Wonbin Kweon , Zhenrui Yue , Yaokun Liu , Yifan Liu , Susik Yoon , Dong Wang , SeongKu Kang

Most current recommender systems primarily focus on what to recommend, assuming users always require personalized recommendations. However, with the widely spread of ChatGPT and other chatbots, a more crucial problem in the context of…

Information Retrieval · Computer Science 2024-04-09 Zhefan Wang , Weizhi Ma , Min Zhang

How can Large Language Models (LLMs) be aligned with human intentions and values? A typical solution is to gather human preference on model outputs and finetune the LLMs accordingly while ensuring that updates do not deviate too far from a…

Computation and Language · Computer Science 2024-05-28 Hung Le , Quan Tran , Dung Nguyen , Kien Do , Saloni Mittal , Kelechi Ogueji , Svetha Venkatesh

As conversational agents accumulate experience collaborating with users, adapting to user preferences is essential for fostering long-term relationships and improving collaboration quality over time. We introduce MultiSessionCollab, a…

Artificial Intelligence · Computer Science 2026-03-17 Shuhaib Mehri , Priyanka Kargupta , Tal August , Dilek Hakkani-Tür

Agentic memory systems enable large language model (LLM) agents to maintain state across long interactions, supporting long-horizon reasoning and personalization beyond fixed context windows. Despite rapid architectural development, the…

Computation and Language · Computer Science 2026-05-21 Dongming Jiang , Yi Li , Songtao Wei , Jinxin Yang , Ayushi Kishore , Alysa Zhao , Dingyi Kang , Xu Hu , Feng Chen , Qiannan Li , Bingzhe Li

Reward models (RMs) are crucial for aligning large language models (LLMs) with human preferences. They are trained using preference datasets where each example consists of one input prompt, two responses, and a preference label. As curating…

Computation and Language · Computer Science 2025-03-18 Jiaming Shen , Ran Xu , Yennie Jun , Zhen Qin , Tianqi Liu , Carl Yang , Yi Liang , Simon Baumgartner , Michael Bendersky

Aligning the output of Large Language Models (LLMs) with human preferences (e.g., by means of reinforcement learning with human feedback, or RLHF) is essential for ensuring their effectiveness in real-world scenarios. Despite significant…

Artificial Intelligence · Computer Science 2024-10-23 Pietro Bernardelle , Gianluca Demartini

Personalizing large language models (LLMs) is essential for delivering tailored interactions that improve user experience. Many existing personalization methods require fine-tuning LLMs for each user, rendering them prohibitively expensive…

Machine Learning · Computer Science 2025-03-06 Yijing Zhang , Dyah Adila , Changho Shin , Frederic Sala

Large language model (LLM) agents increasingly operate in settings where a single context window is far too small to capture what has happened, what was learned, and what should not be repeated. Memory -- the ability to persist, organize,…

Artificial Intelligence · Computer Science 2026-03-10 Pengfei Du

Existing memory benchmarks for LLM agents evaluate explicit recall of facts, yet overlook implicit memory where experience becomes automated behavior without conscious retrieval. This gap is critical: effective assistants must automatically…

Artificial Intelligence · Computer Science 2026-04-16 Chonghan Qin , Xiachong Feng , Weitao Ma , Xiaocheng Feng , Lingpeng Kong

This paper studies retrieval-augmented approaches for personalizing large language models (LLMs), which potentially have a substantial impact on various applications and domains. We propose the first attempt to optimize the retrieval models…

Computation and Language · Computer Science 2024-04-19 Alireza Salemi , Surya Kallumadi , Hamed Zamani

Since individuals may struggle to recall all life details and often confuse events, establishing a system to assist users in recalling forgotten experiences is essential. While numerous studies have proposed memory recall systems, these…

Computation and Language · Computer Science 2026-02-26 Chia Cheng Chang , An-Zi Yen , Hen-Hsen Huang , Hsin-Hsi Chen

Sequential recommender systems aim to predict users' next interested item given their historical interactions. However, a long-standing issue is how to distinguish between users' long/short-term interests, which may be heterogeneous and…

Information Retrieval · Computer Science 2023-03-14 Muyang Li , Zijian Zhang , Xiangyu Zhao , Wanyu Wang , Minghao Zhao , Runze Wu , Ruocheng Guo

LLM-based user agents, which simulate user interaction behavior, are emerging as a promising approach to enhancing recommender systems. In real-world scenarios, users' interactions often exhibit cross-domain characteristics and are…

Information Retrieval · Computer Science 2025-04-21 Jiahao Liu , Shengkang Gu , Dongsheng Li , Guangping Zhang , Mingzhe Han , Hansu Gu , Peng Zhang , Tun Lu , Li Shang , Ning Gu

We primarily focus on the field of large language models (LLMs) for recommendation, which has been actively explored recently and poses a significant challenge in effectively enhancing recommender systems with logical reasoning abilities…

Information Retrieval · Computer Science 2024-08-13 Jiachen Zhu , Jianghao Lin , Xinyi Dai , Bo Chen , Rong Shan , Jieming Zhu , Ruiming Tang , Yong Yu , Weinan Zhang

Existing multimodal task-oriented dialog data fails to demonstrate the diverse expressions of user subjective preferences and recommendation acts in the real-life shopping scenario. This paper introduces a new dataset SURE (Multimodal…

Information Retrieval · Computer Science 2023-05-30 Yuxing Long , Binyuan Hui , Caixia Yuan1 , Fei Huang , Yongbin Li , Xiaojie Wang

We explore the use of Large Language Model (LLM-based) chatbots to power recommender systems. We observe that the chatbots respond poorly when they encounter under-specified requests (e.g., they make incorrect assumptions, hedge with a long…

Information Retrieval · Computer Science 2024-06-05 Christine Herlihy , Jennifer Neville , Tobias Schnabel , Adith Swaminathan

What enables large language models (LLMs) to effectively model user preferences in sequential recommendation? Our investigation reveals that existing preference-alignment approaches largely rely on binary pairwise comparisons, overlooking…

Information Retrieval · Computer Science 2026-04-20 Zhongyu Ouyang , Qianlong Wen , Chunhui Zhang , Yanfang Ye , Soroush Vosoughi

AI-powered recruitment tools are increasingly adopted in personnel selection, yet they struggle to capture the requisition (req)-specific personal competencies (PCs) that distinguish successful candidates beyond job categories. We propose a…

Computation and Language · Computer Science 2026-04-02 Wanxin Li , Denver McNeney , Nivedita Prabhu , Charlene Zhang , Renee Barr , Matthew Kitching , Khanh Dao Duc , Anthony S. Boyce