English
Related papers

Related papers: What Makes LLMs Effective Sequential Recommenders?…

200 papers

Large language models (LLMs) are now widely used across many fields, including marketing research. Sentiment analysis, in particular, helps firms understand consumer preferences. While most NLP studies classify sentiment from review text…

Computation and Language · Computer Science 2025-08-18 Junichiro Niimi

Iterative preference optimization has recently become one of the de-facto training paradigms for large language models (LLMs), but the performance is still underwhelming due to too much noisy preference data yielded in the loop. To combat…

Computation and Language · Computer Science 2024-09-18 Jianing Wang , Yang Zhou , Xiaocheng Zhang , Mengjiao Bao , Peng Yan

Reward models (RMs) play a pivotal role in aligning large language models (LLMs) with human values. However, noisy preferences in human feedback can lead to reward misgeneralization - a phenomenon where reward models learn spurious…

The advent of large language models (LLMs) has sparked significant interest in using natural language for preference learning. However, existing methods often suffer from high computational burdens, taxing human supervision, and lack of…

Machine Learning · Computer Science 2024-12-23 Saaduddin Mahmud , Mason Nakamura , Shlomo Zilberstein

Standard human preference-based alignment methods, such as Reinforcement Learning from Human Feedback (RLHF), are a cornerstone for aligning large language models (LLMs) with human values. However, these methods typically assume that…

Artificial Intelligence · Computer Science 2026-03-02 Xiaoyang Cao , Zelai Xu , Mo Guang , Kaiwen Long , Michiel A. Bakker , Yu Wang , Chao Yu

In the era of information overload, recommendation systems play a pivotal role in filtering data and delivering personalized content. Recent advancements in feature interaction and user behavior modeling have significantly enhanced the…

Information Retrieval · Computer Science 2025-02-20 Hao Wang , Wei Guo , Luankang Zhang , Jin Yao Chin , Yufei Ye , Huifeng Guo , Yong Liu , Defu Lian , Ruiming Tang , Enhong Chen

Serendipity plays a pivotal role in enhancing user satisfaction within recommender systems, yet its evaluation poses significant challenges due to its inherently subjective nature and conceptual ambiguity. Current algorithmic approaches…

Information Retrieval · Computer Science 2025-07-24 Li Kang , Yuhan Zhao , Li Chen

Reinforcement learning from human feedback (RLHF) has emerged as the primary method for aligning large language models (LLMs) with human preferences. While it enables LLMs to achieve human-level alignment, it often incurs significant…

Computation and Language · Computer Science 2025-03-21 Shivank Garg , Ayush Singh , Shweta Singh , Paras Chopra

The performance of pre-trained Large Language Models (LLMs) is often sensitive to nuances in prompt templates, requiring careful prompt engineering, adding costs in terms of computing and human effort. In this study, we present experiments…

Computation and Language · Computer Science 2025-05-27 Liang Cheng , Tianyi LI , Zhaowei Wang , Mark Steedman

While learning to align Large Language Models (LLMs) with human preferences has shown remarkable success, aligning these models to meet the diverse user preferences presents further challenges in preserving previous knowledge. This paper…

Artificial Intelligence · Computer Science 2024-10-01 Gihun Lee , Minchan Jeong , Yujin Kim , Hojung Jung , Jaehoon Oh , Sangmook Kim , Se-Young Yun

Pairwise preference data have played an important role in the alignment of large language models (LLMs). Each sample of such data consists of a prompt, two different responses to the prompt, and a binary label indicating which of the two…

Computation and Language · Computer Science 2026-05-12 Zhongze Cai , Xiaocheng Li

Sequential recommender systems predict items that may interest users by modeling their preferences based on historical interactions. Traditional sequential recommendation methods rely on capturing implicit collaborative filtering signals…

Information Retrieval · Computer Science 2024-03-28 Shenghao Yang , Weizhi Ma , Peijie Sun , Qingyao Ai , Yiqun Liu , Mingchen Cai , Min Zhang

Sequential recommendation systems predict the next interaction item based on users' past interactions, aligning recommendations with individual preferences. Leveraging the strengths of Large Language Models (LLMs) in knowledge comprehension…

Information Retrieval · Computer Science 2025-01-22 Xiaoyu Kong , Jiancan Wu , An Zhang , Leheng Sheng , Hui Lin , Xiang Wang , Xiangnan He

Large language models (LLMs) demonstrate exceptional instruct-following ability to complete various downstream tasks. Although this impressive ability makes LLMs flexible task solvers, their performance in solving tasks also heavily relies…

Computation and Language · Computer Science 2024-06-03 Pengwei Zhan , Zhen Xu , Qian Tan , Jie Song , Ru Xie

Aligning the behavior of Large language models (LLMs) with human intentions and values remains a critical challenge. Reinforcement learning from human feedback (RLHF) aligns LLMs by training a reward model (RM) on human preferences and…

Computation and Language · Computer Science 2025-12-25 Jiayi Zhou , Jiaming Ji , Juntao Dai , Dong Li , Yaodong Yang

Sequential recommendation (SR) leverages users' dynamic preferences, with recent advances incorporating multi-interest learning to model diverse user interests. However, most multi-interest SR models rely on noisy, sparse implicit feedback,…

Information Retrieval · Computer Science 2025-05-08 Shutong Qiao , Chen Gao , Wei Yuan , Yong Li , Hongzhi Yin

Modeling user preferences across domains remains a key challenge in slate recommendation (i.e. recommending an ordered sequence of items) research. We investigate how Large Language Models (LLM) can effectively act as world models of user…

Information Retrieval · Computer Science 2025-11-07 Baptiste Bonin , Maxime Heuillet , Audrey Durand

Reinforcement Learning from Human Feedback (RLHF) has become central to aligning large language models with human values, typically by first learning a reward model from preference data which is then used to update the model with…

Artificial Intelligence · Computer Science 2025-10-20 Keertana Chidambaram , Karthik Vinary Seetharaman , Vasilis Syrgkanis

Large Language Models (LLMs) are being increasingly explored as general-purpose tools for recommendation tasks, enabling zero-shot and instruction-following capabilities without the need for task-specific training. While the research…

Information Retrieval · Computer Science 2025-08-05 Ethan Bito , Yongli Ren , Estrid He

As a paradigm that delves into the deep seated drivers of user behavior, motivation-based recommendation systems have emerged as a prominent research direction in the field of personalized information retrieval. Unlike traditional…

Information Retrieval · Computer Science 2026-03-16 Yicheng Di