English
Related papers

Related papers: From Clicks to Preference: A Multi-stage Alignment…

200 papers

Large Language Models (LLMs) have been integrated into recommender systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant items…

Information Retrieval · Computer Science 2025-03-27 Sichun Luo , Jian Xu , Xiaojie Zhang , Linrong Wang , Sicong Liu , Hanxu Hou , Linqi Song

Retrieval-Augmented Generation (RAG) grounds large language models with external evidence, but many implementations rely on pre-built indices that remain static after construction. Related queries therefore repeat similar multi-hop…

Artificial Intelligence · Computer Science 2026-03-03 Yifan Wang , Mingxuan Jiang , Zhihao Sun , Yixin Cao , Yicun Liu , Keyang Chen , Guangnan Ye , Hongfeng Chai

Generative Retrieval (GR) offers a promising paradigm for recommendation through next-token prediction (NTP). However, scaling it to large-scale industrial systems introduces three challenges: (i) within a single request, the identical…

Information Retrieval · Computer Science 2026-04-17 Yanyan Zou , Junbo Qi , Lunsong Huang , Yu Li , Kewei Xu , Jiabao Gao , Binglei Zhao , Xuanhua Yang , Sulong Xu , Shengjie Li

Retrieval-Augmented Generation (RAG) based on knowledge graphs (KGs) enhances large language models (LLMs) by providing structured and interpretable external knowledge. However, existing KG-based RAG methods struggle to retrieve accurate…

Artificial Intelligence · Computer Science 2025-10-21 Junchi Yu , Yujie Liu , Jindong Gu , Philip Torr , Dongzhan Zhou

Training multi-modal large language models (MLLMs) that align with human intentions is a long-term challenge. Traditional score-only reward models for alignment suffer from low accuracy, weak generalization, and poor interpretability,…

Artificial Intelligence · Computer Science 2025-05-27 Jiayi Zhou , Jiaming Ji , Boyuan Chen , Jiapeng Sun , Wenqi Chen , Donghai Hong , Sirui Han , Yike Guo , Yaodong Yang

LLMs often fail to meet the specialized needs of distinct user groups due to their one-size-fits-all training paradigm \cite{lucy-etal-2024-one} and there is limited research on what personalization aspects each group expect. To address…

Computation and Language · Computer Science 2025-03-12 Ishani Mondal , Jack W. Stokes , Sujay Kumar Jauhar , Longqi Yang , Mengting Wan , Xiaofeng Xu , Xia Song , Jennifer Neville

Generative AI models differ from traditional machine learning tools in that they allow users to provide as much or as little information as they choose in their inputs. This flexibility often leads users to omit certain details, relying on…

Computer Science and Game Theory · Computer Science 2026-05-13 Charlotte Park , Kate Donahue , Manish Raghavan

Click-Through Rate (CTR) prediction, a core task in recommendation systems, aims to estimate the probability of users clicking on items. Existing models predominantly follow a discriminative paradigm, which relies heavily on explicit…

Information Retrieval · Computer Science 2025-12-17 Mingjia Yin , Junwei Pan , Hao Wang , Ximei Wang , Shangyu Zhang , Jie Jiang , Defu Lian , Enhong Chen

Generative AI has significantly changed industries by enabling text-driven image generation, yet challenges remain in achieving high-resolution outputs that align with fine-grained user preferences. Consequently, multi-round interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Kun Li , Jianhui Wang , Yangfan He , Xinyuan Song , Ruoyu Wang , Hongyang He , Wenxin Zhang , Jiaqi Chen , Keqin Li , Sida Li , Miao Zhang , Tianyu Shi , Xueqian Wang

Generative Reward Models (GRMs) provide greater flexibility than scalar reward models in capturing human preferences, but their effectiveness is limited by poor reasoning capabilities. This often results in incomplete or overly speculative…

Computation and Language · Computer Science 2025-06-23 Bin Chen , Xinzge Gao , Chuanrui Hu , Penghang Yu , Hua Zhang , Bing-Kun Bao

Reward Models (RMs) are critical components in the Reinforcement Learning from Human Feedback (RLHF) pipeline, directly determining the alignment quality of Large Language Models (LLMs). Recently, Generative Reward Models (GRMs) have…

Artificial Intelligence · Computer Science 2026-04-21 Kai Qin , Liangxin Liu , Yu Liang , Longzheng Wang , Yan Wang , Yueyang Zhang , Long Xia , Zhiyuan Sun , Houde Liu , Daiting Shi

Recommender systems in multi-behavior domains, such as advertising and e-commerce, aim to guide users toward high-value but inherently sparse conversions. Leveraging auxiliary behaviors (e.g., clicks, likes, shares) is therefore essential.…

Information Retrieval · Computer Science 2025-11-06 Zhefan Wang , Guokai Yan , Jinbei Yu , Siyu Gu , Jingyan Chen , Peng Jiang , Zhiqiang Guo , Min Zhang

In the combinatorial recommender systems, multiple items are fed to the user at one time in the result page, where the correlations among the items have impact on the user behavior. In this work, we model the combinatorial recommendation as…

Information Retrieval · Computer Science 2019-06-25 Fan Wang , Xiaomin Fang , Lihang Liu , Yaxue Chen , Jiucheng Tao , Zhiming Peng , Cihang Jin , Hao Tian

Iterative data generation and model re-training can effectively align large language models(LLMs) to human preferences. The process of data sampling is crucial, as it significantly influences the success of policy improvement. Repeated…

Computation and Language · Computer Science 2024-10-07 Hai Ye , Hwee Tou Ng

Recent advancements in retrieval-augmented generation (RAG) have enhanced large language models in question answering by integrating external knowledge. However, challenges persist in achieving global understanding and aligning responses…

Computation and Language · Computer Science 2025-06-24 Quanwei Tang , Sophia Yat Mei Lee , Junshuang Wu , Dong Zhang , Shoushan Li , Erik Cambria , Guodong Zhou

Large Language Models (LLMs) have become powerful foundations for generative recommender systems, framing recommendation tasks as text generation tasks. However, existing generative recommendation methods often rely on discrete ID-based…

Information Retrieval · Computer Science 2026-03-24 Jerome Ramos , Bin Wu , Aldo Lipani

Industrial-scale recommender systems rely on a cascade pipeline in which the retrieval stage must return a high-recall candidate set from billions of items under tight latency. Existing solutions either (i) suffer from limited…

Information Retrieval · Computer Science 2026-04-02 Yijia Sun , Shanshan Huang , Zhiyuan Guan , Qiang Luo , Ruiming Tang , Kun Gai , Guorui Zhou

A core objective in recommender systems is to accurately model the distribution of user preferences over items to enable personalized recommendations. Recently, driven by the strong generative capabilities of large language models (LLMs),…

Information Retrieval · Computer Science 2026-02-10 Yuanbo Zhao , Ruochen Liu , Senzhang Wang , Jun Yin , Yuxin Dong , Huan Gong , Hao Chen , Shirui Pan , Chengqi Zhang

Reward Modeling is critical in evaluating and improving the generation of Large Language Models (LLMs). While numerous recent works have shown its feasibility in improving safety, helpfulness, reasoning, and instruction-following ability,…

Computation and Language · Computer Science 2025-11-13 Hanning Zhang , Juntong Song , Juno Zhu , Yuanhao Wu , Tong Zhang , Cheng Niu

Reward models (RMs) are central to reinforcement learning from human feedback (RLHF), providing the critical supervision signals that align large language models (LLMs) with human preferences. Generative reward models (GRMs) provide greater…

Machine Learning · Computer Science 2026-04-21 Ai Jian , Jingqing Ruan , Xing Ma , Xiaoyun Zhang , Dailin Li , Weipeng Zhang , Ke Zeng , Xunliang Cai