English
Related papers

Related papers: From Clicks to Preference: A Multi-stage Alignment…

200 papers

We present a comprehensive framework for enhancing Retrieval-Augmented Generation (RAG) systems through dynamic retrieval strategies and reinforcement fine-tuning. This approach significantly improves large language models on…

Machine Learning · Computer Science 2025-05-21 Sakhinana Sagar Srinivas , Akash Das , Shivam Gupta , Venkataramana Runkana

Reward models (RMs) play a pivotal role in aligning large language models (LLMs) with human preferences. Due to the difficulty of obtaining high-quality human preference annotations, distilling preferences from generative LLMs has emerged…

Computation and Language · Computer Science 2026-01-21 Hongli Zhou , Hui Huang , Wei Liu , Chenglong Wang , Xingyuan Bu , Lvyuan Han , Fuhai Song , Muyun Yang , Wenhao Jiang , Hailong Cao , Tiejun Zhao

Reranking, as the final stage of recommender systems, plays a crucial role in determining the final exposure, directly influencing user experience. Recently, generative reranking has gained increasing attention for formulating reranking as…

Information Retrieval · Computer Science 2026-02-12 Qiya Yang , Xiaoxi Liang , Zeping Xiao , Ying Cao , Yingjie Deng , Yuxin Ren , Yalong Wang , Yongqi Liu

Large language model (LLM) agents typically adopt a step-by-step reasoning framework, in which they interleave the processes of thinking and acting to accomplish the given task. However, this paradigm faces a deep-rooted one-pass issue…

Computation and Language · Computer Science 2025-09-29 Xingzuo Li , Kehai Chen , Yunfei Long , Xuefeng Bai , Yong Xu , Min Zhang

Sequential recommender systems (SRS) have gained increasing popularity due to their remarkable proficiency in capturing dynamic user preferences. In the current setup of SRS, a common configuration is to uniformly consider each historical…

Information Retrieval · Computer Science 2025-06-03 Hao Zhang , Mingyue Cheng , Zhiding Liu , Junzhe Jiang

In the field of group recommendation systems (GRS), effectively addressing the diverse preferences of group members poses a significant challenge. Traditional GRS approaches often aggregate individual preferences into a collective group…

Information Retrieval · Computer Science 2025-03-18 Peijin Yu , Shin'ichi Konomi

Learning from preference feedback is essential for aligning large language models (LLMs) with human values and improving the quality of generated responses. However, existing preference learning methods rely heavily on curated data from…

Computation and Language · Computer Science 2025-06-06 Zhaoxuan Tan , Zheng Li , Tianyi Liu , Haodong Wang , Hyokun Yun , Ming Zeng , Pei Chen , Zhihan Zhang , Yifan Gao , Ruijie Wang , Priyanka Nigam , Bing Yin , Meng Jiang

Most universities in the United States encourage their students to explore academic areas before declaring a major and to acquire academic breadth by satisfying a variety of requirements. Each term, students must choose among many thousands…

Information Retrieval · Computer Science 2024-12-31 Hugh Van Deventer , Mark Mills , August Evrard

Reranking is attracting incremental attention in the recommender systems, which rearranges the input ranking list into the final rank-ing list to better meet user demands. Most existing methods greedily rerank candidates through the rating…

Information Retrieval · Computer Science 2021-04-08 Yufei Feng , Binbin Hu , Yu Gong , Fei Sun , Qingwen Liu , Wenwu Ou

Generative advertising in large language model (LLM) responses requires optimizing sponsorship configurations under two strict constraints: the strategic behavior of advertisers and the high cost of stochastic generations. To address this,…

Computer Science and Game Theory · Computer Science 2026-04-09 Jiayuan Liu , Barry Wang , Jiarui Gan , Tonghan Wang , Leon Xie , Mingyu Guo , Vincent Conitzer

Most existing news recommendation methods tackle this task by conducting semantic matching between candidate news and user representation produced by historical clicked news. However, they overlook the high-level connections among different…

Information Retrieval · Computer Science 2024-03-07 Shen Gao , Jiabao Fang , Quan Tu , Zhitao Yao , Zhumin Chen , Pengjie Ren , Zhaochun Ren

Algorithmic Recourse aims to provide actionable explanations, or recourse plans, to overturn potentially unfavourable decisions taken by automated machine learning models. In this paper, we propose an interaction paradigm based on a guided…

Human-Computer Interaction · Computer Science 2024-07-22 Seyedehdelaram Esfahani , Giovanni De Toni , Bruno Lepri , Andrea Passerini , Katya Tentori , Massimo Zancanaro

The emergence of generative models enables the creation of texts and images tailored to users' preferences. Existing personalized generative models have two critical limitations: lacking a dedicated paradigm for accurate preference…

Information Retrieval · Computer Science 2026-04-23 Yuting Zhang , Ying Sun , Dazhong Shen , Ziwei Xie , Feng Liu , Changwang Zhang , Xiang Liu , Jun Wang , Hui Xiong

While recent advancements in aligning Large Language Models (LLMs) with recommendation tasks have shown great potential and promising performance overall, these aligned recommendation LLMs still face challenges in complex scenarios. This is…

Information Retrieval · Computer Science 2025-02-18 Yi Fang , Wenjie Wang , Yang Zhang , Fengbin Zhu , Qifan Wang , Fuli Feng , Xiangnan He

Recommender systems are widely used to suggest engaging content, and Large Language Models (LLMs) have given rise to generative recommenders. Such systems can directly generate items, including for open-set tasks like question suggestion.…

Computation and Language · Computer Science 2024-06-11 Lütfi Kerem Senel , Besnik Fetahu , Davis Yoshida , Zhiyu Chen , Giuseppe Castellucci , Nikhita Vedula , Jason Choi , Shervin Malmasi

Reward models (RMs) play a crucial role in Reinforcement Learning from Human Feedback by serving as proxies for human preferences in aligning large language models. However, they suffer from various biases which could lead to reward…

Artificial Intelligence · Computer Science 2026-03-18 Xiao Zhu , Chenmien Tan , Pinzhen Chen , Rico Sennrich , Huiming Wang , Yanlin Zhang , Hanxu Hu

Recently, the personalization of Large Language Models (LLMs) to generate content that aligns with individual user preferences has garnered widespread attention. Personalized Retrieval-Augmented Generation (RAG), which retrieves relevant…

Information Retrieval · Computer Science 2025-04-09 Teng Shi , Jun Xu , Xiao Zhang , Xiaoxue Zang , Kai Zheng , Yang Song , Han Li

Recent advances in Large Language Models (LLMs) have driven their adoption in recommender systems through Retrieval-Augmented Generation (RAG) frameworks. However, existing RAG approaches predominantly rely on flat, similarity-based…

Information Retrieval · Computer Science 2025-06-10 Vahid Azizi , Fatemeh Koochaki

Despite the promise of Retrieval-Augmented Generation in grounding Multimodal Large Language Models with external knowledge, the transition to extensive contexts often leads to significant attention dilution and reasoning hallucinations.…

Computation and Language · Computer Science 2026-03-10 Junming Liu , Yuqi Li , Shiping Wen , Zhigang Zeng , Tingwen Huang

Aligning large language models (LLMs) with human values and safety constraints is challenging, especially when objectives like helpfulness, truthfulness, and avoidance of harm conflict. Reinforcement Learning from Human Feedback (RLHF) has…

Computation and Language · Computer Science 2025-03-31 Xuying Li , Zhuo Li , Yuji Kosuga , Victor Bian