English
Related papers

Related papers: Rank-GRPO: Training LLM-based Conversational Recom…

200 papers

Large Language Models (LLMs) are emerging as promising approaches to enhance session-based recommendation (SBR), where both prompt-based and fine-tuning-based methods have been widely investigated to align LLMs with SBR. However, the former…

Artificial Intelligence · Computer Science 2024-04-22 Ziyan Wang , Yingpeng Du , Zhu Sun , Haoyan Chua , Kaidong Feng , Wenya Wang , Jie Zhang

In search settings, calibrating the scores during the ranking process to quantities such as click-through rates or relevance levels enhances a system's usefulness and trustworthiness for downstream users. While previous research has…

Information Retrieval · Computer Science 2024-08-28 Puxuan Yu , Daniel Cohen , Hemank Lamba , Joel Tetreault , Alex Jaimes

A recent Large language model (LLM)-based recommendation model, called RecRanker, has demonstrated a superior performance in the top-k recommendation task compared to other models. In particular, RecRanker samples users via clustering,…

Information Retrieval · Computer Science 2025-07-09 Zeyuan Meng , Zixuan Yi , Iadh Ounis

Training robust and generalizable reward models for human visual preferences is essential for aligning text-to-image and text-to-video generative models with human intent. However, current reward models often fail to generalize, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Alexander Gambashidze , Li Pengyi , Matvey Skripkin , Andrey Galichin , Anton Gusarov , Konstantin Sobolev , Andrey Kuznetsov , Ivan Oseledets

Large Language Models (LLMs), despite their remarkable capabilities, are prone to generating hallucinated or outdated content due to their static internal knowledge. While Retrieval-Augmented Generation (RAG) integrated with Reinforcement…

Computation and Language · Computer Science 2026-01-14 Zhiwen Tan , Jiaming Huang , Qintong Wu , Hongxuan Zhang , Chenyi Zhuang , Jinjie Gu

Large language models (LLMs) are increasingly deployed for tasks requiring complex reasoning, prompting significant interest in improving their reasoning abilities through post-training. Especially RL based methods using verifiable reward,…

Machine Learning · Computer Science 2025-10-02 Prasanna Parthasarathi , Mathieu Reymond , Boxing Chen , Yufei Cui , Sarath Chandar

Reinforcement Learning (RL)-based recommender systems have demonstrated promising performance in meeting user expectations by learning to make accurate next-item recommendations from historical user-item interactions. However, existing…

Information Retrieval · Computer Science 2024-03-26 Jie Wang , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

With the rapid development of online services, recommender systems (RS) have become increasingly indispensable for mitigating information overload. Despite remarkable progress, conventional recommendation models (CRM) still have some…

Information Retrieval · Computer Science 2024-07-10 Jianghao Lin , Xinyi Dai , Yunjia Xi , Weiwen Liu , Bo Chen , Hao Zhang , Yong Liu , Chuhan Wu , Xiangyang Li , Chenxu Zhu , Huifeng Guo , Yong Yu , Ruiming Tang , Weinan Zhang

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an indispensable paradigm for enhancing reasoning in Large Language Models (LLMs). However, standard policy optimization methods, such as Group Relative Policy…

Machine Learning · Computer Science 2026-02-09 Pengyi Li , Elizaveta Goncharova , Andrey Kuznetsov , Ivan Oseledets

Large Vision-Language Models (LVLMs) or multimodal large language models represent a significant advancement in artificial intelligence, enabling systems to understand and generate content across both visual and textual modalities. While…

Machine Learning · Computer Science 2025-09-09 Thanh Thi Nguyen , Campbell Wilson , Janis Dalins

Group Relative Policy Optimization (GRPO) has proven to be an effective tool for post-training language models (LMs). However, AI systems are increasingly expressed as modular programs that mix together multiple LM calls with distinct…

Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning, generalization, and simulating human-like behavior across a wide range of tasks. These strengths present new opportunities to enhance traditional…

Information Retrieval · Computer Science 2025-12-01 Nachiket Subbaraman , Jaskinder Sarai , Aniruddh Nath , Lichan Hong , Lukasz Heldt , Li Wei , Zhe Zhao

Reinforcement learning (RL) enhanced large language models (LLMs), particularly exemplified by DeepSeek-R1, have exhibited outstanding performance. Despite the effectiveness in improving LLM capabilities, its implementation remains highly…

Computation and Language · Computer Science 2025-02-25 Shuhe Wang , Shengyu Zhang , Jie Zhang , Runyi Hu , Xiaoya Li , Tianwei Zhang , Jiwei Li , Fei Wu , Guoyin Wang , Eduard Hovy

The widespread adoption of Large Language Models (LLMs) as re-rankers is shifting recommender systems towards a user-centric paradigm. However, a significant gap remains: current re-rankers often lack mechanisms for fine-grained user…

Information Retrieval · Computer Science 2025-11-25 Wenxi Dai , Wujiang Xu , Pinhuan Wang , Dimitris N. Metaxas

The reasoning capabilities of large reasoning models (LRMs), such as OpenAI's o1 and DeepSeek-R1, have seen substantial advancements through deep thinking. However, these enhancements come with significant resource demands, underscoring the…

Computation and Language · Computer Science 2025-11-04 Wenrui Cai , Chengyu Wang , Junbing Yan , Jun Huang , Xiangzhong Fang

Understanding what users like is relatively straightforward; understanding what users dislike, however, remains a challenging and underexplored problem. Research into users' negative preferences has gained increasing importance in modern…

Information Retrieval · Computer Science 2026-01-23 Xinda Chen , Jiawei Wu , Yishuang Liu , Jialin Zhu , Shuwen Xiao , Junjun Zheng , Xiangheng Kong , Yuning Jiang

Recently, sequential recommendation has been adapted to the LLM paradigm to enjoy the power of LLMs. LLM-based methods usually formulate recommendation information into natural language and the model is trained to predict the next item in…

Information Retrieval · Computer Science 2024-02-16 Hanbing Wang , Xiaorui Liu , Wenqi Fan , Xiangyu Zhao , Venkataramana Kini , Devendra Yadav , Fei Wang , Zhen Wen , Jiliang Tang , Hui Liu

Retrieval-Augmented Generation (RAG) expands the knowledge of Large Language Models (LLMs), yet current static retrieval methods struggle with complex, multi-hop problems. While recent dynamic retrieval strategies offer improvements, they…

Computation and Language · Computer Science 2026-04-23 Haijian Liang , Zenghao Niu , Junjie Wu , Changwang Zhang , Wangchunshu Zhou , Jun Wang

Sequential recommendation aims to predict users' future interactions by modeling collaborative filtering (CF) signals from historical behaviors of similar users or items. Traditional sequential recommenders predominantly rely on ID-based…

Information Retrieval · Computer Science 2025-06-30 Yingzhi He , Xiaohao Liu , An Zhang , Yunshan Ma , Tat-Seng Chua

Recent advances in large language models (LLMs) highlight the importance of post training techniques for improving reasoning and mathematical ability. Group Relative Policy Optimization (GRPO) has shown promise in this domain by combining…

Machine Learning · Computer Science 2026-03-20 Gabriele Carrino , Andrea Sassella , Nicolo Brunello , Federico Toschi , Mark James Carman