English
Related papers

Related papers: Rank-GRPO: Training LLM-based Conversational Recom…

200 papers

Sequential recommendation problems have received increasing attention in research during the past few years, leading to the inception of a large variety of algorithmic approaches. In this work, we explore how large language models (LLMs),…

Information Retrieval · Computer Science 2023-09-19 Jesse Harte , Wouter Zorgdrager , Panos Louridas , Asterios Katsifodimos , Dietmar Jannach , Marios Fragkoulis

Large Language Models (LLMs) have emerged as powerful tools for passage reranking in information retrieval, leveraging their superior reasoning capabilities to address the limitations of conventional models on complex queries. However,…

Information Retrieval · Computer Science 2026-05-01 Meixiu Long , Duolin Sun , Dan Yang , Yihan Jiao , Lei Liu , Jiahai Wang , BinBin Hu , Yue Shen , Jie Feng , Zhehao Tan , Junjie Wang , Lianzhen Zhong , Jian Wang , Peng Wei , Jinjie Gu

Recently, competition in the field of artificial intelligence (AI) has intensified among major technological companies, resulting in the continuous release of new large-language models (LLMs) that exhibit improved language understanding and…

Information Retrieval · Computer Science 2025-07-29 Sinnyum Choi , Woong Kim

Large Language Models (LLMs) have recently demonstrated strong potential in generating 'believable human-like' behavior in web environments. Prior work has explored augmenting training data with LLM-synthesized rationales and applying…

Large Vision-Language Models (LVLMs) typically follow a two-stage training paradigm-pretraining and supervised fine-tuning. Recently, preference optimization, derived from the language domain, has emerged as an effective post-training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yufei Zhan , Yousong Zhu , Shurong Zheng , Hongyin Zhao , Fan Yang , Ming Tang , Jinqiao Wang

Long chain-of-thought (CoT) significantly enhances the reasoning capabilities of large language models (LLMs). However, extensive reasoning traces lead to inefficiencies and increased time-to-first-token (TTFT). We propose a training…

Computation and Language · Computer Science 2026-01-08 Roy Xie , David Qiu , Deepak Gopinath , Dong Lin , Yanchao Sun , Chong Wang , Saloni Potdar , Bhuwan Dhingra

Recently, online Reinforcement Learning with Verifiable Rewards (RLVR) has become a key paradigm for enhancing the reasoning capabilities of Large Language Models (LLMs). However, existing methods typically treat all training samples…

Artificial Intelligence · Computer Science 2025-09-30 Shijie Zhang , Guohao Sun , Kevin Zhang , Xiang Guo , Rujun Guo

We deploy large language models (LLMs) as business development (BD) agents for persuasive price negotiation in online travel agencies (OTAs). The agent must follow a multi-stage Standard Operating Procedure (SOP) and strict guardrails (no…

Computation and Language · Computer Science 2026-04-30 Xia Zeng , Yihan Chen , Luhui Liu , Chao Luo , Ye Chen , Zhuoran Zhuang

The adoption of large language models (LLMs) as rerankers in multi-stage retrieval systems has gained significant traction in academia and industry. These models refine a candidate list of retrieved documents, often through carefully…

Information Retrieval · Computer Science 2025-05-27 Sahel Sharifymoghaddam , Ronak Pradeep , Andre Slavescu , Ryan Nguyen , Andrew Xu , Zijian Chen , Yilin Zhang , Yidi Chen , Jasper Xian , Jimmy Lin

Conversational recommender systems (CRSs) enhance recommendation quality by engaging users in multi-turn dialogues, capturing nuanced preferences through natural language interactions. However, these systems often face the false negative…

Information Retrieval · Computer Science 2025-08-11 Haozhe Xu , Xiaohua Wang , Changze Lv , Xiaoqing Zheng

RLVR has become a widely adopted paradigm for improving LLMs' reasoning capabilities, and GRPO is one of its most representative algorithms. In this paper, we first show that GRPO admits an equivalent discriminative reformulation as a…

Machine Learning · Computer Science 2026-05-19 Feng Zhang , Xinhong Ma , Ziqiang Dong , Xi Leng , Jianfei Zhao , Xin Sun , Yang Yang , Guanjun Jiang

The integration of Large Language Model (LLM) agents is transforming recommender systems from simple query-item matching towards deeply personalized and interactive recommendations. Reinforcement Learning (RL) provides an essential…

Large language models (LLMs) have demonstrated remarkable advances in reasoning capabilities. However, their performance remains constrained by limited access to explicit and structured domain knowledge. Retrieval-Augmented Generation (RAG)…

Computation and Language · Computer Science 2025-10-20 Junlin Wu , Xianrui Zhong , Jiashuo Sun , Bolian Li , Bowen Jin , Jiawei Han , Qingkai Zeng

Reinforcement learning for multi-step reasoning with large language models (LLMs) typically relies on sparse terminal rewards, which creates a poorly conditioned credit-assignment problem: the final feedback is propagated uniformly across…

Machine Learning · Computer Science 2026-05-26 Fei Ding , Yongkang Zhang , youwei wang , Zijian Zeng

Reinforcement learning in open-ended long-form generation is challenging because reliable reference answers and automatic metrics are often unavailable. Existing rubric-based methods typically rely on pointwise LLM-as-a-judge scoring, but…

Computation and Language · Computer Science 2026-05-27 Zixuan Yang , Yiqun Chen , Wei Yang , Erhan Zhang , Zihan Shen , Xiaochi Wei , Yan Gao , Yi Wu , Yao Hu , Jiaxin Mao

Reranking is a critical component in recommender systems, playing an essential role in refining the output of recommendation algorithms. Traditional reranking models have focused predominantly on accuracy, but modern applications demand…

Information Retrieval · Computer Science 2025-02-04 Jingtong Gao , Bo Chen , Weiwen Liu , Xiangyang Li , Yichao Wang , Wanyu Wang , Huifeng Guo , Ruiming Tang , Xiangyu Zhao

Large Language Models (LLMs) have revolutionized artificial intelligence with capabilities in reasoning, coding, and communication, driving innovation across industries. Their true potential depends on effective alignment to ensure correct,…

Computation and Language · Computer Science 2025-07-25 Bowen Jin , Jinsung Yoon , Zhen Qin , Ziqi Wang , Wei Xiong , Yu Meng , Jiawei Han , Sercan O. Arik

Recent works have demonstrated the effectiveness of reinforcement learning (RL)-based post-training for enhancing the reasoning capabilities of large language models (LLMs). In particular, Group Relative Policy Optimization (GRPO) has shown…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Jinyoung Park , Jeehye Na , Jinyoung Kim , Hyunwoo J. Kim

Recent advancements in Large Language Models(LLMs) have demonstrated their capabilities not only in reasoning but also in invoking external tools, particularly search engines. However, teaching models to discern when to invoke search and…

Computation and Language · Computer Science 2025-05-14 Zeyang Sha , Shiwen Cui , Weiqiang Wang

Recommender systems (RSs) have become an inseparable part of our everyday lives. They help us find our favorite items to purchase, our friends on social networks, and our favorite movies to watch. Traditionally, the recommendation problem…

Information Retrieval · Computer Science 2022-06-09 M. Mehdi Afsar , Trafford Crump , Behrouz Far