English
Related papers

Related papers: IB-GRPO: Aligning LLM-based Learning Path Recommen…

200 papers

Reinforcement learning with verifiable reward has recently emerged as a central paradigm for post-training large language models (LLMs); however, prevailing mean-based methods, such as Group Relative Policy Optimization (GRPO), suffer from…

Machine Learning · Computer Science 2025-10-02 Tao Ren , Jinyang Jiang , Hui Yang , Wan Tian , Minhao Zou , Guanghao Li , Zishi Zhang , Qinghao Wang , Shentao Qin , Yanjun Zhao , Rui Tao , Hui Shao , Yijie Peng

Matching job descriptions (JDs) with suitable talent requires models capable of understanding not only textual similarities between JDs and candidate resumes but also contextual factors such as geographical location and academic seniority.…

Computation and Language · Computer Science 2025-03-17 Yafei Zhang , Murray Wang , Yu Wang , Xiaohui Wang

Reinforcement learning has become the primary paradigm for aligning large language models (LLMs) on complex reasoning tasks, with group relative policy optimization (GRPO) widely used in large-scale post-training. However, GRPO faces…

Machine Learning · Computer Science 2026-01-08 Amir Hossein Yari , Fajri Koto

Direct Preference Optimization (DPO) is broadly utilized for aligning Large Language Models (LLMs) with human values because of its flexibility. Despite its effectiveness, it has been observed that the capability of DPO to generate…

Machine Learning · Computer Science 2025-05-20 Wenqiao Zhu , Ji Liu , Lulu Wang , Jun Wu , Yulun Zhang

Large Language Model (LLM) personalization aims to align model behaviors with individual user preferences. Existing methods often focus on isolated user histories, neglecting the essential role of inter-user differences. We propose C-BPO, a…

Computation and Language · Computer Science 2026-05-12 Xilai Ma , Liye Zhao , Weijun Yao , Haibing Di , Wenya Wang , Jing Li

Aligning language models (LMs) with curated human feedback is critical to control their behaviors in real-world applications. Several recent policy optimization methods, such as DPO and SLiC, serve as promising alternatives to the…

Computation and Language · Computer Science 2025-01-28 Tianqi Liu , Zhen Qin , Junru Wu , Jiaming Shen , Misha Khalman , Rishabh Joshi , Yao Zhao , Mohammad Saleh , Simon Baumgartner , Jialu Liu , Peter J. Liu , Xuanhui Wang

Large reasoning models (LRMs) generate intermediate reasoning traces before producing final answers, yielding strong gains on multi-step and mathematical tasks. Yet aligning LRMs with human preferences, a crucial prerequisite for model…

Machine Learning · Computer Science 2025-10-07 Mingkang Zhu , Xi Chen , Bei Yu , Hengshuang Zhao , Jiaya Jia

The task adaptation and alignment of Large Multimodal Models (LMMs) have been significantly advanced by instruction tuning and further strengthened by recent preference optimization. Yet, most LMMs still suffer from severe modality…

Machine Learning · Computer Science 2025-10-10 Chenxi Liu , Tianyi Xiong , Yanshuo Chen , Ruibo Chen , Yihan Wu , Junfeng Guo , Tianyi Zhou , Heng Huang

Post-training plays a crucial role in refining and aligning large language models to meet specific tasks and human preferences. While recent advancements in post-training techniques, such as Group Relative Policy Optimization (GRPO),…

Artificial Intelligence · Computer Science 2025-10-28 Kaichen Zhang , Yuzhong Hong , Junwei Bao , Hongfei Jiang , Yang Song , Dingqian Hong , Hui Xiong

Self-supervised reinforcement learning (RL) presents a promising approach for enhancing the reasoning capabilities of Large Language Models (LLMs) without reliance on expensive human-annotated data. However, we find that existing methods…

Artificial Intelligence · Computer Science 2025-12-16 Bizhe Bai , Hongming Wu , Peng Ye , Tao Chen

Automatic prompt optimization is an important approach to improving the performance of large language models (LLMs). Recent research demonstrates the potential of using LLMs as prompt optimizers, which can generate improved task prompts via…

Computation and Language · Computer Science 2025-01-28 Xinyu Tang , Xiaolei Wang , Wayne Xin Zhao , Siyuan Lu , Yaliang Li , Ji-Rong Wen

Recently, there has been a growing interest in leveraging Large Language Models (LLMs) for recommendation systems, which usually adapt a pre-trained LLM to the recommendation scenario through supervised fine-tuning (SFT). However, both the…

Information Retrieval · Computer Science 2024-10-17 Jiayi Liao , Xiangnan He , Ruobing Xie , Jiancan Wu , Yancheng Yuan , Xingwu Sun , Zhanhui Kang , Xiang Wang

Large language models (LLMs), despite their extensive pretraining on diverse datasets, require effective alignment to human preferences for practical and reliable deployment. Conventional alignment methods typically employ off-policy…

Computation and Language · Computer Science 2025-07-29 Hyeonji Lee , Daejin Jo , Seohwan Yun , Sungwoong Kim

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) for Large Language Model (LLM) reasoning have been hindered by a persistent challenge: exploration collapse. The semantic homogeneity of random rollouts often traps…

Machine Learning · Computer Science 2026-01-12 Huilin Deng , Hongchen Luo , Yue Zhu , Long Li , Zhuoyue Chen , Xinghao Zhao , Ming Li , Jihai Zhang , Mengchang Wang , Yang Cao , Yu Kang

Recent advances in large language models (LLMs) have shown strong reasoning capabilities through large-scale pretraining and post-training reinforcement learning, demonstrated by DeepSeek-R1. However, current post-training methods, such as…

Artificial Intelligence · Computer Science 2025-12-04 Boyang Gu , Hongjian Zhou , Bradley Max Segal , Jinge Wu , Zeyu Cao , Hantao Zhong , Lei Clifton , Fenglin Liu , David A. Clifton

Recent advancements in Recommender Systems (RS) have incorporated Reinforcement Learning (RL), framing the recommendation as a Markov Decision Process (MDP). However, offline RL policies trained on static user data are vulnerable to…

Information Retrieval · Computer Science 2025-01-24 Jie Wang , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a promising approach to improve the reasoning abilities of Large Language Models (LLMs). Among RLVR algorithms, Group Relative Policy Optimization (GRPO) and its variants…

Artificial Intelligence · Computer Science 2026-04-21 Zhaokang Liao , Yingguo Gao , Yi Yang , Yongheng Hu , Jingting Ding

Group relative policy optimization (GRPO) has become a standard post-training paradigm for improving reasoning and preference alignment in large language models (LLMs), and has recently shown strong effectiveness in LLM-based recommender…

Information Retrieval · Computer Science 2026-03-09 Yu Wang , Yonghui Yang , Le Wu , Jiancan Wu , Hefei Xu , Hui Lin

Training Large Language Models (LLMs) for multi-turn Tool-Integrated Reasoning (TIR) - where models iteratively reason, generate code, and verify through execution - remains challenging for existing reinforcement learning (RL) approaches.…

Machine Learning · Computer Science 2026-04-21 Yifeng Ding , Hung Le , Songyang Han , Kangrui Ruan , Zhenghui Jin , Varun Kumar , Zijian Wang , Anoop Deoras

Reinforcement Learning with Human Feedback (RLHF) has been the dominant approach for improving the reasoning capabilities of Large Language Models (LLMs). Recently, Reinforcement Learning with Verifiable Rewards (RLVR) has simplified this…

Computation and Language · Computer Science 2025-10-10 Yining Wang , Jinman Zhao , Chuangxin Zhao , Shuhao Guan , Gerald Penn , Shinan Liu