English
Related papers

Related papers: Reasoning While Recommending: Entropy-Guided Laten…

200 papers

Reinforcement learning with verifiable rewards (RLVR) has demonstrated superior performance in enhancing the reasoning capability of large language models (LLMs). However, this accuracy-oriented learning paradigm often suffers from entropy…

Artificial Intelligence · Computer Science 2026-01-19 Hongye Cao , Zhixin Bai , Ziyue Peng , Boyan Wang , Tianpei Yang , Jing Huo , Yuyao Zhang , Yang Gao

Alignment of large language models (LLMs) with human preferences typically relies on supervised reward models or external judges that demand abundant annotations. However, in fields that rely on professional knowledge, such as medicine and…

Artificial Intelligence · Computer Science 2025-11-18 Yiyang Zhao , Huiyu Bai , Xuejiao Zhao

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities in complex problem-solving tasks, sparking growing interest in their application to preference reasoning in recommendation systems. Existing methods typically…

Artificial Intelligence · Computer Science 2025-10-27 Yang Zhang , Wenxin Xu , Xiaoyan Zhao , Wenjie Wang , Fuli Feng , Xiangnan He , Tat-Seng Chua

Recent studies increasingly explore Large Language Models (LLMs) as a new paradigm for recommendation systems due to their scalability and world knowledge. However, existing work has three key limitations: (1) most efforts focus on…

Sequential recommender systems have become increasingly important in real-world applications that model user behavior sequences to predict their preferences. However, existing sequential recommendation methods predominantly rely on…

Information Retrieval · Computer Science 2025-06-05 Enze Liu , Bowen Zheng , Xiaolei Wang , Wayne Xin Zhao , Jinpeng Wang , Sheng Chen , Ji-Rong Wen

The effective training of Large Language Models (LLMs) for function calling faces a critical challenge: balancing exploration of complex reasoning paths with stable policy optimization. Standard methods like Supervised Fine-Tuning (SFT)…

Large Language Models (LLMs) have been integrated into recommender systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant items…

Information Retrieval · Computer Science 2025-03-27 Sichun Luo , Jian Xu , Xiaojie Zhang , Linrong Wang , Sicong Liu , Hanxu Hou , Linqi Song

Balancing exploration and exploitation is a central goal in reinforcement learning (RL). Despite recent advances in enhancing large language model (LLM) reasoning, most methods lean toward exploitation, and increasingly encounter…

Computation and Language · Computer Science 2025-11-11 Daixuan Cheng , Shaohan Huang , Xuekai Zhu , Bo Dai , Wayne Xin Zhao , Zhenliang Zhang , Furu Wei

Reinforcement Learning with Verifiable Rewards (RLVR) has become a central approach for improving the reasoning ability of large language models. Recent work studies RLVR through token entropy, arguing that high-entropy tokens drive…

Machine Learning · Computer Science 2025-12-02 Xinzhu Chen , Xuesheng Li , Zhongxiang Sun , Weijie Yu

Reinforcement learning with verifiable rewards (RLVR) has emerged as a prominent paradigm for enhancing the reasoning capabilities of large language models (LLMs). However, the entropy of LLMs usually collapses during RLVR training, leading…

Computation and Language · Computer Science 2026-04-21 Renren Jin , Pengzhi Gao , Yuqi Ren , Zhuowen Han , Tongxuan Zhang , Wuwei Huang , Wei Liu , Jian Luan , Deyi Xiong

Chain-of-thought (CoT) reasoning has become the default strategy for enhancing LLM capabilities, yet its application raises a fundamental question: when is explicit reasoning actually beneficial? Empirical evidence reveals a striking…

Machine Learning · Computer Science 2026-05-25 Wei Xia , Haoqing Wang , Zhi-Hong Deng , Yehui Tang

Reasoning ability has become a defining capability of Large Language Models (LLMs), with Reinforcement Learning with Verifiable Rewards (RLVR) emerging as a key paradigm to enhance it. However, RLVR training often suffers from policy…

Machine Learning · Computer Science 2026-04-20 Xiaoyun Zhang , Xiaojian Yuan , Di Huang , Wang You , Chen Hu , Jingqing Ruan , Ai Jian , Kejiang Chen , Xing Hu

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an indispensable paradigm for enhancing reasoning in Large Language Models (LLMs). However, standard policy optimization methods, such as Group Relative Policy…

Machine Learning · Computer Science 2026-02-09 Pengyi Li , Elizaveta Goncharova , Andrey Kuznetsov , Ivan Oseledets

Multimodal reward models are crucial for aligning multimodal large language models with human preferences. Recent works have incorporated reasoning capabilities into these models, achieving promising results. However, training these models…

Artificial Intelligence · Computer Science 2026-02-03 Shidong Yang , Tongwen Huang , Hao Wen , Yong Wang , Li Chen , Xiangxiang Chu

Large language models (LLMs) have shown promise in performing complex multi-step reasoning, yet they continue to struggle with mathematical reasoning, often making systematic errors. A promising solution is reinforcement learning (RL)…

Machine Learning · Computer Science 2025-09-22 Hanning Zhang , Pengcheng Wang , Shizhe Diao , Yong Lin , Rui Pan , Hanze Dong , Dylan Zhang , Pavlo Molchanov , Tong Zhang

Recent advancements in large language models (LLMs) often rely on generating intermediate reasoning steps to enhance accuracy. However, little work has examined how reasoning utility contributes to the final answer's correctness. Due to the…

Computation and Language · Computer Science 2025-08-29 Xu Guo

Large Reasoning Models (LRMs) often suffer from overthinking, generating unnecessarily long reasoning chains even for simple tasks. This leads to substantial computational overhead with limited performance gain, primarily due to redundant…

Artificial Intelligence · Computer Science 2026-01-13 Ruichu Cai , Haopeng Du , Qingwen Lin , Yutong Chen , Zijian Li , Boyan Xu

Recent advancements in the Generative Reward Model (GRM) have demonstrated its potential to enhance the reasoning abilities of LLMs through Chain-of-Thought (CoT) prompting. Despite these gains, existing implementations of GRM suffer from…

Computation and Language · Computer Science 2026-05-05 Chao Xue , Yao Wang , Mengqiao Liu , Di Liang , Xingsheng Han , Peiyang Liu , Xianjie Wu , Chenyao Lu , Lei Jiang , Yu Lu , Haibo Shi , Shuang Liang , Minlong Peng , Flora D. Salim

Recent breakthroughs in large language models (LLMs) have fundamentally shifted recommender systems from discriminative to generative paradigms, where user behavior modeling is achieved by generating target items conditioned on historical…

Information Retrieval · Computer Science 2025-10-15 Junfei Tan , Yuxin Chen , An Zhang , Junguang Jiang , Bin Liu , Ziru Xu , Han Zhu , Jian Xu , Bo Zheng , Xiang Wang

Reinforcement learning has become the central approach for language models (LMs) to learn from environmental reward or feedback. In practice, the environmental feedback is usually sparse and delayed. Learning from such signals is…

Machine Learning · Computer Science 2026-02-17 Taiwei Shi , Sihao Chen , Bowen Jiang , Linxin Song , Longqi Yang , Jieyu Zhao
‹ Prev 1 2 3 10 Next ›