English
Related papers

Related papers: GM-PRM: A Generative Multimodal Process Reward Mod…

200 papers

Process Reward Models (PRMs) supervise intermediate reasoning steps in large language models (LLMs), but existing PRMs are mainly trained on general-domain data and struggle with the structured, symbolic, and fact-sensitive nature of…

Computation and Language · Computer Science 2026-05-05 Jie Zhu , Yuanchen Zhou , Shuo Jiang , Junhui Li , Lifan Guo , Feng Chen , Chi Zhang

Process Reward Models (PRMs) are crucial for guiding Large Language Models (LLMs) in complex scenarios by providing dense reward signals. However, existing PRMs primarily rely on heuristic approaches, which struggle with cross-domain…

Computation and Language · Computer Science 2025-07-25 Zhangyue Yin , Qiushi Sun , Zhiyuan Zeng , Qinyuan Cheng , Xipeng Qiu , Xuanjing Huang

In multi-hop question answering (MHQA) tasks, Chain of Thought (CoT) improves the quality of generation by guiding large language models (LLMs) through multi-step reasoning, and Knowledge Graphs (KGs) reduce hallucinations via semantic…

Computation and Language · Computer Science 2025-12-02 Xinyi Wang , Yiping Song , Zhiliang Tian , Bo Liu , Tingjin Luo , Minlie Huang

Hallucinations in large language models (LLMs) pose significant challenges in tasks requiring complex multi-step reasoning, such as mathematical problem-solving. Existing approaches primarily detect the presence of hallucinations but lack a…

Computation and Language · Computer Science 2025-09-19 Ruosen Li , Ziming Luo , Xinya Du

The Process Reward Model (PRM) plays a crucial role in mathematical reasoning tasks, requiring high-quality supervised process data. However, we observe that reasoning steps generated by Large Language Models (LLMs) often fail to exhibit…

Artificial Intelligence · Computer Science 2025-08-25 Yulan Hu , Sheng Ouyang , Jinman Zhao , Yong Liu

Retrieval-Augmented Generation (RAG) systems for Large Language Models (LLMs) hold promise in knowledge-intensive tasks but face limitations in complex multi-step reasoning. While recent methods have integrated RAG with chain-of-thought…

Computation and Language · Computer Science 2025-01-15 Zhongxiang Sun , Qipeng Wang , Weijie Yu , Xiaoxue Zang , Kai Zheng , Jun Xu , Xiao Zhang , Song Yang , Han Li

Recent work increasingly focuses on improving the reasoning capabilities of Multimodal Large Language Models (MLLMs). Among existing methods, Process Reward Models (PRMs) stand out for offering dense, step-wise supervision to guide…

Multimodal Large Language Models (MLLMs) are making significant progress in multimodal reasoning. Early approaches focus on pure text-based reasoning. More recent studies have incorporated multimodal information into the reasoning steps;…

Artificial Intelligence · Computer Science 2026-04-21 Dongjie Cheng , Yongqi Li , Zhixin Ma , Hongru Cai , Yupeng Hu , Wenjie Wang , Liqiang Nie , Wenjie Li

Process Reward Models (PRMs) have achieved remarkable success in augmenting the reasoning capabilities of Large Language Models (LLMs) within static domains such as mathematics. However, their potential in dynamic data analysis tasks…

Computation and Language · Computer Science 2026-04-28 Zhisong Qiu , Shuofei Qiao , Kewei Xu , Yuqi Zhu , Lun Du , Ningyu Zhang , Huajun Chen

Process reward models (PRMs) enhance complex reasoning in large language models (LLMs) by evaluating candidate solutions step-by-step and selecting answers based on aggregated step scores. While effective in domains such as mathematics,…

Computation and Language · Computer Science 2026-01-26 Lei Tang , Wei Zhou , Mohsen Mesgar

Large language models have shown promise in clinical decision making, but current approaches struggle to localize and correct errors at specific steps of the reasoning process. This limitation is critical in medicine, where identifying and…

While Large Language Models (LLMs) have demonstrated strong math reasoning abilities through Reinforcement Learning with *Verifiable Rewards* (RLVR), many advanced mathematical problems are proof-based, with no guaranteed way to determine…

Computation and Language · Computer Science 2026-02-20 Haotong Yang , Zitong Wang , Shijia Kang , Siqi Yang , Wenkai Yu , Xu Niu , Yike Sun , Yi Hu , Zhouchen Lin , Muhan Zhang

The primary obstacle for applying reinforcement learning (RL) to real-world robotics is the design of effective reward functions. While recently learning-based Process Reward Models (PRMs) are a promising direction, they are often hindered…

Code generation is a core application of large language models (LLMs), yet LLMs still frequently fail on complex programming tasks. Given its success in mathematical reasoning, test-time scaling approaches such as Process Reward Model…

Machine Learning · Computer Science 2026-02-02 Ruiyi Zhang , Peijia Qin , Qi Cao , Eric Xue , Pengtao Xie

Large Language Models (LLMs) have shown promising capabilities for solving Operations Research (OR) problems. While reinforcement learning serves as a powerful paradigm for LLM training on OR problems, existing works generally face two key…

Artificial Intelligence · Computer Science 2025-10-03 Chenyu Zhou , Tianyi Xu , Jianghao Lin , Dongdong Ge

Recent advancements in reinforcement learning with verifiable rewards (RLVR) have significantly improved the complex reasoning ability of vision-language models (VLMs). However, its outcome-level supervision is too coarse to diagnose and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yingqian Min , Kun Zhou , Yifan Li , Yuhuan Wu , Han Peng , Yifan Du , Wayne Xin Zhao , Min Yang , Ji-Rong Wen

Recent advances in large language models (LLMs) have significantly improved performance on the Text-to-SQL task by leveraging their powerful reasoning capabilities. To enhance accuracy during the reasoning process, external Process Reward…

Computation and Language · Computer Science 2025-05-20 Yuxin Zhang , Meihao Fan , Ju Fan , Mingyang Yi , Yuyu Luo , Jian Tan , Guoliang Li

Automating radiology report generation with Large Vision-Language Models (LVLMs) holds great potential, yet these models often produce clinically critical hallucinations, posing serious risks. Existing hallucination detection methods…

Computation and Language · Computer Science 2025-10-28 Alois Thomas , Maya Varma , Jean-Benoit Delbrouck , Curtis P. Langlotz

Process supervision, i.e., evaluating each step, is critical for complex large language model (LLM) reasoning and test-time searching with increased inference compute. Existing approaches, represented by process reward models (PRMs),…

Computation and Language · Computer Science 2025-03-07 Wenxiang Chen , Wei He , Zhiheng Xi , Honglin Guo , Boyang Hong , Jiazheng Zhang , Rui Zheng , Nijun Li , Tao Gui , Yun Li , Qi Zhang , Xuanjing Huang

Process Reward Model (PRM) is widely used in the post-training of Large Language Model (LLM) because it can perform fine-grained evaluation of the reasoning steps of generated content. However, most PRMs lack long-term reasoning and deep…

Machine Learning · Computer Science 2026-05-22 Xinquan Chen , Chongying Yue , Bangwei Liu , Xuhong Wang , Yingchun Wang , Chaochao Lu