English
Related papers

Related papers: Efficient Process Reward Model Training via Active…

200 papers

Process Reward Models (PRMs) have proven effective at enhancing mathematical reasoning for Large Language Models (LLMs) by leveraging increased inference-time computation. However, they are predominantly trained on mathematical data and…

While Multimodal Large Language Models (MLLMs) have achieved impressive progress in vision-language understanding, they still struggle with complex multi-step reasoning, often producing logically inconsistent or partially correct solutions.…

Artificial Intelligence · Computer Science 2025-06-06 Lingxiao Du , Fanqing Meng , Zongkai Liu , Zhixiang Zhou , Ping Luo , Qiaosheng Zhang , Wenqi Shao

Although Large Language Models (LLMs) exhibit advanced reasoning ability, conventional alignment remains largely dominated by outcome reward models (ORMs) that judge only final answers. Process Reward Models(PRMs) address this gap by…

Computation and Language · Computer Science 2026-04-30 Congmin Zheng , Jiachen Zhu , Zhuoying Ou , Yuxiang Chen , Kangning Zhang , Rong Shan , Zeyu Zheng , Mengyue Yang , Jianghao Lin , Yong Yu , Weinan Zhang

Recent advancements in Large Language Models (LLMs) have shown that it is promising to utilize Process Reward Models (PRMs) as verifiers to enhance the performance of LLMs. However, current PRMs face three key challenges: (1) limited…

Computation and Language · Computer Science 2025-04-08 Jian Zhao , Runze Liu , Kaiyan Zhang , Zhimu Zhou , Junqi Gao , Dong Li , Jiafei Lyu , Zhouyi Qian , Biqing Qi , Xiu Li , Bowen Zhou

Large Language Model (LLM) agents are increasingly deployed for complex, multi-step software engineering (SWE) tasks. However, their trajectories often contain costly inefficiencies, such as redundant exploration, looping, and failure to…

Artificial Intelligence · Computer Science 2025-10-22 Shubham Gandhi , Jason Tsay , Jatin Ganhotra , Kiran Kate , Yara Rizk

Large Language Models (LLMs) increasingly rely on external tools such as search engines to solve complex agentic tasks that require reasoning and external knowledge retrieval. Recently, reinforcement learning with verifiable rewards (RLVR)…

Artificial Intelligence · Computer Science 2025-10-01 Peiran Xu , Zhuohao Li , Xiaoying Xing , Guannan Zhang , Debiao Li , Kunyu Shi

Process Reward Models (PRMs) aim to improve multi-step reasoning in Large Language Models (LLMs) by supervising intermediate steps and identifying errors. However, building effective PRMs remains challenging due to the lack of scalable,…

Artificial Intelligence · Computer Science 2025-10-17 Yao Zhang , Yu Wu , Haowei Zhang , Weiguo Li , Haokun Chen , Jingpei Wu , Guohao Li , Zhen Han , Volker Tresp

Dense process rewards have proven a more effective alternative to the sparse outcome-level rewards in the inference-time scaling of large language models (LLMs), particularly in tasks requiring complex multi-step reasoning. While dense…

Process Reward Models (PRMs) have emerged as a promising approach for improving LLM reasoning capabilities by providing process supervision over reasoning traces. However, existing approaches for constructing PRM training data remain costly…

Computation and Language · Computer Science 2026-04-10 Ryo Kamoi , Yusen Zhang , Nan Zhang , Sarkar Snigdha Sarathi Das , Ranran Haoran Zhang , Wenpeng Yin , Rui Zhang

Fine-tuning Large Language Models (LLMs) typically relies on large quantities of high-quality annotated data, or questions with well-defined ground truth answers in the case of Reinforcement Learning with Verifiable Rewards (RLVR). While…

Artificial Intelligence · Computer Science 2026-04-21 Justin Bauer , Thomas Walshe , Derek Pham , Harit Vishwakarma , Armin Parchami , Frederic Sala , Paroma Varma

Test-time compute scaling allocates inference computation uniformly, uses fixed sampling strategies, and applies verification only for reranking. In contrast, we propose a verifier-guided adaptive framework treating reasoning as iterative…

Computation and Language · Computer Science 2026-04-08 Ahsan Bilal , Ahmed Mohsin , Muhammad Umer , Ali Subhan , Hassan Rizwan , Ayesha Mohsin , Dean Hougen

Process rewards have been widely used in deep reinforcement learning to improve training efficiency, reduce variance, and prevent reward hacking. In LLM reasoning, existing works also explore various solutions for learning effective process…

Machine Learning · Computer Science 2026-05-21 Xian Wu , Kaijie Zhu , Ying Zhang , Lun Wang , Wenbo Guo

Process Reward Models (PRMs) provide step-level feedback for reasoning, but current PRMs usually output only a single reward score for each step. Downstream methods must therefore treat imperfect step-level reward predictions as reliable…

Computation and Language · Computer Science 2026-05-18 Jinyuan Li , Langlin Huang , Chengsong Huang , Shaoyang Xu , Donghong Cai , Yuyi Yang , Wenxuan Zhang , Jiaxin Huang

Reasoning has substantially improved the performance of large language models (LLMs) on complicated tasks. Central to the current reasoning studies, Process Reward Models (PRMs) offer a fine-grained evaluation of intermediate reasoning…

Machine Learning · Computer Science 2025-11-05 Qi Cao , Ruiyi Wang , Ruiyi Zhang , Sai Ashish Somayajula , Pengtao Xie

Current approaches for training Process Reward Models (PRMs) often involve breaking down responses into multiple reasoning steps using rule-based techniques, such as using predefined placeholder tokens or setting the reasoning step's length…

Artificial Intelligence · Computer Science 2025-06-03 Yuliang Liu , Junjie Lu , Zhaoling Chen , Chaofeng Qu , Jason Klein Liu , Chonghan Liu , Zefan Cai , Yunhui Xia , Li Zhao , Jiang Bian , Chuheng Zhang , Wei Shen , Zhouhan Lin

The Process Reward Model (PRM) plays a crucial role in mathematical reasoning tasks, requiring high-quality supervised process data. However, we observe that reasoning steps generated by Large Language Models (LLMs) often fail to exhibit…

Artificial Intelligence · Computer Science 2025-08-25 Yulan Hu , Sheng Ouyang , Jinman Zhao , Yong Liu

Complex multi-step reasoning tasks, such as solving mathematical problems or generating code, remain a significant hurdle for even the most advanced large language models (LLMs). Verifying LLM outputs with an Outcome Reward Model (ORM) is a…

Computation and Language · Computer Science 2024-12-13 Liangchen Luo , Yinxiao Liu , Rosanne Liu , Samrat Phatale , Meiqi Guo , Harsh Lara , Yunxuan Li , Lei Shu , Yun Zhu , Lei Meng , Jiao Sun , Abhinav Rastogi

Achieving both accuracy and diverse reasoning remains challenging for Large Language Models (LLMs) in complex domains like mathematics. A key bottleneck is evaluating intermediate reasoning steps to guide generation without costly human…

Machine Learning · Computer Science 2025-10-14 Adam Younsi , Ahmed Attia , Abdalgader Abubaker , Mohamed El Amine Seddik , Hakim Hacid , Salem Lahlou

Process supervision, i.e., evaluating each step, is critical for complex large language model (LLM) reasoning and test-time searching with increased inference compute. Existing approaches, represented by process reward models (PRMs),…

Computation and Language · Computer Science 2025-03-07 Wenxiang Chen , Wei He , Zhiheng Xi , Honglin Guo , Boyang Hong , Jiazheng Zhang , Rui Zheng , Nijun Li , Tao Gui , Yun Li , Qi Zhang , Xuanjing Huang

Active learning is a paradigm aimed at reducing the annotation effort by training the model on actively selected informative and/or representative samples. Another paradigm to reduce the annotation effort is self-training that learns from a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Javad Zolfaghari Bengar , Joost van de Weijer , Bartlomiej Twardowski , Bogdan Raducanu