English
Related papers

Related papers: DPRM: A Dual Implicit Process Reward Model in Mult…

200 papers

MLLM reasoning has drawn widespread research for its excellent problem-solving capability. Current reasoning methods fall into two types: PRM, which supervises the intermediate reasoning steps, and ORM, which supervises the final results.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Qihan Huang , Weilong Dai , Jinlong Liu , Wanggui He , Hao Jiang , Mingli Song , Jingyuan Chen , Chang Yao , Jie Song

Reward models are critical for reinforcement learning from human feedback, as they determine the alignment quality and reliability of generative models. For complex tasks such as image editing, reward models are required to capture global…

Large language models (LLMs) have demonstrated remarkable capabilities in tasks requiring reasoning and multi-step problem-solving through the use of chain-of-thought (CoT) prompting. However, generating the full CoT process results in…

Computation and Language · Computer Science 2024-09-16 Tianqiao Liu , Zui Chen , Zitao Liu , Mi Tian , Weiqi Luo

Recent studies on post-training large language models (LLMs) for reasoning through reinforcement learning (RL) typically focus on tasks that can be accurately verified and rewarded, such as solving math problems. In contrast, our research…

Computation and Language · Computer Science 2025-05-29 Ang Lv , Ruobing Xie , Xingwu Sun , Zhanhui Kang , Rui Yan

Understanding complex biomolecular mechanisms requires multi-step reasoning across molecular interactions, signaling cascades, and metabolic pathways. While large language models(LLMs) show promise in such tasks, their application to…

Artificial Intelligence · Computer Science 2025-11-12 Tianwen Lyu , Xiang Zhuang , Keyan Ding , Xinzhe Cao , Lei Liang , Wei Zhao , Qiang Zhang , Huajun Chen

Recent advancements in reinforcement learning with verifiable rewards (RLVR) have significantly improved the complex reasoning ability of vision-language models (VLMs). However, its outcome-level supervision is too coarse to diagnose and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yingqian Min , Kun Zhou , Yifan Li , Yuhuan Wu , Han Peng , Yifan Du , Wayne Xin Zhao , Min Yang , Ji-Rong Wen

Chain-of-Thought (CoT) prompting has significantly improved the reasoning capabilities of large language models (LLMs). However, conventional CoT often relies on unstructured, flat reasoning chains that suffer from redundancy and suboptimal…

Computation and Language · Computer Science 2026-04-02 Xingshuai Huang , Derek Li , Bahareh Nikpour , Parsa Omidi

Reinforcement learning with verifiable outcome rewards (RLVR) has effectively scaled up chain-of-thought (CoT) reasoning in large language models (LLMs). Yet, its efficacy in training vision-language model (VLM) agents for goal-directed…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Tong Wei , Yijun Yang , Junliang Xing , Yuanchun Shi , Zongqing Lu , Deheng Ye

Reward models are central to both reinforcement learning (RL) with language models and inference-time verification. However, existing reward models often lack temporal consistency, leading to ineffective policy updates and unstable RL…

Machine Learning · Computer Science 2025-09-30 Dan Zhang , Min Cai , Jonathan Light , Ziniu Hu , Yisong Yue , Jie Tang

Currently, process reward models (PRMs) have exhibited remarkable potential for test-time scaling. Since large language models (LLMs) regularly generate flawed intermediate reasoning steps when tackling a broad spectrum of reasoning and…

Artificial Intelligence · Computer Science 2026-05-08 Zhouhao Sun , Xuan Zhang , Xiao Ding , Bibo Cai , Li Du , Kai Xiong , Xinran Dai , Fei Zhang , weidi tang , Zhiyuan Kan , Yang Zhao , Bing Qin , Ting Liu

Inference-time alignment methods have gained significant attention for their efficiency and effectiveness in aligning large language models (LLMs) with human preferences. However, existing dominant approaches using reward-guided search…

Computation and Language · Computer Science 2025-07-01 Bin Xie , Bingbing Xu , Yige Yuan , Shengmao Zhu , Huawei Shen

Large Language Models (LLMs) exhibit remarkable proficiency in addressing a diverse array of tasks within the Natural Language Processing (NLP) domain, with various prompt design strategies significantly augmenting their capabilities.…

Computation and Language · Computer Science 2024-08-05 Xiangyu Zhao , Chengqian Ma

Reinforcement learning with verifiable rewards (RLVR) has substantially enhanced the reasoning capabilities of multimodal large language models (MLLMs). However, existing RLVR approaches typically rely on outcome-driven optimization that…

Artificial Intelligence · Computer Science 2026-04-10 Ziqi Miao , Haonan Jia , Lijun Li , Chen Qian , Yuan Xiong , Wenting Yan , Jing Shao

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities in complex problem-solving tasks, sparking growing interest in their application to preference reasoning in recommendation systems. Existing methods typically…

Artificial Intelligence · Computer Science 2025-10-27 Yang Zhang , Wenxin Xu , Xiaoyan Zhao , Wenjie Wang , Fuli Feng , Xiangnan He , Tat-Seng Chua

Major depressive disorder (MDD) presents challenges in diagnosis and treatment due to its complex and heterogeneous nature. Emerging evidence indicates that reward processing abnormalities may serve as a behavioral marker for MDD. To…

Machine Learning · Computer Science 2024-07-29 Xingche Guo , Donglin Zeng , Yuanjia Wang

Process Reward Models (PRMs) have achieved remarkable success in augmenting the reasoning capabilities of Large Language Models (LLMs) within static domains such as mathematics. However, their potential in dynamic data analysis tasks…

Computation and Language · Computer Science 2026-04-28 Zhisong Qiu , Shuofei Qiao , Kewei Xu , Yuqi Zhu , Lun Du , Ningyu Zhang , Huajun Chen

We introduce VisualPRM, an advanced multimodal Process Reward Model (PRM) with 8B parameters, which improves the reasoning abilities of existing Multimodal Large Language Models (MLLMs) across different model scales and families with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Weiyun Wang , Zhangwei Gao , Lianjie Chen , Zhe Chen , Jinguo Zhu , Xiangyu Zhao , Yangzhou Liu , Yue Cao , Shenglong Ye , Xizhou Zhu , Lewei Lu , Haodong Duan , Yu Qiao , Jifeng Dai , Wenhai Wang

Recent advancements in large language models (LLMs) have been driven by their emergent reasoning capabilities, particularly through long chain-of-thought (CoT) prompting, which enables thorough exploration and deliberation. Despite these…

Computation and Language · Computer Science 2026-04-09 Junnan Liu , Hongwei Liu , Songyang Zhang , Kai Chen

Code generation is a core application of large language models (LLMs), yet LLMs still frequently fail on complex programming tasks. Given its success in mathematical reasoning, test-time scaling approaches such as Process Reward Model…

Machine Learning · Computer Science 2026-02-02 Ruiyi Zhang , Peijia Qin , Qi Cao , Eric Xue , Pengtao Xie

Information-seeking is a core capability for AI agents, requiring them to gather and reason over tool-generated information across long trajectories. However, such multi-step information-seeking tasks remain challenging for agents backed by…

Artificial Intelligence · Computer Science 2025-11-25 Jaewoo Lee , Archiki Prasad , Justin Chih-Yao Chen , Zaid Khan , Elias Stengel-Eskin , Mohit Bansal