中文
相关论文

相关论文: Scaling Medical Reasoning Verification via Tool-In…

200 篇论文

Despite substantial advances in scaling test-time compute, an ongoing debate in the community is how it should be scaled up to enable continued and efficient improvements with scaling. There are largely two approaches: first, distilling…

机器学习 · 计算机科学 2025-02-19 Amrith Setlur , Nived Rajaraman , Sergey Levine , Aviral Kumar

Test-time scaling (TTS) techniques can improve the performance of large language models (LLMs) at the expense of additional computation and latency. While TTS has proven effective in formal domains such as mathematics and programming, its…

计算与语言 · 计算机科学 2025-10-31 Davide Romano , Jonathan Schwarz , Daniele Giofré

An impediment to using Large Language Models (LLMs) for reasoning output verification is that LLMs struggle to reliably identify errors in thinking traces, particularly in long outputs, domains requiring expert knowledge, and problems…

计算与语言 · 计算机科学 2026-02-09 Kate Sanders , Nathaniel Weir , Sapana Chaudhary , Kaj Bostrom , Huzefa Rangwala

Recent advances in general medical AI have made significant strides, but existing models often lack the reasoning capabilities needed for complex medical decision-making. This paper presents GMAI-VL-R1, a multimodal medical reasoning model…

Large language models (LLMs) show promise for diagnostic reasoning but often lack reliable, knowledge grounded inference. Knowledge graphs (KGs), such as the Unified Medical Language System (UMLS), offer structured biomedical knowledge that…

计算与语言 · 计算机科学 2025-09-24 Saksham Khatwani , He Cheng , Majid Afshar , Dmitriy Dligach , Yanjun Gao

Retrieval-Augmented Generation (RAG) systems for Large Language Models (LLMs) hold promise in knowledge-intensive tasks but face limitations in complex multi-step reasoning. While recent methods have integrated RAG with chain-of-thought…

计算与语言 · 计算机科学 2025-01-15 Zhongxiang Sun , Qipeng Wang , Weijie Yu , Xiaoxue Zang , Kai Zheng , Jun Xu , Xiao Zhang , Song Yang , Han Li

Reinforcement learning (RL) offers a principled way to enhance the reasoning capabilities of large language models, yet its effectiveness hinges on training signals that remain informative as models evolve. In practice, RL progress often…

人工智能 · 计算机科学 2026-05-05 Caijun Xu , Changyi Xiao , Zhongyuan Peng , Xinrun Wang , Yixin Cao

Reinforcement learning (RL) has become a standard paradigm for refining large language models (LLMs) beyond pre-training and instruction tuning. A prominent line of work is RL with verifiable rewards (RLVR), which leverages automatically…

机器学习 · 计算机科学 2025-09-23 Bonan Zhang , Zhongqi Chen , Bowen Song , Qinya Li , Fan Wu , Guihai Chen

Recent advances in Reinforcement Learning (RL) have underscored its potential for incentivizing reasoning capabilities of Large Language Models (LLMs). However, existing step-level efforts suffer from costly annotations that limit domain…

机器学习 · 计算机科学 2026-05-20 Junjie Zhang , Guozheng Ma , Shunyu Liu , Zetian Hu , Yongcheng Jing , Ting-En Lin , Yongbin Li , Dacheng Tao

Diffusion-based large language models offer a non-autoregressive alternative for text generation, but enabling them to perform complex reasoning remains challenging. Reinforcement learning has recently emerged as an effective post-training…

人工智能 · 计算机科学 2026-04-14 Shaoan Xie , Lingjing Kong , Xiangchen Song , Xinshuai Dong , Guangyi Chen , Eric P. Xing , Kun Zhang

Reinforcement Learning with Verifiable Rewards (RLVR) has recently strengthened LLM reasoning, but its focus on final answer correctness leaves a critical gap: it does not ensure the robustness of the reasoning process itself. We adopt a…

机器学习 · 计算机科学 2026-02-10 Hyunseok Lee , Soheil Abbasloo , Jihoon Tack , Jinwoo Shin

Recent advances in large language models (LLMs) have demonstrated significant progress in performing complex tasks. While Reinforcement Learning from Human Feedback (RLHF) has been effective in aligning LLMs with human preferences, it is…

机器学习 · 计算机科学 2025-05-30 Chaoqi Wang , Zhuokai Zhao , Yibo Jiang , Zhaorun Chen , Chen Zhu , Yuxin Chen , Jiayi Liu , Lizhu Zhang , Xiangjun Fan , Hao Ma , Sinong Wang

Process reward models (PRMs) that provide dense, step-level feedback have shown promise for reinforcement learning, yet their adoption remains limited by the need for expensive step-level annotations or ground truth references. We propose…

机器学习 · 计算机科学 2025-12-04 Salman Rahman , Sruthi Gorantla , Arpit Gupta , Swastik Roy , Nanyun Peng , Yang Liu

Large language models (LLMs) have demonstrated remarkable performance in reasoning tasks, where reinforcement learning (RL) serves as a key algorithm for enhancing their reasoning capabilities. Currently, there are two mainstream reward…

计算与语言 · 计算机科学 2025-08-08 Haitao Hong , Yuchen Yan , Xingyu Wu , Guiyang Hou , Wenqi Zhang , Weiming Lu , Yongliang Shen , Jun Xiao

Reinforcement learning (RL) training of large language models (LLMs) on unverifiable tasks is challenging even when a reasonable-quality reference answer is available. We propose a constrained RL training framework that (i) optimizes a…

Recent advances in synergizing large reasoning models (LRMs) with retrieval-augmented generation (RAG) have shown promising results, yet two critical challenges remain: (1) reasoning models typically operate from a single, unchallenged…

人工智能 · 计算机科学 2026-01-12 Can Xu , Lingyong Yan , Jiayi Wu , Haosen Wang , Shuaiqiang Wang , Yuchen Li , Jizhou Huang , Dawei Yin , Xiang Li

HealthBench, a benchmark designed to measure the capabilities of AI systems for health better (Arora et al., 2025), has advanced medical language model evaluation through physician-crafted dialogues and transparent rubrics. However, its…

人工智能 · 计算机科学 2025-08-04 Fred Mutisya , Shikoh Gitau , Nasubo Ongoma , Keith Mbae , Elizabeth Wamicha

Large Language Model (LLM) agents can increasingly automate complex reasoning through Test-Time Scaling (TTS), iterative refinement guided by reward signals. However, many real-world tasks involve multi-stage pipeline whose final outcomes…

机器学习 · 计算机科学 2025-12-30 Shuyu Gan , James Mooney , Pan Hao , Renxiang Wang , Mingyi Hong , Qianwen Wang , Dongyeop Kang

Reinforcement learning with verifiable rewards (RLVR) has demonstrated superior performance in enhancing the reasoning capability of large language models (LLMs). However, this accuracy-oriented learning paradigm often suffers from entropy…

人工智能 · 计算机科学 2026-01-19 Hongye Cao , Zhixin Bai , Ziyue Peng , Boyan Wang , Tianpei Yang , Jing Huo , Yuyao Zhang , Yang Gao

Recent advances in large language models have demonstrated the promise of unsupervised reinforcement learning (RL) methods for enhancing reasoning capabilities without external supervision. However, the generalizability of these label-free…

机器学习 · 计算机科学 2025-11-10 Shuvendu Roy , Hossein Hajimirsadeghi , Mengyao Zhai , Golnoosh Samei