中文
相关论文

相关论文: ToolPRMBench: Evaluating and Advancing Process Rew…

200 篇论文

Recent advancements in Large Language Models (LLMs) have shown outstanding potential for role-playing applications. Evaluating these capabilities is becoming crucial yet remains challenging. Existing benchmarks mostly adopt a…

计算与语言 · 计算机科学 2025-10-24 Hao Xiang , Tianyi Tang , Yang Su , Bowen Yu , An Yang , Fei Huang , Yichang Zhang , Yaojie Lu , Hongyu Lin , Xianpei Han , Jingren Zhou , Junyang Lin , Le Sun

Recent advances in LLM Multi-Agent Systems enable scalable orchestration of sub-agents, each coordinating hundreds or thousands of tools or Model Context Protocol (MCP) servers. However, existing retrieval methods typically match queries…

计算与语言 · 计算机科学 2025-11-05 Elias Lumer , Faheem Nizar , Anmol Gulati , Pradeep Honaganahalli Basavaraju , Vamse Kumar Subbiah

Recent advancements in Large Language Models (LLMs) have demonstrated that Process Reward Models (PRMs) play a crucial role in enhancing model performance. However, training PRMs typically requires step-level labels, either manually…

计算与语言 · 计算机科学 2025-06-05 Lin Sun , Chuang Liu , Xiaofeng Ma , Tao Yang , Weijia Lu , Ning Wu

Reasoning in knowledge-intensive domains remains challenging as intermediate steps are often not locally verifiable: unlike math or code, evaluating step correctness may require synthesizing clues across large external knowledge sources. As…

人工智能 · 计算机科学 2026-04-13 Jiwoong Sohn , Tomasz Sternal , Kenneth Styppa , Torsten Hoefler , Michael Moor

Process Reward Models (PRMs), which assign fine-grained scores to intermediate reasoning steps within a solution trajectory, have emerged as a promising approach to enhance the reasoning quality of Large Language Models (LLMs). However,…

计算与语言 · 计算机科学 2026-01-07 Lingyin Zhang , Jun Gao , Xiaoxue Ren , Ziqiang Cao

Practical deployment of multi-agent systems (MAS) demands strong performance at test time, motivating methods that guide search during inference and selectively spend compute to improve quality. We present the Multi-Agent System Process…

多智能体系统 · 计算机科学 2026-02-16 Milad Yazdani , Mahdi Mostajabdaveh , Zirui Zhou , Ying Xiong

Planning is a fundamental capability for large language models (LLMs) because such complex tasks require models to coordinate goals, constraints, resources, and long-term consequences into executable and verifiable solutions. Existing…

人工智能 · 计算机科学 2026-05-21 Ziliang Zhao , Zenan Xu , Shuting Wang , Hongjin Qian , Yan Lei , Minda Hu , Zhao Wang , Shihan Dou , Zhicheng Dou , Pluto Zhou

Tool learning has generated widespread interest as a vital means of interaction between Large Language Models (LLMs) and the physical world. Current research predominantly emphasizes LLMs' capacity to utilize tools in well-structured…

计算与语言 · 计算机科学 2024-09-24 Junjie Ye , Yilong Wu , Songyang Gao , Caishuang Huang , Sixian Li , Guanyu Li , Xiaoran Fan , Qi Zhang , Tao Gui , Xuanjing Huang

While integrating external tools into large language models (LLMs) enhances their ability to access real-time information and domain-specific services, existing approaches focus narrowly on functional tool selection following user…

计算与语言 · 计算机科学 2025-05-23 Zihao Cheng , Hongru Wang , Zeming Liu , Yuhang Guo , Yuanfang Guo , Yunhong Wang , Haifeng Wang

The rapid advancement of Large Vision Language Models (LVLMs) has demonstrated excellent abilities in various visual tasks. Building upon these developments, the thinking with images paradigm has emerged, enabling models to dynamically edit…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Yujin Zhou , Pengcheng Wen , Jiale Chen , Boqin Yin , Han Zhu , Jiaming Ji , Juntao Dai , Chi-Min Chan , Sirui Han

Tool use enables large language models to solve complex tasks through sequences of API calls, yet existing reinforcement learning approaches fail to scale to multi-step composition settings. Outcome-based rewards provide only sparse…

机器学习 · 计算机科学 2026-05-19 Anay Kulkarni , ChiaEn Lu , Dheeraj Mekala , Jayanth Srinivasa , Gaowen Liu , Jingbo Shang

Process reward models (PRMs) rely on high-quality process supervision data, yet existing construction methods often provide limited control over error location, error type, and trajectory consistency. We propose a controllable and…

人工智能 · 计算机科学 2026-05-05 Yinghui Chi , Lucien Wang

Empowering large language models (LLMs) with effective tool utilization capabilities is crucial for enabling AI agents to solve complex problems. However, current models face two major limitations: (1) unreliable tool planning and…

计算与语言 · 计算机科学 2025-06-06 Zhiyuan Ma , Jiayu Liu , Xianzhen Luo , Zhenya Huang , Qingfu Zhu , Wanxiang Che

Recent advancements in function calling and tool use have significantly enhanced the capabilities of large language models (LLMs) by enabling them to interact with external information sources and execute complex tasks. However, the limited…

机器学习 · 计算机科学 2024-09-05 Suhong Moon , Siddharth Jha , Lutfi Eren Erdogan , Sehoon Kim , Woosang Lim , Kurt Keutzer , Amir Gholami

Agents backed by large language models (LLMs) increasingly rely on external tools drawn from marketplaces where multiple providers offer functionally equivalent options. This raises a critical fairness concern: systematic bias in tool…

Large Language Models (LLMs) based autonomous agents demonstrate multifaceted capabilities to contribute substantially to economic production. However, existing benchmarks remain focused on single agentic capability, failing to capture…

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

人工智能 · 计算机科学 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan

As Large Language Model (LLM) alignment evolves from simple completions to complex, highly sophisticated generation, Reward Models are increasingly shifting toward rubric-guided evaluation to mitigate surface-level biases. However, the…

人工智能 · 计算机科学 2026-03-04 Qiyuan Zhang , Junyi Zhou , Yufei Wang , Fuyuan Lyu , Yidong Ming , Can Xu , Qingfeng Sun , Kai Zheng , Peng Kang , Xue Liu , Chen Ma

Achieving both accuracy and diverse reasoning remains challenging for Large Language Models (LLMs) in complex domains like mathematics. A key bottleneck is evaluating intermediate reasoning steps to guide generation without costly human…

机器学习 · 计算机科学 2025-10-14 Adam Younsi , Ahmed Attia , Abdalgader Abubaker , Mohamed El Amine Seddik , Hakim Hacid , Salem Lahlou

Large Language Models (LLMs) based agents excel at diverse tasks, yet they suffer from brittle procedural memory that is manually engineered or entangled in static parameters. In this work, we investigate strategies to endow agents with a…

计算与语言 · 计算机科学 2026-04-16 Runnan Fang , Yuan Liang , Xiaobin Wang , Jialong Wu , Shuofei Qiao , Pengjun Xie , Fei Huang , Huajun Chen , Ningyu Zhang