English

ToolCoder: A Systematic Code-Empowered Tool Learning Framework for Large Language Models

Computation and Language 2025-06-02 v2

Abstract

Tool learning has emerged as a crucial capability for large language models (LLMs) to solve complex real-world tasks through interaction with external tools. Existing approaches face significant challenges, including reliance on hand-crafted prompts, difficulty in multi-step planning, and lack of precise error diagnosis and reflection mechanisms. We propose ToolCoder, a novel framework that reformulates tool learning as a code generation task. Inspired by software engineering principles, ToolCoder transforms natural language queries into structured Python function scaffold and systematically breaks down tasks with descriptive comments, enabling LLMs to leverage coding paradigms for complex reasoning and planning. It then generates and executes function implementations to obtain final responses. Additionally, ToolCoder stores successfully executed functions in a repository to promote code reuse, while leveraging error traceback mechanisms for systematic debugging, optimizing both execution efficiency and robustness. Experiments demonstrate that ToolCoder achieves superior performance in task completion accuracy and execution reliability compared to existing approaches, establishing the effectiveness of code-centric approaches in tool learning.

Keywords

Cite

@article{arxiv.2502.11404,
  title  = {ToolCoder: A Systematic Code-Empowered Tool Learning Framework for Large Language Models},
  author = {Hanxing Ding and Shuchang Tao and Liang Pang and Zihao Wei and Jinyang Gao and Bolin Ding and Huawei Shen and Xueqi Cheng},
  journal= {arXiv preprint arXiv:2502.11404},
  year   = {2025}
}

Comments

Accepted to ACL 2025