English

Routine: A Structural Planning Framework for LLM Agent System in Enterprise

Artificial Intelligence 2025-07-23 v2 Computation and Language

Abstract

The deployment of agent systems in an enterprise environment is often hindered by several challenges: common models lack domain-specific process knowledge, leading to disorganized plans, missing key tools, and poor execution stability. To address this, this paper introduces Routine, a multi-step agent planning framework designed with a clear structure, explicit instructions, and seamless parameter passing to guide the agent's execution module in performing multi-step tool-calling tasks with high stability. In evaluations conducted within a real-world enterprise scenario, Routine significantly increases the execution accuracy in model tool calls, increasing the performance of GPT-4o from 41.1% to 96.3%, and Qwen3-14B from 32.6% to 83.3%. We further constructed a Routine-following training dataset and fine-tuned Qwen3-14B, resulting in an accuracy increase to 88.2% on scenario-specific evaluations, indicating improved adherence to execution plans. In addition, we employed Routine-based distillation to create a scenario-specific, multi-step tool-calling dataset. Fine-tuning on this distilled dataset raised the model's accuracy to 95.5%, approaching GPT-4o's performance. These results highlight Routine's effectiveness in distilling domain-specific tool-usage patterns and enhancing model adaptability to new scenarios. Our experimental results demonstrate that Routine provides a practical and accessible approach to building stable agent workflows, accelerating the deployment and adoption of agent systems in enterprise environments, and advancing the technical vision of AI for Process.

Keywords

Cite

@article{arxiv.2507.14447,
  title  = {Routine: A Structural Planning Framework for LLM Agent System in Enterprise},
  author = {Guancheng Zeng and Xueyi Chen and Jiawang Hu and Shaohua Qi and Yaxuan Mao and Zhantao Wang and Yifan Nie and Shuang Li and Qiuyang Feng and Pengxu Qiu and Yujia Wang and Wenqiang Han and Linyan Huang and Gang Li and Jingjing Mo and Haowen Hu},
  journal= {arXiv preprint arXiv:2507.14447},
  year   = {2025}
}

Comments

26 pages, 8 figures, 5 tables

R2 v1 2026-07-01T04:08:55.782Z