English
Related papers

Related papers: To Call or Not to Call: A Framework to Assess and …

200 papers

Large Language Model (LLM) agents significantly extend the capabilities of standalone LLMs, empowering them to interact with external tools (e.g., APIs, functions) and complete various tasks in a self-directed fashion. The challenge of tool…

Artificial Intelligence · Computer Science 2024-02-19 Weizhou Shen , Chenliang Li , Hongzhan Chen , Ming Yan , Xiaojun Quan , Hehong Chen , Ji Zhang , Fei Huang

Large language model (LLM)-based agents have shown strong capabilities in using external tools to solve complex tasks. However, existing evaluations often overlook the temporal dimension of tool use, especially the impact of tool response…

Artificial Intelligence · Computer Science 2026-05-29 Kou Shi , Ziao Zhang , Shiting Huang , Avery Nie , Zhen Fang , Qiuchen Wang , Lin Chen , Huaian Chen , Zehui Chen , Feng Zhao

As large language models evolve into tool-augmented agents, a central question remains unresolved: when is external tool use actually justified? Existing agent frameworks typically treat tools as ordinary actions and optimize for task…

Artificial Intelligence · Computer Science 2026-05-11 Hongru Wang , Cheng Qian , Manling Li , Jiahao Qiu , Boyang Xue , Mengdi Wang , Heng Ji , Amos Storkey , Kam-Fai Wong

LLM agents exhibit a consistent tendency to over-call, invoking tools even in situations where none is needed. On the When2Call benchmark, six models from three families show high call accuracy but much lower no-call accuracy, leaving…

Machine Learning · Computer Science 2026-05-20 Wei Shi , Ziheng Peng , Sihang Li , Xiting Wang , Xiang Wang , Mengnan Du , Na Zou

Tool learning methods have enhanced the ability of large language models (LLMs) to interact with real-world applications. Many existing works fine-tune LLMs or design prompts to enable LLMs to select appropriate tools and correctly invoke…

Computation and Language · Computer Science 2024-07-04 Chengrui Huang , Zhengliang Shi , Yuntao Wen , Xiuying Chen , Peng Han , Shen Gao , Shuo Shang

LLM-based agents represent a paradigm shift in AI, enabling autonomous systems to plan, reason, and use tools while interacting with dynamic environments. This paper provides the first comprehensive survey of evaluation methods for these…

Artificial Intelligence · Computer Science 2026-04-24 Asaf Yehudai , Lilach Eden , Alan Li , Guy Uziel , Yilun Zhao , Roy Bar-Haim , Arman Cohan , Michal Shmueli-Scheuer

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

Artificial Intelligence · Computer Science 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan

Recent research has demonstrated that Large Language Models (LLMs) can enhance their capabilities by utilizing external tools. However, three pivotal questions remain unanswered: (1) How effective are current LLMs in utilizing tools? (2)…

Computation and Language · Computer Science 2023-10-26 Minghao Li , Yingxiu Zhao , Bowen Yu , Feifan Song , Hangyu Li , Haiyang Yu , Zhoujun Li , Fei Huang , Yongbin Li

Large language models (LLMs) have shown remarkable emergent capabilities, transforming the execution of functional tasks by leveraging external tools for complex problems that require specialized processing or up-to-date data. While…

Computation and Language · Computer Science 2025-08-22 Wenjun Li , Dexun Li , Kuicai Dong , Cong Zhang , Hao Zhang , Weiwen Liu , Yasheng Wang , Ruiming Tang , Yong Liu

Tools have become a mainstay of LLMs, allowing them to retrieve knowledge not in their weights, to perform tasks on the web, and even to control robots. However, most ontologies and surveys of tool-use have assumed the core challenge for…

Computation and Language · Computer Science 2024-06-28 Jimin Sun , So Yeon Min , Yingshan Chang , Yonatan Bisk

The integration of tools in augmenting large language models presents a novel approach toward enhancing the efficiency and accuracy of these models in handling specific, complex tasks. This paper delves into the methodology,challenges, and…

Artificial Intelligence · Computer Science 2024-09-30 Zhuocheng Shen

Tool calling has become increasingly popular for Large Language Models (LLMs). However, for large tool sets, the resulting tokens would exceed the LLM's context window limit, making it impossible to include every tool. Hence, an external…

Computation and Language · Computer Science 2026-03-03 Saptarshi Sengupta , Zhengyu Zhou , Jun Araki , Xingbo Wang , Bingqing Wang , Suhang Wang , Zhe Feng

Large language models (LLMs) can now access a wide range of external tools, thanks to the Model Context Protocol (MCP). This greatly expands their abilities as various agents. However, LLMs rely entirely on the text descriptions of tools to…

Artificial Intelligence · Computer Science 2025-09-23 Kazem Faghih , Wenxiao Wang , Yize Cheng , Siddhant Bharti , Gaurang Sriramanan , Sriram Balasubramanian , Parsa Hosseini , Soheil Feizi

Augmenting large language models (LLMs) with external tools has emerged as a promising approach to extend their utility, enabling them to solve practical tasks. Previous methods manually parse tool documentation and create in-context…

Computation and Language · Computer Science 2025-03-05 Zhengliang Shi , Shen Gao , Lingyong Yan , Yue Feng , Xiuyi Chen , Zhumin Chen , Dawei Yin , Suzan Verberne , Zhaochun Ren

Task-orientated conversational agents interact with users and assist them via leveraging external APIs. A typical task-oriented conversational system can be broken down into three phases: external API selection, argument filling, and…

Computation and Language · Computer Science 2024-07-18 Jisoo Mok , Mohammad Kachuee , Shuyang Dai , Shayan Ray , Tara Taghavi , Sungroh Yoon

Agentic AI will be an essential enabling technology for designing future mobile communication systems, which could provide flexible and customized services, automate complex network operations, and drive autonomous decision-making across…

Networking and Internet Architecture · Computer Science 2026-05-05 Purna Sai Garigipati , Onur Ayan , Kishor Chandra Joshi , Xueli An

Large Language Models (LLMs) enhance their problem-solving capability by utilizing external tools. However, in open-world scenarios with massive and evolving tool repositories, existing methods relying on static embedding retrieval or…

Computation and Language · Computer Science 2026-04-16 Shouzheng Huang , Meishan Zhang , Baotian Hu , Min Zhang

The reasoning capabilities of LLM (Large Language Model) are widely acknowledged in recent research, inspiring studies on tool learning and autonomous agents. LLM serves as the "brain" of the agent, orchestrating multiple tools for…

Machine Learning · Computer Science 2024-03-26 Xiangyan Liu , Rongxue Li , Wei Ji , Tao Lin

AI-assisted decision making becomes increasingly prevalent, yet individuals often fail to utilize AI-based decision aids appropriately especially when the AI explanations are absent, potentially as they do not %understand reflect on AI's…

Human-Computer Interaction · Computer Science 2025-02-18 Zhuoyan Li , Hangxiao Zhu , Zhuoran Lu , Ziang Xiao , Ming Yin

We present a domain-grounded framework and benchmark for tool-aware plan generation in contact centers, where answering a query for business insights, our target use case, requires decomposing it into executable steps over structured tools…

Computation and Language · Computer Science 2026-02-17 Varun Nathan , Shreyas Guha , Ayush Kumar