English
Related papers

Related papers: Benchmarking Failures in Tool-Augmented Language M…

200 papers

Large Language Models (LLMs) can enhance their capabilities as AI assistants by integrating external tools, allowing them to access a wider range of information. While recent LLMs are typically fine-tuned with tool usage examples during…

Computation and Language · Computer Science 2025-02-27 Jie He , Jennifer Neville , Mengting Wan , Longqi Yang , Hui Liu , Xiaofeng Xu , Xia Song , Jeff Z. Pan , Pei Zhou

Recent studies on software tool manipulation with large language models (LLMs) mostly rely on closed model APIs. The industrial adoption of these models is substantially constrained due to the security and robustness risks in exposing…

Computation and Language · Computer Science 2023-05-29 Qiantong Xu , Fenglu Hong , Bo Li , Changran Hu , Zhengyu Chen , Jian Zhang

Large Language Models (LLMs) have displayed massive improvements in reasoning and decision-making skills and can hold natural conversations with users. Recently, many tool-use benchmark datasets have been proposed. However, existing…

The rapid advancement of Artificial Intelligence (AI) has led to its integration into various areas, especially with Large Language Models (LLMs) significantly enhancing capabilities in Artificial Intelligence Generated Content (AIGC).…

Software Engineering · Computer Science 2026-01-07 Guangba Yu , Gou Tan , Haojia Huang , Zhenyu Zhang , Pengfei Chen , Roberto Natella , Zibin Zheng

Existing benchmarks for Large Language Model (LLM) agents focus on task completion under idealistic settings but overlook reliability in real-world, user-facing applications. In domains, such as in-car voice assistants, users often issue…

Artificial Intelligence · Computer Science 2026-01-30 Johannes Kirmayr , Lukas Stappen , Elisabeth André

Leveraging external tools is a key feature for modern Language Models (LMs) to expand their capabilities and integrate them into existing systems. However, existing benchmarks primarily focus on the accuracy of tool calling -- whether the…

Computation and Language · Computer Science 2025-04-29 Hayley Ross , Ameya Sunil Mahabaleshwarkar , Yoshi Suhara

Evaluations of audio-language models (ALMs) -- multimodal models that take interleaved audio and text as input and output text -- are hindered by the lack of standardized benchmarks; most benchmarks measure only one or two capabilities and…

Artificial Intelligence · Computer Science 2025-09-04 Tony Lee , Haoqin Tu , Chi Heem Wong , Zijun Wang , Siwei Yang , Yifan Mai , Yuyin Zhou , Cihang Xie , Percy Liang

Teaching language models to use tools is an important milestone towards building general assistants, but remains an open problem. While there has been significant progress on learning to use specific tools via fine-tuning, language models…

Computation and Language · Computer Science 2024-03-14 Dheeraj Mekala , Jason Weston , Jack Lanchantin , Roberta Raileanu , Maria Lomeli , Jingbo Shang , Jane Dwivedi-Yu

Empowering large language models (LLMs) with effective tool utilization capabilities is crucial for enabling AI agents to solve complex problems. However, current models face two major limitations: (1) unreliable tool planning and…

Computation and Language · Computer Science 2025-06-06 Zhiyuan Ma , Jiayu Liu , Xianzhen Luo , Zhenya Huang , Qingfu Zhu , Wanxiang Che

Tool-augmented large language models (LLMs) are often trained on datasets of query-response pairs, which embed the ability to use tools or APIs directly into the parametric knowledge of LLMs. Tool-augmented LLMs need the ability to forget…

Machine Learning · Computer Science 2025-08-07 Jiali Cheng , Hadi Amiri

In recent years, the remarkable progress of large language models (LLMs) has sparked interest in task automation, which involves decomposing complex tasks described by user instructions into sub-tasks and invoking external tools to execute…

Computation and Language · Computer Science 2024-11-04 Yongliang Shen , Kaitao Song , Xu Tan , Wenqi Zhang , Kan Ren , Siyu Yuan , Weiming Lu , Dongsheng Li , Yueting Zhuang

Large language models (LLM) have achieved remarkable performance on various NLP tasks and are augmented by tools for broader applications. Yet, how to evaluate and analyze the tool-utilization capability of LLMs is still under-explored. In…

Computation and Language · Computer Science 2024-01-17 Zehui Chen , Weihua Du , Wenwei Zhang , Kuikun Liu , Jiangning Liu , Miao Zheng , Jingming Zhuo , Songyang Zhang , Dahua Lin , Kai Chen , Feng Zhao

Large language models (LLMs) are increasingly integral as productivity assistants, but existing benchmarks fall short in rigorously evaluating their real-world instruction-following capabilities. Current benchmarks often (i) lack sufficient…

Computation and Language · Computer Science 2025-09-30 Jiho Park , Jongyoon Song , Minjin Choi , Kyuho Heo , Taehun Huh , Ji Won Kim

Small language models (SLMs) enable scalable tool-augmented multi-agent systems where multiple SLMs handle subtasks orchestrated by a powerful coordinator. However, they struggle with tool-use tasks, particularly in selecting appropriate…

Computation and Language · Computer Science 2026-04-21 Jonggeun Lee , Woojung Song , Jongwook Han , Haesung Pyun , Yohan Jo

Large language models (LLMs) have demonstrated remarkable capabilities in tool learning. In real-world scenarios, user queries are often ambiguous and incomplete, requiring effective clarification. However, existing interactive…

Computation and Language · Computer Science 2025-06-12 Xuan Zhang , Yongliang Shen , Zhe Zheng , Linjuan Wu , Wenqi Zhang , Yuchen Yan , Qiuying Peng , Jun Wang , Weiming Lu

When deploying large language models (LLMs), it is important to ensure that these models are not only capable, but also reliable. Many benchmarks have been created to track LLMs' growing capabilities, however there has been no similar focus…

Machine Learning · Computer Science 2025-02-06 Joshua Vendrow , Edward Vendrow , Sara Beery , Aleksander Madry

The ability of large language models (LLMs) to utilize external tools has enabled them to tackle an increasingly diverse range of tasks. However, as the tasks become more complex and long-horizon, the intricate tool utilization process may…

Software Engineering · Computer Science 2025-06-18 Shiting Huang , Zhen Fang , Zehui Chen , Siyu Yuan , Junjie Ye , Yu Zeng , Lin Chen , Qi Mao , Feng Zhao

Large language models (LLMs) have garnered significant attention due to their impressive natural language processing (NLP) capabilities. Recently, many studies have focused on the tool utilization ability of LLMs. They primarily…

Software Engineering · Computer Science 2024-12-06 Yue Huang , Jiawen Shi , Yuan Li , Chenrui Fan , Siyuan Wu , Qihui Zhang , Yixin Liu , Pan Zhou , Yao Wan , Neil Zhenqiang Gong , Lichao Sun

Large Language Models (LLMs) have expanded their capabilities beyond language generation to interact with external tools, enabling automation and real-world applications. However, tool hallucinations, where models either select…

Computation and Language · Computer Science 2025-05-30 Hongshen Xu , Zichen Zhu , Lei Pan , Zihan Wang , Su Zhu , Da Ma , Ruisheng Cao , Lu Chen , Kai Yu

Language models (LMs) are powerful yet mostly for text generation tasks. Tools have substantially enhanced their performance for tasks that require complex skills. However, many works adopt the term "tool" in different ways, raising the…

Computation and Language · Computer Science 2024-03-26 Zhiruo Wang , Zhoujun Cheng , Hao Zhu , Daniel Fried , Graham Neubig