English
Related papers

Related papers: Planning, Creation, Usage: Benchmarking LLMs for C…

200 papers

Recent advancements in tool learning have enabled large language models (LLMs) to integrate external tools, enhancing their task performance by expanding their knowledge boundaries. However, relying on tools often introduces tradeoffs…

Computation and Language · Computer Science 2025-03-11 Hongshen Xu , Zihan Wang , Zichen Zhu , Lei Pan , Xingyu Chen , Lu Chen , Kai Yu

Large language models (LLMs) show an innate skill for solving language based tasks. But insights have suggested an inability to adjust for information or task-solving skills becoming outdated, as their knowledge, stored directly within…

Computation and Language · Computer Science 2024-04-16 Jerry Huang , Prasanna Parthasarathi , Mehdi Rezagholizadeh , Sarath Chandar

Large language model (LLM)-based agents increasingly rely on tool use to complete real-world tasks. While existing works evaluate the LLMs' tool use capability, they largely focus on the final answers yet overlook the detailed tool usage…

Large language models (LLMs) are essential tools that users employ across various scenarios, so evaluating their performance and guiding users in selecting the suitable service is important. Although many benchmarks exist, they mainly focus…

Computation and Language · Computer Science 2024-09-23 Jiayin Wang , Fengran Mo , Weizhi Ma , Peijie Sun , Min Zhang , Jian-Yun Nie

We present ControlLLM, a novel framework that enables large language models (LLMs) to utilize multi-modal tools for solving complex real-world tasks. Despite the remarkable performance of LLMs, they still struggle with tool invocation due…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zhaoyang Liu , Zeqiang Lai , Zhangwei Gao , Erfei Cui , Ziheng Li , Xizhou Zhu , Lewei Lu , Qifeng Chen , Yu Qiao , Jifeng Dai , Wenhai Wang

Large language models (LLMs) demonstrate strong potential as agents for tool invocation due to their advanced comprehension and planning capabilities. Users increasingly rely on LLM-based agents to solve complex missions through iterative…

Artificial Intelligence · Computer Science 2025-04-17 Peijie Yu , Yifan Yang , Jinjian Li , Zelong Zhang , Haorui Wang , Xiao Feng , Feng Zhang

Large language models (LLMs) have demonstrated exceptional reasoning capabilities, enabling them to solve various complex problems. Recently, this ability has been applied to the paradigm of tool learning. Tool learning involves providing…

Artificial Intelligence · Computer Science 2025-08-18 Yanming Liu , Xinyue Peng , Jiannan Cao , Yuwei Zhang , Xuhong Zhang , Sheng Cheng , Xun Wang , Jianwei Yin , Tianyu Du

Tool invocation is a crucial mechanism for extending the capabilities of Large Language Models (LLMs) and has recently garnered significant attention. It enables LLMs to solve complex problems through tool calls while accessing up-to-date…

Computation and Language · Computer Science 2025-05-08 Xu Huang , Yuefeng Huang , Weiwen Liu , Xingshan Zeng , Yasheng Wang , Ruiming Tang , Hong Xie , Defu Lian

With recent advancements in natural language processing, Large Language Models (LLMs) have emerged as powerful tools for various real-world applications. Despite their prowess, the intrinsic generative abilities of LLMs may prove…

Artificial Intelligence · Computer Science 2025-12-30 Jingqing Ruan , Yihong Chen , Bin Zhang , Zhiwei Xu , Tianpeng Bao , Guoqing Du , Shiwei Shi , Hangyu Mao , Ziyue Li , Xingyu Zeng , Rui Zhao

Large Language Models (LLMs) are now integral to numerous industries, increasingly serving as the core reasoning engine for autonomous agents that perform complex tasks through tool-use. While the development of Arabic-native LLMs is…

Artificial Intelligence · Computer Science 2026-01-09 Konstantin Kubrak , Ahmed El-Moselhy , Ammar Alsulami , Remaz Altuwaim , Hassan Ismail Fawaz , Faisal Alsaby

Large language model (LLM) agents rely on external tools to solve complex tasks, but real-world toolsets often contain redundant tools with overlapping names and descriptions, introducing ambiguity and reducing selection accuracy. LLMs also…

Computation and Language · Computer Science 2026-05-12 Marianne Menglin Liu , Daniel Garcia , Fjona Parllaku , Vikas Upadhyay , Syed Fahad Allam Shah , Dan Roth

Large Language Models (LLMs) can enhance their reasoning capabilities by using external tools. However, many tasks lack predefined tools. Prior works have explored instructing LLMs to generate tools on their own, but such approaches depend…

Computation and Language · Computer Science 2026-03-03 Xiao Liu , Da Yin , Zirui Wu , Yansong Feng

Language models (LMs) are powerful yet mostly for text generation tasks. Tools have substantially enhanced their performance for tasks that require complex skills. However, many works adopt the term "tool" in different ways, raising the…

Computation and Language · Computer Science 2024-03-26 Zhiruo Wang , Zhoujun Cheng , Hao Zhu , Daniel Fried , Graham Neubig

Large Language Models(LLMs)have become effective tools for natural language processing and have been used in many different fields. This essay offers a succinct summary of various LLM subcategories. The survey emphasizes recent developments…

Computation and Language · Computer Science 2023-07-21 Saurabh Pahune , Manoj Chandrasekharan

The ability of Large Language Models (LLMs) to use external tools unlocks powerful real-world interactions, making rigorous evaluation essential. However, current benchmarks primarily report final accuracy, revealing what models can do but…

Computation and Language · Computer Science 2026-01-29 Qihao Wang , Yue Hu , Mingzhe Lu , Jiayue Wu , Yanbing Liu , Yuanmin Tang

Recent advancements in integrating large language models (LLMs) with tools have allowed the models to interact with real-world environments. However, these tool-augmented LLMs often encounter incomplete scenarios when users provide partial…

Computation and Language · Computer Science 2025-08-05 Seungbin Yang , ChaeHun Park , Taehee Kim , Jaegul Choo

Large Language Models (LLMs) have made significant progress in utilizing tools, but their ability is limited by API availability and the instability of implicit reasoning, particularly when both planning and execution are involved. To…

Computation and Language · Computer Science 2024-06-24 Cheng Qian , Chi Han , Yi R. Fung , Yujia Qin , Zhiyuan Liu , Heng Ji

Tool calling extends large language models (LLMs) by enabling grounded interaction with external executable interfaces, thereby supporting environment-coupled problem solving. However, mainstream in-context learning (ICL) approaches…

Artificial Intelligence · Computer Science 2026-05-29 Zekai Yu , Qi Meng , Qizhi Chu , Yu Hao , Chuan Shi , Cheng Yang

Large language models (LLMs) are incredible and versatile tools for text-based tasks that have enabled countless, previously unimaginable, applications. Retrieval models, in contrast, have not yet seen such capable general-purpose models…

Information Retrieval · Computer Science 2025-09-10 Julian Killingback , Hamed Zamani

Generating plans of action, and reasoning about change have long been considered a core competence of intelligent agents. It is thus no surprise that evaluating the planning and reasoning capabilities of large language models (LLMs) has…

Computation and Language · Computer Science 2023-11-28 Karthik Valmeekam , Matthew Marquez , Alberto Olmo , Sarath Sreedharan , Subbarao Kambhampati