English
Related papers

Related papers: ToolEyes: Fine-Grained Evaluation for Tool Learnin…

200 papers

Tool learning, which enables large language models (LLMs) to utilize external tools effectively, has garnered increasing attention for its potential to revolutionize productivity across industries. Despite rapid development in tool…

Artificial Intelligence · Computer Science 2025-05-20 Haotian Chen , Zijun Song , Boye Niu , Ke Zhang , Litu Ou , Yaxi Lu , Zhong Zhang , Xin Cong , Yankai Lin , Zhiyuan Liu , Maosong Sun

Recently, tool learning with large language models (LLMs) has emerged as a promising paradigm for augmenting the capabilities of LLMs to tackle highly complex problems. Despite growing attention and rapid advancements in this field, the…

Computation and Language · Computer Science 2024-11-05 Changle Qu , Sunhao Dai , Xiaochi Wei , Hengyi Cai , Shuaiqiang Wang , Dawei Yin , Jun Xu , Ji-Rong Wen

Tool learning is widely acknowledged as a foundational approach or deploying large language models (LLMs) in real-world scenarios. While current research primarily emphasizes leveraging tools to augment LLMs, it frequently neglects emerging…

Computation and Language · Computer Science 2024-08-19 Junjie Ye , Sixian Li , Guanyu Li , Caishuang Huang , Songyang Gao , Yilong Wu , Qi Zhang , Tao Gui , Xuanjing Huang

Large language models (LLM) have achieved remarkable performance on various NLP tasks and are augmented by tools for broader applications. Yet, how to evaluate and analyze the tool-utilization capability of LLMs is still under-explored. In…

Computation and Language · Computer Science 2024-01-17 Zehui Chen , Weihua Du , Wenwei Zhang , Kuikun Liu , Jiangning Liu , Miao Zheng , Jingming Zhuo , Songyang Zhang , Dahua Lin , Kai Chen , Feng Zhao

Large language models (LLMs) have demonstrated strong capabilities in using external tools to address user inquiries. However, most existing evaluations assume tool use in short contexts, offering limited insight into model behavior during…

Computation and Language · Computer Science 2025-11-24 Beong-woo Kwak , Minju Kim , Dongha Lim , Hyungjoo Chae , Dongjin Kang , Sunghwan Kim , Dongil Yang , Jinyoung Yeo

Tool learning aims to augment large language models (LLMs) with diverse tools, enabling them to act as agents for solving practical tasks. Due to the limited context length of tool-using LLMs, adopting information retrieval (IR) models to…

Computation and Language · Computer Science 2025-05-27 Zhengliang Shi , Yuhan Wang , Lingyong Yan , Pengjie Ren , Shuaiqiang Wang , Dawei Yin , Zhaochun Ren

Augmenting large language models (LLMs) with external tools has emerged as a promising approach to extend their utility, enabling them to solve practical tasks. Previous methods manually parse tool documentation and create in-context…

Computation and Language · Computer Science 2025-03-05 Zhengliang Shi , Shen Gao , Lingyong Yan , Yue Feng , Xiuyi Chen , Zhumin Chen , Dawei Yin , Suzan Verberne , Zhaochun Ren

The integration of tools in augmenting large language models presents a novel approach toward enhancing the efficiency and accuracy of these models in handling specific, complex tasks. This paper delves into the methodology,challenges, and…

Artificial Intelligence · Computer Science 2024-09-30 Zhuocheng Shen

Tool learning aims to enhance and expand large language models' (LLMs) capabilities with external tools, which has gained significant attention recently. Current methods have shown that LLMs can effectively handle a certain amount of tools…

Computation and Language · Computer Science 2024-10-01 Qiancheng Xu , Yongqi Li , Heming Xia , Wenjie Li

Large Language Models (LLMs) are transformative not only for daily activities but also for engineering tasks. However, current evaluations of LLMs in engineering exhibit two critical shortcomings: (i) the reliance on simplified use cases,…

Artificial Intelligence · Computer Science 2025-05-21 Rene Heesch , Sebastian Eilermann , Alexander Windmann , Alexander Diedrich , Philipp Rosenthal , Oliver Niggemann

While integrating external tools into large language models (LLMs) enhances their ability to access real-time information and domain-specific services, existing approaches focus narrowly on functional tool selection following user…

Computation and Language · Computer Science 2025-05-23 Zihao Cheng , Hongru Wang , Zeming Liu , Yuhang Guo , Yuanfang Guo , Yunhong Wang , Haifeng Wang

The recent trend of using Large Language Models (LLMs) as tool agents in real-world applications underscores the necessity for comprehensive evaluations of their capabilities, particularly in complex scenarios involving planning, creating,…

Computation and Language · Computer Science 2024-06-04 Shijue Huang , Wanjun Zhong , Jianqiao Lu , Qi Zhu , Jiahui Gao , Weiwen Liu , Yutai Hou , Xingshan Zeng , Yasheng Wang , Lifeng Shang , Xin Jiang , Ruifeng Xu , Qun Liu

Large language models (LLMs) combined with tool learning have gained impressive results in real-world applications. During tool learning, LLMs may call multiple tools in nested orders, where the latter tool call may take the former response…

Computation and Language · Computer Science 2025-01-08 Han Han , Tong Zhu , Xiang Zhang , Mengsong Wu , Hao Xiong , Wenliang Chen

Large Language Model (LLM) agents have developed rapidly in recent years to solve complex real-world problems using external tools. However, the scarcity of high-quality trajectories still hinders the development of stronger LLM agents.…

Artificial Intelligence · Computer Science 2025-12-08 Chen Yang , Ran Le , Yun Xing , Zhenwei An , Zongchao Chen , Wayne Xin Zhao , Yang Song , Tao Zhang

Large language models (LLMs) have garnered significant attention due to their impressive natural language processing (NLP) capabilities. Recently, many studies have focused on the tool utilization ability of LLMs. They primarily…

Software Engineering · Computer Science 2024-12-06 Yue Huang , Jiawen Shi , Yuan Li , Chenrui Fan , Siyuan Wu , Qihui Zhang , Yixin Liu , Pan Zhou , Yao Wan , Neil Zhenqiang Gong , Lichao Sun

Tool learning methods have enhanced the ability of large language models (LLMs) to interact with real-world applications. Many existing works fine-tune LLMs or design prompts to enable LLMs to select appropriate tools and correctly invoke…

Computation and Language · Computer Science 2024-07-04 Chengrui Huang , Zhengliang Shi , Yuntao Wen , Xiuying Chen , Peng Han , Shen Gao , Shuo Shang

Despite the advancements of open-source large language models (LLMs), e.g., LLaMA, they remain significantly limited in tool-use capabilities, i.e., using external tools (APIs) to fulfill human instructions. The reason is that current…

Recent advancements in tool learning have enabled large language models (LLMs) to integrate external tools, enhancing their task performance by expanding their knowledge boundaries. However, relying on tools often introduces tradeoffs…

Computation and Language · Computer Science 2025-03-11 Hongshen Xu , Zihan Wang , Zichen Zhu , Lei Pan , Xingyu Chen , Lu Chen , Kai Yu

Large Language Models (LLMs) have demonstrated significant potential in decision-making and reasoning, particularly when integrated with various tools to effectively solve complex problems. However, existing benchmarks for evaluating LLMs'…

Large language models (LLMs) have displayed massive improvements in reasoning and decision-making skills and can hold natural conversations with users. Many recent works seek to augment LLM-based assistants with external tools so they can…

Computation and Language · Computer Science 2023-11-21 Nicholas Farn , Richard Shin
‹ Prev 1 2 3 10 Next ›