English
Related papers

Related papers: Planning, Creation, Usage: Benchmarking LLMs for C…

200 papers

Large language models (LLMs) have garnered significant attention due to their impressive natural language processing (NLP) capabilities. Recently, many studies have focused on the tool utilization ability of LLMs. They primarily…

Software Engineering · Computer Science 2024-12-06 Yue Huang , Jiawen Shi , Yuan Li , Chenrui Fan , Siyuan Wu , Qihui Zhang , Yixin Liu , Pan Zhou , Yao Wan , Neil Zhenqiang Gong , Lichao Sun

While integrating external tools into large language models (LLMs) enhances their ability to access real-time information and domain-specific services, existing approaches focus narrowly on functional tool selection following user…

Computation and Language · Computer Science 2025-05-23 Zihao Cheng , Hongru Wang , Zeming Liu , Yuhang Guo , Yuanfang Guo , Yunhong Wang , Haifeng Wang

Although Large Language Models (LLMs) excel in NLP tasks, they still need external tools to extend their ability. Current research on tool learning with LLMs often assumes mandatory tool use, which does not always align with real-world…

Computation and Language · Computer Science 2024-07-19 Kangyun Ning , Yisong Su , Xueqiang Lv , Yuanzhe Zhang , Jian Liu , Kang Liu , Jinan Xu

Large Language Models (LLMs) have demonstrated proficiency in addressing tasks that necessitate a combination of task planning and the usage of external tools that require a blend of task planning and the utilization of external tools, such…

Artificial Intelligence · Computer Science 2023-11-21 Yilun Kong , Jingqing Ruan , Yihong Chen , Bin Zhang , Tianpeng Bao , Shiwei Shi , Guoqing Du , Xiaoru Hu , Hangyu Mao , Ziyue Li , Xingyu Zeng , Rui Zhao

Large language models (LLMs) are increasingly applied to materials science questions, including literature comprehension, property prediction, materials discovery and alloy design. At the same time, a wide range of physics-based…

Materials Science · Physics 2025-12-17 Siyu Liu , Bo Hu , Beilin Ye , Jiamin Xu , David J. Srolovitz , Tongqi Wen

Fulfilling user needs through Large Language Model multi-turn, multi-step tool-use is rarely a straightforward process. Real user interactions are inherently wild, being intricate, messy, and flexible. We identify three key challenges from…

Human-Computer Interaction · Computer Science 2026-04-09 Peijie Yu , Wei Liu , Yifan Yang , Jinjian Li , Zelong Zhang , Xiao Feng , Feng Zhang

Large Language Models (LLMs) can enhance their capabilities as AI assistants by integrating external tools, allowing them to access a wider range of information. While recent LLMs are typically fine-tuned with tool usage examples during…

Computation and Language · Computer Science 2025-02-27 Jie He , Jennifer Neville , Mengting Wan , Longqi Yang , Hui Liu , Xiaofeng Xu , Xia Song , Jeff Z. Pan , Pei Zhou

Solving problems through tool use under explicit constraints constitutes a highly challenging yet unavoidable scenario for large language models (LLMs), requiring capabilities such as function calling, instruction following, and…

Computation and Language · Computer Science 2026-03-17 Junjie Ye , Guoqiang Zhang , Wenjie Fu , Tao Gui , Qi Zhang , Xuanjing Huang

The integration of tools in augmenting large language models presents a novel approach toward enhancing the efficiency and accuracy of these models in handling specific, complex tasks. This paper delves into the methodology,challenges, and…

Artificial Intelligence · Computer Science 2024-09-30 Zhuocheng Shen

Augmenting large language models (LLMs) with external tools has emerged as a promising approach to extend their utility, enabling them to solve practical tasks. Previous methods manually parse tool documentation and create in-context…

Computation and Language · Computer Science 2025-03-05 Zhengliang Shi , Shen Gao , Lingyong Yan , Yue Feng , Xiuyi Chen , Zhumin Chen , Dawei Yin , Suzan Verberne , Zhaochun Ren

Large Language Models (LLMs) have demonstrated significant potential in decision-making and reasoning, particularly when integrated with various tools to effectively solve complex problems. However, existing benchmarks for evaluating LLMs'…

Large Language Models (LLMs) have exhibited great performance in autonomously calling various tools in external environments, leading to better problem solving and task automation capabilities. However, these external tools also amplify…

Cryptography and Security · Computer Science 2025-09-10 Hongfei Xia , Hongru Wang , Zeming Liu , Qian Yu , Yuhang Guo , Haifeng Wang

Utilizing tools with Large Language Models (LLMs) is essential for grounding AI agents in real-world applications. The prevailing approach involves few-shot prompting with demonstrations or fine-tuning with expert annotations. However, mere…

Computation and Language · Computer Science 2024-10-10 Xiaohan Wang , Dian Li , Yilin Zhao , Sinbadliu , Hui Wang

Evaluating Large Language Models (LLMs) is one of the most critical aspects of building a performant compound AI system. Since the output from LLMs propagate to downstream steps, identifying LLM errors is crucial to system performance. A…

To address intricate real-world tasks, there has been a rising interest in tool utilization in applications of large language models (LLMs). To develop LLM-based agents, it usually requires LLMs to understand many tool functions from…

Computation and Language · Computer Science 2024-03-28 Siyu Yuan , Kaitao Song , Jiangjie Chen , Xu Tan , Yongliang Shen , Ren Kan , Dongsheng Li , Deqing Yang

By virtue of its great utility in solving real-world problems, optimization modeling has been widely employed for optimal decision-making across various sectors, but it requires substantial expertise from operations research professionals.…

Recently, large language models(LLMs) have played an increasingly important role in solving a wide range of NLP tasks, leveraging their capabilities of natural language understanding and generating. Integration with external tools further…

Computation and Language · Computer Science 2025-05-14 Aiyao He , Sijia Cui , Shuai Xu , Yanna Wang , Bo Xu

Large language models (LLMs) are powerful tools capable of handling diverse tasks. Comparing and selecting appropriate LLMs for specific tasks requires systematic evaluation methods, as models exhibit varying capabilities across different…

Computation and Language · Computer Science 2025-06-04 Anna Sokol , Elizabeth Daly , Michael Hind , David Piorkowski , Xiangliang Zhang , Nuno Moniz , Nitesh Chawla

The advent of Large Language Models (LLMs) holds promise for revolutionizing various fields traditionally dominated by human expertise. Urban planning, a professional discipline that fundamentally shapes our daily surroundings, is one such…

Computation and Language · Computer Science 2025-05-01 Yu Zheng , Longyi Liu , Yuming Lin , Jie Feng , Guozhen Zhang , Depeng Jin , Yong Li

The ability of large language models (LLMs) to utilize external tools has enabled them to tackle an increasingly diverse range of tasks. However, as the tasks become more complex and long-horizon, the intricate tool utilization process may…

Software Engineering · Computer Science 2025-06-18 Shiting Huang , Zhen Fang , Zehui Chen , Siyu Yuan , Junjie Ye , Yu Zeng , Lin Chen , Qi Mao , Feng Zhao
‹ Prev 1 2 3 10 Next ›