English
Related papers

Related papers: To Call or Not to Call: A Framework to Assess and …

200 papers

Leveraging external tools is a key feature for modern Language Models (LMs) to expand their capabilities and integrate them into existing systems. However, existing benchmarks primarily focus on the accuracy of tool calling -- whether the…

Computation and Language · Computer Science 2025-04-29 Hayley Ross , Ameya Sunil Mahabaleshwarkar , Yoshi Suhara

Recent advancements in tool learning have enabled large language models (LLMs) to integrate external tools, enhancing their task performance by expanding their knowledge boundaries. However, relying on tools often introduces tradeoffs…

Computation and Language · Computer Science 2025-03-11 Hongshen Xu , Zihan Wang , Zichen Zhu , Lei Pan , Xingyu Chen , Lu Chen , Kai Yu

Large language models (LLMs) increasingly act as autonomous agents that must decide when to answer directly vs. when to invoke external tools. Prior work studying adaptive tool use has largely treated tool necessity as a model-agnostic…

Artificial Intelligence · Computer Science 2026-05-19 Yize Cheng , Chenrui Fan , Mahdi JafariRaviz , Keivan Rezaei , Soheil Feizi

Language models (LMs) are becoming increasingly dependent on external tools. LM-based agentic frameworks frequently interact with their environment via such tools to search files, run code, call APIs, etc. Further, modern reasoning-based…

Programming Languages · Computer Science 2025-12-19 Daniel Nichols , Prajwal Singhania , Charles Jekel , Abhinav Bhatele , Harshitha Menon

Tool use enables large language models (LLMs) to access external information, invoke software systems, and act in digital environments beyond what can be solved from model parameters alone. Early research mainly studied whether a model…

Large language models (LLMs) have exhibited remarkable capabilities across various domains. The ability to call external tools further expands their capability to handle real-world tasks. However, LLMs often follow an opaque reasoning…

Machine Learning · Computer Science 2025-11-20 Ruixin Zhang , Jon Donnelly , Zhicheng Guo , Ghazal Khalighinejad , Haiyang Huang , Alina Jade Barnett , Cynthia Rudin

Although Large Language Models (LLMs) excel in NLP tasks, they still need external tools to extend their ability. Current research on tool learning with LLMs often assumes mandatory tool use, which does not always align with real-world…

Computation and Language · Computer Science 2024-07-19 Kangyun Ning , Yisong Su , Xueqiang Lv , Yuanzhe Zhang , Jian Liu , Kang Liu , Jinan Xu

The advanced function-calling capabilities of foundation models open up new possibilities for deploying agents to perform complex API tasks. However, managing large amounts of data and interacting with numerous APIs makes function calling…

Large language models (LLMs) have garnered significant attention due to their impressive natural language processing (NLP) capabilities. Recently, many studies have focused on the tool utilization ability of LLMs. They primarily…

Software Engineering · Computer Science 2024-12-06 Yue Huang , Jiawen Shi , Yuan Li , Chenrui Fan , Siyuan Wu , Qihui Zhang , Yixin Liu , Pan Zhou , Yao Wan , Neil Zhenqiang Gong , Lichao Sun

Tool-augmented LLM agents tend to call tools indiscriminately, even when the model can answer directly. Each unnecessary call wastes API fees and latency, yet no existing benchmark systematically studies when a tool call is actually needed.…

Computation and Language · Computer Science 2026-05-22 Chung-En Sun , Linbo Liu , Ge Yan , Zimo Wang , Tsui-Wei Weng

Modern Large Language Models (LLMs) often require external tools, such as machine learning classifiers or knowledge retrieval systems, to provide accurate answers in domains where their pre-trained knowledge is insufficient. This…

Machine Learning · Computer Science 2025-05-23 Panagiotis Lymperopoulos , Vasanth Sarathy

This work presents an analytical framework for the design and analysis of LLM-based algorithms, i.e., algorithms that contain one or multiple calls of large language models (LLMs) as sub-routines and critically rely on the capabilities of…

Machine Learning · Computer Science 2025-10-14 Yanxi Chen , Yaliang Li , Bolin Ding , Jingren Zhou

Tool-augmented reasoning has emerged as a promising direction for enhancing the reasoning capabilities of multimodal large language models (MLLMs). However, existing studies mainly focus on enabling models to perform tool invocation, while…

Computation and Language · Computer Science 2026-05-20 Qinghe Ma , Zhen Zhao , Yiming Wu , Jian Zhang , Lei Bai , Yinghuan Shi

Equipped with the capability to call functions, modern large language models (LLMs) can leverage external tools for addressing a range of tasks unattainable through language skills alone. However, the effective execution of these tools…

Computation and Language · Computer Science 2026-04-30 Wenxuan Wang , Juluan Shi , Zixuan Ling , Yuk-Kit Chan , Chaozheng Wang , Cheryl Lee , Youliang Yuan , Jen-tse Huang , Wenxiang Jiao , Michael R. Lyu

Language models (LMs) exhibit remarkable abilities to solve new tasks from just a few examples or textual instructions, especially at scale. They also, paradoxically, struggle with basic functionality, such as arithmetic or factual lookup,…

Computation and Language · Computer Science 2023-02-10 Timo Schick , Jane Dwivedi-Yu , Roberto Dessì , Roberta Raileanu , Maria Lomeli , Luke Zettlemoyer , Nicola Cancedda , Thomas Scialom

Tool calling is a critical capability that allows Large Language Models (LLMs) to interact with external systems, significantly expanding their utility. However, research and resources for tool calling are predominantly English-centric,…

Computation and Language · Computer Science 2025-09-26 Asim Ersoy , Enes Altinisik , Husrev Taha Sencar , Kareem Darwish

Large language models (LLMs) have demonstrated strong reasoning and tool-use capabilities, yet they often fail in real-world tool-interactions due to incorrect parameterization, poor tool selection, or misinterpretation of user intent.…

Artificial Intelligence · Computer Science 2025-09-23 Hy Dang , Tianyi Liu , Zhuofeng Wu , Jingfeng Yang , Haoming Jiang , Tao Yang , Pei Chen , Zhengyang Wang , Helen Wang , Huasheng Li , Bing Yin , Meng Jiang

Large Language Models (LLMs) have demonstrated proficiency in addressing tasks that necessitate a combination of task planning and the usage of external tools that require a blend of task planning and the utilization of external tools, such…

Artificial Intelligence · Computer Science 2023-11-21 Yilun Kong , Jingqing Ruan , Yihong Chen , Bin Zhang , Tianpeng Bao , Shiwei Shi , Guoqing Du , Xiaoru Hu , Hangyu Mao , Ziyue Li , Xingyu Zeng , Rui Zhao

The pursuit of human-level artificial intelligence (AI) has significantly advanced the development of autonomous agents and Large Language Models (LLMs). LLMs are now widely utilized as decision-making agents for their ability to interpret…

Large language models (LLMs) are increasingly integrated into design and development workflows, yet decisions about their use are rarely binary or purely technical. We report findings from a constructivist grounded theory study based on…

Human-Computer Interaction · Computer Science 2026-04-20 Varad Vishwarupe , Ivan Flechais , Nigel Shadbolt , Marina Jirotka
‹ Prev 1 2 3 10 Next ›