English
Related papers

Related papers: What Affects the Stability of Tool Learning? An Em…

200 papers

Modern systems are built using development frameworks. These frameworks have a major impact on how the resulting system executes, how configurations are managed, how it is tested, and how and where it is deployed. Machine learning (ML)…

Machine Learning · Computer Science 2020-05-14 Yang Ren , Gregory Gay , Christian Kästner , Pooyan Jamshidi

Effective tool use is essential for large language models (LLMs) to interact with their environment. However, progress is limited by the lack of efficient reinforcement learning (RL) frameworks specifically designed for tool use, due to…

Computation and Language · Computer Science 2026-04-16 Junjie Ye , Changhao Jiang , Zhengyin Du , Yufei Xu , Xuesong Yao , Zhiheng Xi , Xiaoran Fan , Qi Zhang , Tao Gui , Xuanjing Huang , Jiecao Chen

Large language models (LLMs) could be valuable personal AI agents across various domains, provided they can precisely follow user instructions. However, recent studies have shown significant limitations in LLMs' instruction-following…

Artificial Intelligence · Computer Science 2025-03-31 Juyeon Heo , Miao Xiong , Christina Heinze-Deml , Jaya Narain

Large Language Models (LLMs) are highly vulnerable to input perturbations, as even a small prompt change may result in a substantially different output. Existing methods to enhance LLM robustness are primarily focused on perturbed data…

Computation and Language · Computer Science 2025-04-04 Aryan Agrawal , Lisa Alazraki , Shahin Honarvar , Marek Rei

Tool learning is widely acknowledged as a foundational approach or deploying large language models (LLMs) in real-world scenarios. While current research primarily emphasizes leveraging tools to augment LLMs, it frequently neglects emerging…

Computation and Language · Computer Science 2024-08-19 Junjie Ye , Sixian Li , Guanyu Li , Caishuang Huang , Songyang Gao , Yilong Wu , Qi Zhang , Tao Gui , Xuanjing Huang

Tool learning has emerged as a promising direction by extending Large Language Models' (LLMs) capabilities with external tools. Existing tool learning studies primarily focus on the general-purpose tool-use capability, which addresses…

Computation and Language · Computer Science 2025-02-27 Qiancheng Xu , Yongqi Li , Heming Xia , Fan Liu , Min Yang , Wenjie Li

Tool learning empowers large language models (LLMs) as agents to use external tools and extend their utility. Existing methods employ one single LLM-based agent to iteratively select and execute tools, thereafter incorporating execution…

Computation and Language · Computer Science 2024-06-25 Zhengliang Shi , Shen Gao , Xiuyi Chen , Yue Feng , Lingyong Yan , Haibo Shi , Dawei Yin , Pengjie Ren , Suzan Verberne , Zhaochun Ren

Large Language Models (LLMs) have shown remarkable progress, but their real-world application necessitates reliable calibration. This study conducts a comprehensive analysis of calibration degradation of LLMs across four dimensions: models,…

Computation and Language · Computer Science 2025-02-11 Hongseok Oh , Wonseok Hwang

Large Language Models (LLMs) are increasingly being integrated into software development processes, with the potential to transform team workflows and productivity. This paper investigates how LLMs affect team collaboration throughout the…

Software Engineering · Computer Science 2025-10-13 Devang Dhanuka

Large Language Models (LLMs) have demonstrated remarkable progress in reasoning across diverse domains. However, effective reasoning in real-world tasks requires adapting the reasoning strategy to the demands of the problem, ranging from…

Computation and Language · Computer Science 2025-08-19 Xinda Jia , Jinpeng Li , Zezhong Wang , Jingjing Li , Xingshan Zeng , Yasheng Wang , Weinan Zhang , Yong Yu , Weiwen Liu

While Large Language Models (LLMs) are fundamentally next-token prediction systems, their practical applications extend far beyond this basic function. From natural language processing and text generation to conversational assistants and…

Computation and Language · Computer Science 2025-03-10 Vishakha Agrawal , Archie Chaudhury , Shreya Agrawal

Although Large Language Models (LLMs) excel in NLP tasks, they still need external tools to extend their ability. Current research on tool learning with LLMs often assumes mandatory tool use, which does not always align with real-world…

Computation and Language · Computer Science 2024-07-19 Kangyun Ning , Yisong Su , Xueqiang Lv , Yuanzhe Zhang , Jian Liu , Kang Liu , Jinan Xu

Large language model (LLM) agents with tool-calling capabilities are increasingly deployed in production systems, yet a fundamental reliability question remains under-explored: does the same agent behave the same way twice? We present a…

Computation and Language · Computer Science 2026-05-29 Abel Yagubyan

Large Language Models (LLMs) are increasingly employed for simulating human behaviors across diverse domains. However, our position is that current LLM-based human simulations remain insufficiently reliable, as evidenced by significant…

Computation and Language · Computer Science 2025-12-02 Qian Wang , Jiaying Wu , Zichen Jiang , Zhenheng Tang , Bingqiao Luo , Nuo Chen , Wei Chen , Bingsheng He

Large language models (LLMs) have exhibited remarkable capabilities across various domains. The ability to call external tools further expands their capability to handle real-world tasks. However, LLMs often follow an opaque reasoning…

Machine Learning · Computer Science 2025-11-20 Ruixin Zhang , Jon Donnelly , Zhicheng Guo , Ghazal Khalighinejad , Haiyang Huang , Alina Jade Barnett , Cynthia Rudin

Recent studies on software tool manipulation with large language models (LLMs) mostly rely on closed model APIs. The industrial adoption of these models is substantially constrained due to the security and robustness risks in exposing…

Computation and Language · Computer Science 2023-05-29 Qiantong Xu , Fenglu Hong , Bo Li , Changran Hu , Zhengyu Chen , Jian Zhang

Modern Large Language Models (LLMs) often require external tools, such as machine learning classifiers or knowledge retrieval systems, to provide accurate answers in domains where their pre-trained knowledge is insufficient. This…

Machine Learning · Computer Science 2025-05-23 Panagiotis Lymperopoulos , Vasanth Sarathy

The tool-use ability of Large Language Models (LLMs) has a profound impact on a wide range of industrial applications. However, LLMs' self-control and calibration capability in appropriately using tools remains understudied. The problem is…

Machine Learning · Computer Science 2024-12-18 Yuanhao Shen , Xiaodan Zhu , Lei Chen

Personalized chatbot-based teaching assistants can be crucial in addressing increasing classroom sizes, especially where direct teacher presence is limited. Large language models (LLMs) offer a promising avenue, with increasing research…

Human-Computer Interaction · Computer Science 2024-08-21 Harsh Kumar , Ilya Musabirov , Mohi Reza , Jiakai Shi , Xinyuan Wang , Joseph Jay Williams , Anastasia Kuzminykh , Michael Liut

As the applications of large language models (LLMs) expand across diverse fields, the ability of these models to adapt to ongoing changes in data, tasks, and user preferences becomes crucial. Traditional training methods, relying on static…

Machine Learning · Computer Science 2024-06-11 Junhao Zheng , Shengjie Qiu , Chengming Shi , Qianli Ma