English
Related papers

Related papers: Learning to Rewrite Tool Descriptions for Reliable…

200 papers

Large Language Models (LLMs) can enhance their capabilities as AI assistants by integrating external tools, allowing them to access a wider range of information. While recent LLMs are typically fine-tuned with tool usage examples during…

Computation and Language · Computer Science 2025-02-27 Jie He , Jennifer Neville , Mengting Wan , Longqi Yang , Hui Liu , Xiaofeng Xu , Xia Song , Jeff Z. Pan , Pei Zhou

Large language models are increasingly evaluated as interactive agents, yet standard agent benchmarks conflate two qualitatively distinct sources of success: semantic tool-use and interface-specific interaction pattern memorization. Because…

Machine Learning · Computer Science 2026-02-03 Weizheng Gu , Chengze Li , Zhuohao Yu , Mengyuan Sun , Zhibang Yang , Wei Wang , Hongrui Jia , Shikun Zhang , Wei Ye

Digital tool-based agents, powered by Large Language Models (LLMs), that invoke external Application Programming Interfaces (APIs) often rely on documentation to understand API functionality. However, such documentation is frequently…

Artificial Intelligence · Computer Science 2025-11-13 Bhrij Patel , Ashish Jagmohan , Aditya Vempaty

As Large Language Models increasingly automate complex, long-horizon tasks such as \emph{vibe coding}, a supervision gap has emerged. While models excel at execution, users often struggle to guide them effectively due to insufficient domain…

Artificial Intelligence · Computer Science 2026-02-09 Enyu Zhou , Zhiheng Xi , Long Ma , Zhihao Zhang , Shihan Dou , Zhikai Lei , Guoteng Wang , Rui Zheng , Hang Yan , Tao Gui , Qi Zhang , Xuanjing Huang

Developing effective instruction-following policies in reinforcement learning remains challenging due to the reliance on extensive human-labeled instruction datasets and the difficulty of learning from sparse rewards. In this paper, we…

Machine Learning · Computer Science 2025-06-26 Zhicheng Zhang , Ziyan Wang , Yali Du , Fei Fang

Autonomous agents, which perceive environments and take actions to achieve goals, have become increasingly feasible with the advancements in large language models (LLMs). However, current powerful agents often depend on sophisticated prompt…

Computation and Language · Computer Science 2025-05-27 Yihan Chen , Benfeng Xu , Xiaorui Wang , Yongdong Zhang , Zhendong Mao

Large Language Model (LLM) agents have developed rapidly in recent years to solve complex real-world problems using external tools. However, the scarcity of high-quality trajectories still hinders the development of stronger LLM agents.…

Artificial Intelligence · Computer Science 2025-12-08 Chen Yang , Ran Le , Yun Xing , Zhenwei An , Zongchao Chen , Wayne Xin Zhao , Yang Song , Tao Zhang

Existing Tool-Integrated Reasoning (TIR) models have effectively extended the question-answering capabilities of LLMs by incorporating external tools. However, real-world scenarios present numerous open-ended problems where fixed tools…

Artificial Intelligence · Computer Science 2026-02-03 Xintian Shen , Jiawei Chen , Lihao Zheng , Hao Ma , Tao Wei , Kun Zhan

Large Language Model (LLM) agents have emerged as powerful tools for automating complex tasks by leveraging the reasoning and decision-making abilities of LLMs. However, a major bottleneck in current agent frameworks lies in the high…

Artificial Intelligence · Computer Science 2025-11-19 Jingyi Jia , Qinbin Li

Modern research heavily relies on software. A significant challenge researchers face is understanding the complex software used in specific research fields. We target two scenarios in this context, namely long onboarding times for newcomers…

Software Engineering · Computer Science 2026-04-14 Adrian Bajraktari , Andreas Vogelsang

While large language models (LLMs) have substantially improved Text-to-SQL generation, a pronounced gap remains between AI systems and human experts on challenging benchmarks such as BIRD-SQL. We argue this gap stems largely from the…

Tool use has turned large language models (LLMs) into powerful agents that can perform complex multi-step tasks by dynamically utilising external software components. However, these tools must be implemented in advance by human developers,…

Computation and Language · Computer Science 2025-06-02 Georg Wölflein , Dyke Ferber , Daniel Truhn , Ognjen Arandjelović , Jakob Nikolas Kather

Despite the growing capabilities of autonomous agents powered by large language models (LLMs), their adoption in high-stakes domains remains limited. A key barrier is security: the inherently nondeterministic behavior of LLM agents defies…

Software Engineering · Computer Science 2026-02-12 Adam AlSayyad , Kelvin Yuxiang Huang , Richik Pal

Effective interactive tool use requires agents to master Tool Integrated Reasoning (TIR): a complex process involving multi-turn planning and long-context dialogue management. To train agents for this dynamic process, particularly in…

Computation and Language · Computer Science 2025-09-19 Weiting Tan , Xinghua Qu , Ming Tu , Meng Ge , Andy T. Liu , Philipp Koehn , Lu Lu

Agentic AI architectures augment LLMs with external tools, unlocking strong capabilities. However, tool use is not always beneficial; some calls may be redundant or even harmful. Effective tool use, therefore, hinges on a core LLM decision:…

Artificial Intelligence · Computer Science 2026-05-04 Qinyuan Wu , Soumi Das , Mahsa Amani , Arijit Nag , Seungeon Lee , Krishna P. Gummadi , Abhilasha Ravichander , Muhammad Bilal Zafar

Sequential multi-agent systems built with large language models (LLMs) can automate complex software tasks, but they are hard to trust because errors quietly pass from one stage to the next. We study a traceable and accountable pipeline,…

Artificial Intelligence · Computer Science 2025-10-10 Amine Barrak

Large Language Models (LLMs) often generate substantively relevant content but fail to adhere to formal constraints, leading to outputs that are conceptually correct but procedurally flawed. Traditional prompt refinement approaches focus on…

Artificial Intelligence · Computer Science 2026-01-08 Alberto Purpura , Li Wang , Sahil Badyal , Eugenio Beaufrand , Adam Faulkner

Reinforcement learning (RL) has become a prevalent paradigm for training tool calling agents, which typically requires online interactive environments. Existing approaches either rely on training data with ground truth annotations or…

Machine Learning · Computer Science 2026-05-08 Chenming Tang , Hsiu-Yuan Huang , Weijie Liu , Junqiang Zheng , Saiyong Yang , Yunfang Wu

LLM-based deep research agents are largely built on the ReAct framework. This linear design makes it difficult to revisit earlier states, branch into alternative search directions, or maintain global awareness under long contexts, often…

Retrieval-Augmented Generation (RAG) delivers substantial value in knowledge-intensive applications. However, its generated responses often lack transparent reasoning paths that trace back to source evidence from retrieved documents. This…

Computation and Language · Computer Science 2026-01-30 Jingyi Ren , Yekun Xu , Xiaolong Wang , Weitao Li , Ante Wang , Weizhi Ma , Yang Liu