English
Related papers

Related papers: UniToolCall: Unifying Tool-Use Representation, Dat…

200 papers

The recent paradigm shift toward large reasoning models (LRMs) as autonomous agents has intensified the demand for sophisticated, multi-turn tool-use capabilities. Yet, existing datasets and data-generation approaches are limited by static,…

Computation and Language · Computer Science 2026-01-14 Jungho Cho , Minbyul Jeong , Sungrae Park

Effective interactive tool use requires agents to master Tool Integrated Reasoning (TIR): a complex process involving multi-turn planning and long-context dialogue management. To train agents for this dynamic process, particularly in…

Computation and Language · Computer Science 2025-09-19 Weiting Tan , Xinghua Qu , Ming Tu , Meng Ge , Andy T. Liu , Philipp Koehn , Lu Lu

Tool-using LLM agents produce trajectories whose calls form a directed dependency graph: earlier tool outputs supply arguments to later calls. Whether this execution structure is represented inside the model is unknown; prior structural…

Computation and Language · Computer Science 2026-05-26 Tianda Sun , Dimitar Kazakov

Enabling Large Language Models (LLMs) to reliably invoke external tools remains a critical bottleneck for autonomous agents. Existing approaches suffer from three fundamental challenges: expensive human annotation for high-quality…

Computation and Language · Computer Science 2025-12-30 Yuwen Li , Wei Zhang , Zelong Huang , Mason Yang , Jiajun Wu , Shawn Guo , Huahao Hu , Lingyi Sun , Jian Yang , Mingjie Tang , Byran Dai

Tool learning, which enables large language models (LLMs) to utilize external tools effectively, has garnered increasing attention for its potential to revolutionize productivity across industries. Despite rapid development in tool…

Artificial Intelligence · Computer Science 2025-05-20 Haotian Chen , Zijun Song , Boye Niu , Ke Zhang , Litu Ou , Yaxi Lu , Zhong Zhang , Xin Cong , Yankai Lin , Zhiyuan Liu , Maosong Sun

Enabling Large Language Models (LLMs) to effectively utilize tools in multi-turn interactions is essential for building capable autonomous agents. However, acquiring diverse and realistic multi-turn tool-use data remains a significant…

Computation and Language · Computer Science 2026-01-16 Zhihao Xu , Rumei Li , Jiahuan Li , Rongxiang Weng , Jingang Wang , Xunliang Cai , Xiting Wang

While integrating tools like Code Interpreter and Search has significantly enhanced Large Language Model (LLM) reasoning in models like ChatGPT Agent and Gemini-Pro, practical guidance on optimal tool use is lacking. The core challenge is…

Computation and Language · Computer Science 2025-10-03 Yongchao Chen , Jiefeng Chen , Rui Meng , Ji Yin , Na Li , Chuchu Fan , Chi Wang , Tomas Pfister , Jinsung Yoon

Existing MLLM benchmarks face significant challenges in evaluating Unified MLLMs (U-MLLMs) due to: 1) lack of standardized benchmarks for traditional tasks, leading to inconsistent comparisons; 2) absence of benchmarks for mixed-modality…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Wulin Xie , Yi-Fan Zhang , Chaoyou Fu , Yang Shi , Bingyan Nie , Hongkai Chen , Zhang Zhang , Liang Wang , Tieniu Tan

The rapidly growing demand for high-quality data in Large Language Models (LLMs) has intensified the need for scalable, reliable, and semantically rich data preparation pipelines. However, current practices remain dominated by ad-hoc…

Large-scale models have exhibited remarkable capabilities across diverse domains, including automated medical services and intelligent customer support. However, as most large models are trained on single-modality corpora, enabling them to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Hao Sun , Yu Song , Jiaqing Liu , Jihong Hu , Yen-Wei Chen , Lanfen Lin

Multi-turn tool calling is essential for LLMs to function as autonomous agents, yet synthesizing the training data required for these capabilities remains a fundamental challenge. Existing synthetic data generation pipelines often produce…

Computation and Language · Computer Science 2026-05-14 Dinesh Khandelwal , Gnana Prakash Punnavajhala , GPS Bhargav , Gaurav Pandey , Sachin Joshi , Hima Karanam , Dinesh Raghu

Recently, the astonishing performance of large language models (LLMs) in natural language comprehension and generation tasks triggered lots of exploration of using them as central controllers to build agent systems. Multiple studies focus…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Chenyu Wang , Weixin Luo , Sixun Dong , Xiaohua Xuan , Zhengxin Li , Lin Ma , Shenghua Gao

Large language models (LLMs) have exhibited the ability to effectively utilize external tools to address user queries. However, their performance may be limited in complex, multi-turn interactions involving users and multiple tools. To…

Computation and Language · Computer Science 2025-03-12 Fan Yin , Zifeng Wang , I-Hung Hsu , Jun Yan , Ke Jiang , Yanfei Chen , Jindong Gu , Long T. Le , Kai-Wei Chang , Chen-Yu Lee , Hamid Palangi , Tomas Pfister

Travel planning is a natural real-world task to test large language models' (LLMs) planning and tool-use abilities. Although prior work has studied LLM performance on travel planning, existing settings still differ from real-world needs,…

Artificial Intelligence · Computer Science 2026-04-22 Xiang Cheng , Yulan Hu , Xiangwen Zhang , Lu Xu , Lide Tan , Zheng Pan , Xin Li , Yong Liu

To address intricate real-world tasks, there has been a rising interest in tool utilization in applications of large language models (LLMs). To develop LLM-based agents, it usually requires LLMs to understand many tool functions from…

Computation and Language · Computer Science 2024-03-28 Siyu Yuan , Kaitao Song , Jiangjie Chen , Xu Tan , Yongliang Shen , Ren Kan , Dongsheng Li , Deqing Yang

Tool retrieval is a critical component in enabling large language models (LLMs) to interact effectively with external tools. It aims to precisely filter the massive tools into a small set of candidates for the downstream tool-augmented…

Information Retrieval · Computer Science 2025-07-03 Jianghao Lin , Xinyuan Wang , Xinyi Dai , Menghui Zhu , Bo Chen , Ruiming Tang , Yong Yu , Weinan Zhang

Large language models (LLMs) are increasingly relied upon for complex multi-turn conversations across diverse real-world applications. However, existing benchmarks predominantly focus on single-turn evaluations, overlooking the models'…

Computation and Language · Computer Science 2024-01-31 Wai-Chung Kwan , Xingshan Zeng , Yuxin Jiang , Yufei Wang , Liangyou Li , Lifeng Shang , Xin Jiang , Qun Liu , Kam-Fai Wong

LLM-based function calling enables intelligent agents to interact with external tools and environments, yet autoregressive decoding imposes a fundamental latency bottleneck that limits real-time applications such as embodied intelligence,…

Computation and Language · Computer Science 2026-03-03 Xiaoxin Shi , Jiaxin Wan , Linkang Dong , Wei Jiang , Yue Liu , Zengfeng Huang

Recent advances in large language models (LLMs) have sparked growing interest in building generalist agents that can learn through online interactions. However, applying reinforcement learning (RL) to train LLM agents in multi-turn,…

Artificial Intelligence · Computer Science 2025-10-07 Hanchen Zhang , Xiao Liu , Bowen Lv , Xueqiao Sun , Bohao Jing , Iat Long Iong , Zhenyu Hou , Zehan Qi , Hanyu Lai , Yifan Xu , Rui Lu , Hongning Wang , Jie Tang , Yuxiao Dong

Large Language Models (LLMs) have demonstrated remarkable capabilities in software engineering, yet comprehensive benchmarks covering diverse SE activities remain limited. We present a multi-task evaluation of 11 state-of-the-art LLMs…

Software Engineering · Computer Science 2026-02-10 Go Frendi Gunawan , Mukhlis Amien