English
Related papers

Related papers: Tool-integrated Reinforcement Learning for Repo De…

200 papers

Tool learning aims to enhance and expand large language models' (LLMs) capabilities with external tools, which has gained significant attention recently. Current methods have shown that LLMs can effectively handle a certain amount of tools…

Computation and Language · Computer Science 2024-10-01 Qiancheng Xu , Yongqi Li , Heming Xia , Wenjie Li

Locating files and functions requiring modification in large software repositories is challenging due to their scale and structural complexity. Existing LLM-based methods typically treat this as a repository-level retrieval task and rely on…

Software Engineering · Computer Science 2026-05-27 Zhaoxi Zhang , Yitong Duan , Yanzhi Zhang , Yiming Xu , Zhixiang Wang , Kun Liang , Weikang Li , Jiahui Liang , Deguo Xia , Jizhou Huang , Jiyan He , Yunfang Wu

Tool-Integrated Reasoning (TIR) extends LLM capabilities by leveraging external environments. However, existing methods lack the deliberation during sequential tool invocation required for strategic planning and self-correction. While RL…

Artificial Intelligence · Computer Science 2026-05-29 Yang He , Xiao Ding , Bibo Cai , Yufei Zhang , Kai Xiong , Zhouhao Sun , Bing Qin , Ting Liu

Tool learning has emerged as a crucial capability for large language models (LLMs) to solve complex real-world tasks through interaction with external tools. Existing approaches face significant challenges, including reliance on…

Computation and Language · Computer Science 2025-06-02 Hanxing Ding , Shuchang Tao , Liang Pang , Zihao Wei , Jinyang Gao , Bolin Ding , Huawei Shen , Xueqi Cheng

While reasoning models (e.g., DeepSeek R1) trained with reinforcement learning (RL), excel in textual reasoning, they struggle in scenarios requiring structured problem-solving, such as geometric reasoning, concise computation, or complex…

Computation and Language · Computer Science 2025-04-18 Jiazhan Feng , Shijue Huang , Xingwei Qu , Ge Zhang , Yujia Qin , Baoquan Zhong , Chengquan Jiang , Jinxin Chi , Wanjun Zhong

Tool learning aims to augment large language models (LLMs) with diverse tools, enabling them to act as agents for solving practical tasks. Due to the limited context length of tool-using LLMs, adopting information retrieval (IR) models to…

Computation and Language · Computer Science 2025-05-27 Zhengliang Shi , Yuhan Wang , Lingyong Yan , Pengjie Ren , Shuaiqiang Wang , Dawei Yin , Zhaochun Ren

Effective tool use is essential for agentic AI, yet training agents to utilize tools remains challenging due to manually designed rewards, limited training data, and poor multi-tool selection, resulting in slow adaptation, wasted…

Artificial Intelligence · Computer Science 2026-01-13 Quy Minh Le , Minh Sao Khue Luu , Khanh-Tung Tran , Duc-Hai Nguyen , Hoang-Quoc-Viet Pham , Quan Le , Hoang Thanh Lam , Hoang D. Nguyen

Software issue localization, the task of identifying the precise code locations (files, classes, or functions) relevant to a natural language issue description (e.g., bug report, feature request), is a critical yet time-consuming aspect of…

Software Engineering · Computer Science 2026-04-23 Revanth Gangi Reddy , Tarun Suresh , JaeHyeok Doo , Ye Liu , Xuan Phi Nguyen , Yingbo Zhou , Semih Yavuz , Caiming Xiong , Heng Ji , Shafiq Joty

Tool-integrated reasoning (TIR) enables LLM agents to solve tasks through planning, tool use, and iterative revision, but outcome-only reinforcement learning in this setting suffers from sparse, delayed rewards and weak step-level credit…

Computation and Language · Computer Science 2026-02-11 Qiao Liang , Yuke Zhu , Chao Ge , Lei Yang , Ying Shen , Bo Zheng , Sheng Guo

Recent advancements in function calling and tool use have significantly enhanced the capabilities of large language models (LLMs) by enabling them to interact with external information sources and execute complex tasks. However, the limited…

Machine Learning · Computer Science 2024-09-05 Suhong Moon , Siddharth Jha , Lutfi Eren Erdogan , Sehoon Kim , Woosang Lim , Kurt Keutzer , Amir Gholami

Augmenting large language models (LLMs) with external tools is a promising approach to enhance their capabilities, especially for complex tasks. Synthesizing tool-use data through real-world simulations is an effective way to achieve this.…

Computation and Language · Computer Science 2025-11-10 Yirong Zeng , Xiao Ding , Yuxian Wang , Weiwen Liu , Wu Ning , Yutai Hou , Xu Huang , Duyu Tang , Dandan Tu , Bing Qin , Ting Liu

Tool calling has become increasingly popular for Large Language Models (LLMs). However, for large tool sets, the resulting tokens would exceed the LLM's context window limit, making it impossible to include every tool. Hence, an external…

Computation and Language · Computer Science 2026-03-03 Saptarshi Sengupta , Zhengyu Zhou , Jun Araki , Xingbo Wang , Bingqing Wang , Suhang Wang , Zhe Feng

Large language models (LLMs) are increasingly employed for complex multi-step planning tasks, where the tool retrieval (TR) step is crucial for achieving successful outcomes. Two prevalent approaches for TR are single-step retrieval, which…

Information Retrieval · Computer Science 2023-12-19 Raviteja Anantha , Bortik Bandyopadhyay , Anirudh Kashi , Sayantan Mahinder , Andrew W Hill , Srinivas Chappidi

Information retrieval systems are crucial for enabling effective access to large document collections. Recent approaches have leveraged Large Language Models (LLMs) to enhance retrieval performance through query augmentation, but often rely…

Information Retrieval · Computer Science 2025-04-15 Pengcheng Jiang , Jiacheng Lin , Lang Cao , Runchu Tian , SeongKu Kang , Zifeng Wang , Jimeng Sun , Jiawei Han

Tool-Integrated Reasoning (TIR) enables large language models (LLMs) to solve complex tasks by interacting with external tools, yet existing approaches depend on high-quality synthesized trajectories selected by scoring functions and sparse…

Artificial Intelligence · Computer Science 2026-02-02 Siyu Gong , Linan Yue , Weibo Gao , Fangzhou Yao , Shimin Di , Lei Feng , Min-Ling Zhang

Tool learning aims to extend the capabilities of large language models (LLMs) with external tools. A major challenge in tool learning is how to support a large number of tools, including unseen tools. To address this challenge, previous…

Information Retrieval · Computer Science 2024-06-12 Yuanhang Zheng , Peng Li , Wei Liu , Yang Liu , Jian Luan , Bin Wang

By augmenting Large Language Models (LLMs) with external tools, their capacity to solve complex problems has been significantly enhanced. However, despite ongoing advancements in the parsing capabilities of LLMs, incorporating all available…

Computation and Language · Computer Science 2025-11-24 Hang Gao , Yongfeng Zhang

Recent advancements in large language models (LLMs) integrated with external tools and APIs have successfully addressed complex tasks by using in-context learning or fine-tuning. Despite this progress, the vast scale of tool retrieval…

Information Retrieval · Computer Science 2024-10-07 Yuxiang Zhang , Xin Fan , Junjie Wang , Chongxian Chen , Fan Mo , Tetsuya Sakai , Hayato Yamana

Recent advances in large language models (LLMs) have demonstrated remarkable capabilities in reasoning and tool utilization. However, the generalization of tool-augmented reinforcement learning (RL) across diverse domains remains a…

Machine Learning · Computer Science 2026-01-08 Zhengyu Chen , Jinluan Yang , Teng Xiao , Ruochen Zhou , Luan Zhang , Xiangyu Xi , Xiaowei Shi , Wei Wang , Jinggang Wang

While language models have shown remarkable performance across diverse tasks, they still encounter challenges in complex reasoning scenarios. Recent research suggests that language models trained on linearized search traces toward…

Artificial Intelligence · Computer Science 2025-10-28 Seungyong Moon , Bumsoo Park , Hyun Oh Song
‹ Prev 1 2 3 10 Next ›