English
Related papers

Related papers: Advancing Tool-Augmented Large Language Models via…

200 papers

Large language models (LLMs) have demonstrated remarkable potential in transforming recommender systems from implicit behavioral pattern matching to explicit intent reasoning. While RecGPT-V1 successfully pioneered this paradigm by…

We study why Tool-Integrated Reasoning (TIR) makes Large Language Models (LLMs) more capable. While LLMs integrated with tools like Python code interpreters show great promise, a principled theory explaining why this paradigm is effective…

Machine Learning · Computer Science 2025-08-27 Heng Lin , Zhongwen Xu

Tools are essential for large language models (LLMs) to acquire up-to-date information and take consequential actions in external environments. Existing work on tool-augmented LLMs primarily focuses on the broad coverage of tools and the…

Computation and Language · Computer Science 2024-03-08 Boshi Wang , Hao Fang , Jason Eisner , Benjamin Van Durme , Yu Su

Large Language Models (LLMs) have emerged as a transformative AI paradigm, profoundly influencing daily life through their exceptional language understanding and contextual generation capabilities. Despite their remarkable performance, LLMs…

Artificial Intelligence · Computer Science 2024-12-10 Yedi Zhang , Yufan Cai , Xinyue Zuo , Xiaokun Luan , Kailong Wang , Zhe Hou , Yifan Zhang , Zhiyuan Wei , Meng Sun , Jun Sun , Jing Sun , Jin Song Dong

Large language models (LLMs) have revolutionized algorithm development, yet their application in symbolic regression, where algorithms automatically discover symbolic expressions from data, remains limited. In this paper, we propose a…

Neural and Evolutionary Computing · Computer Science 2026-04-01 Hengzhe Zhang , Qi Chen , Bing Xue , Wolfgang Banzhaf , Mengjie Zhang

Large Language Models (LLMs) have demonstrated remarkable potential in handling complex reasoning tasks by generating step-by-step rationales.Some methods have proven effective in boosting accuracy by introducing extra verifiers to assess…

Computation and Language · Computer Science 2024-07-02 Mingqian He , Yongliang Shen , Wenqi Zhang , Zeqi Tan , Weiming Lu

Large language models (LLMs) have demonstrated remarkable reasoning capability in solving mathematical problems. However, existing approaches primarily focus on improving the quality of correct training data, e.g., distilling high-quality…

Machine Learning · Computer Science 2025-06-02 Zhuoshi Pan , Yu Li , Honglin Lin , Qizhi Pei , Zinan Tang , Wei Wu , Chenlin Ming , H. Vicky Zhao , Conghui He , Lijun Wu

Recent advances in prompt optimization, exemplified by methods such as TextGrad, enable automatic, gradient-like refinement of textual prompts to enhance the performance of large language models (LLMs) on specific downstream tasks. However,…

Artificial Intelligence · Computer Science 2025-08-27 Chunlong Wu , Zhibo Qu

Despite the advancements of open-source large language models (LLMs), e.g., LLaMA, they remain significantly limited in tool-use capabilities, i.e., using external tools (APIs) to fulfill human instructions. The reason is that current…

Self-reflection mechanisms that rely on purely text-based rethinking processes perform well in most multimodal tasks. However, when directly applied to long-form video understanding scenarios, they exhibit clear limitations. The fundamental…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Jiaze Li , Hao Yin , Wenhui Tan , Jingyang Chen , Boshen Xu , Yuxun Qu , Yijing Chen , Jianzhong Ju , Zhenbo Luo , Jian Luan

Tool learning with foundation models aims to endow AI systems with the ability to invoke external resources -- such as APIs, computational utilities, and specialized models -- to solve complex tasks beyond the reach of standalone language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Gabriele Mattioli , Evelyn Turri , Sara Sarto , Lorenzo Baraldi , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Large language models (LLMs) are becoming the foundation for autonomous agents that can use tools to solve complex tasks. Reinforcement learning (RL) has emerged as a common approach for injecting such agentic capabilities, but typically…

Machine Learning · Computer Science 2026-02-26 Emre Can Acikgoz , Cheng Qian , Jonas Hübotter , Heng Ji , Dilek Hakkani-Tür , Gokhan Tur

In real-world applications with Large Language Models (LLMs), external retrieval mechanisms - such as Search-Augmented Generation (SAG), tool utilization, and Retrieval-Augmented Generation (RAG) - are often employed to enhance the quality…

Computation and Language · Computer Science 2025-02-25 Tzu-Lin Kuo , Feng-Ting Liao , Mu-Wei Hsieh , Fu-Chieh Chang , Po-Chun Hsu , Da-Shan Shiu

Experience-driven self-evolving agents aim to overcome the static nature of large language models by distilling reusable experience from past interactions, thus enabling adaptation to novel tasks at deployment time. This process places…

Artificial Intelligence · Computer Science 2026-05-12 Zhiyuan Fan , Wenwei Jin , Feng Zhang , Bin Li , Yihong Dong , Yao Hu , Jiawei Li

Tool-augmented Large Language Models (TaLLMs) extend LLMs with the ability to invoke external tools, enabling them to interact with real-world environments. However, a major limitation in deploying TaLLMs in sensitive applications such as…

Software Engineering · Computer Science 2026-03-24 Cailin Winston , Claris Winston , René Just

Large vision-language models (LVLMs) have shown promising performance on a variety of vision-language tasks. However, they remain susceptible to hallucinations, generating outputs misaligned with visual content or instructions. While…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Jinrui Zhang , Teng Wang , Haigang Zhang , Ping Lu , Feng Zheng

Large language models (LLMs) have introduced substantial challenges to software quality assurance due to their generative, probabilistic, and open-ended nature, which intensifies the oracle problem and limits the applicability of…

Software Engineering · Computer Science 2026-05-15 Zheng Zheng , Zenghui Zhou , Yinwang Xu , Daixu Ren , Tsong Yueh Chen

Tool-augmented language models have demonstrated strong capabilities, but their reliance on live API access creates scalability and reliability challenges during training and deployment. We propose MTR, a simulation-first training framework…

Computation and Language · Computer Science 2025-10-10 Chenpeng Wang , Xiaojie Cheng , Chunye Wang , Linfeng Yang , Lei Zhang

Reinforcement learning (RL) has demonstrated potential in enhancing the reasoning capabilities of large language models (LLMs), but such training typically demands substantial efforts in creating and annotating data. In this work, we…

Computation and Language · Computer Science 2025-10-06 Hangfan Zhang , Siyuan Xu , Zhimeng Guo , Huaisheng Zhu , Shicheng Liu , Xinrun Wang , Qiaosheng Zhang , Yang Chen , Peng Ye , Lei Bai , Shuyue Hu

Large Language Models (LLMs) have demonstrated remarkable proficiency in vulnerability detection. However, a critical reliability gap persists: models frequently yield correct detection verdicts based on hallucinated logic or superficial…

Cryptography and Security · Computer Science 2026-02-09 Li Lu , Yanjie Zhao , Hongzhou Rao , Kechi Zhang , Haoyu Wang