English
Related papers

Related papers: Evolving from Tool User to Creator via Training-Fr…

200 papers

Experience-driven self-evolving agents aim to overcome the static nature of large language models by distilling reusable experience from past interactions, thus enabling adaptation to novel tasks at deployment time. This process places…

Artificial Intelligence · Computer Science 2026-05-12 Zhiyuan Fan , Wenwei Jin , Feng Zhang , Bin Li , Yihong Dong , Yao Hu , Jiawei Li

Tool-integrated reasoning (TIR) augments large language models (LLMs) with the ability to invoke external tools during long-form reasoning, such as search engines and code interpreters, to solve tasks beyond the capabilities of internal…

Artificial Intelligence · Computer Science 2025-06-03 Hongru Wang , Cheng Qian , Wanjun Zhong , Xiusi Chen , Jiahao Qiu , Shijue Huang , Bowen Jin , Mengdi Wang , Kam-Fai Wong , Heng Ji

User simulators serve as the critical interactive environment for agent post-training, and an ideal user simulator generalizes across domains and proactively engages in negotiation by challenging or bargaining. However, current methods…

Computation and Language · Computer Science 2026-01-15 Feng Zhang , Shijia Li , Chunmao Zhang , Zhanyu Ma , Jun Xu , Jiuchong Gao , Jinghua Hao , Renqing He , Jingwen Xu , Han Liu

With their high information density and intuitive readability, charts have become the de facto medium for data analysis and communication across disciplines. Recent multimodal large language models (MLLMs) have made notable progress in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Boran Wang , Xinming Wang , Yi Chen , Xiang Li , Jian Xu , Jing Yuan , Chenglin Liu

Tool-Integrated Reasoning has emerged as a key paradigm to augment Large Language Models (LLMs) with computational capabilities, yet integrating tool-use into long Chain-of-Thought (long CoT) remains underexplored, largely due to the…

Computation and Language · Computer Science 2026-01-19 Kun Li , Zenan Xu , Junan Li , Zengrui Jin , Jinghao Deng , Zexuan Qiu , Bo Zhou

Effective interactive tool use requires agents to master Tool Integrated Reasoning (TIR): a complex process involving multi-turn planning and long-context dialogue management. To train agents for this dynamic process, particularly in…

Computation and Language · Computer Science 2025-09-19 Weiting Tan , Xinghua Qu , Ming Tu , Meng Ge , Andy T. Liu , Philipp Koehn , Lu Lu

Agentic reinforcement learning has advanced large language models (LLMs) to reason through long chain-of-thought trajectories while interleaving external tool use. Existing approaches assume a fixed inventory of tools, limiting LLM agents'…

Computation and Language · Computer Science 2025-12-16 Jiaru Zou , Ling Yang , Yunzhe Qi , Sirui Chen , Mengting Ai , Ke Shen , Jingrui He , Mengdi Wang

Effective tool use is essential for agentic AI, yet training agents to utilize tools remains challenging due to manually designed rewards, limited training data, and poor multi-tool selection, resulting in slow adaptation, wasted…

Artificial Intelligence · Computer Science 2026-01-13 Quy Minh Le , Minh Sao Khue Luu , Khanh-Tung Tran , Duc-Hai Nguyen , Hoang-Quoc-Viet Pham , Quan Le , Hoang Thanh Lam , Hoang D. Nguyen

Current Large Language Model (LLM) agents demonstrate strong reasoning and tool use capabilities, but often lack self-awareness, failing to balance these approaches effectively. This imbalance leads to Tool Overuse, where models…

Artificial Intelligence · Computer Science 2025-05-27 Cheng Qian , Emre Can Acikgoz , Hongru Wang , Xiusi Chen , Avirup Sil , Dilek Hakkani-Tür , Gokhan Tur , Heng Ji

Augmenting large language models (LLMs) with external tools has emerged as a promising approach to extend their utility, enabling them to solve practical tasks. Previous methods manually parse tool documentation and create in-context…

Computation and Language · Computer Science 2025-03-05 Zhengliang Shi , Shen Gao , Lingyong Yan , Yue Feng , Xiuyi Chen , Zhumin Chen , Dawei Yin , Suzan Verberne , Zhaochun Ren

The central challenge of AI for Science is not reasoning alone, but the ability to create computational methods in an open-ended scientific world. Existing LLM-based agents rely on static, pre-defined tool libraries, a paradigm that…

Artificial Intelligence · Computer Science 2026-01-13 Jiaxuan Lu , Ziyu Kong , Yemin Wang , Rong Fu , Haiyuan Wan , Cheng Yang , Wenjie Lou , Haoran Sun , Lilong Wang , Yankai Jiang , Xiaosong Wang , Xiao Sun , Dongzhan Zhou

Integrating robotics into everyday scenarios like tutoring or physical training requires robots capable of adaptive, socially engaging, and goal-oriented interactions. While Large Language Models show promise in human-like communication,…

Robotics · Computer Science 2025-04-03 Luca Garello , Giulia Belgiovine , Gabriele Russo , Francesco Rea , Alessandra Sciutti

Large language models (LLMs) have recently demonstrated remarkable capabilities across domains, tasks, and languages (e.g., ChatGPT and GPT-4), reviving the research of general autonomous agents with human-like cognitive abilities. Such…

Artificial Intelligence · Computer Science 2025-03-07 Pengbo Hu , Xiang Ying

Large Language Models (LLMs) have revolutionized recommendation agents by providing superior reasoning and flexible decision-making capabilities. However, existing methods mainly follow a passive information acquisition paradigm, where…

Information Retrieval · Computer Science 2026-03-11 Haobo Zhang , Yutao Zhu , Kelong Mao , Tianhao Li , Zhicheng Dou

Human-level driving is an ultimate goal of autonomous driving. Conventional approaches formulate autonomous driving as a perception-prediction-planning framework, yet their systems do not capitalize on the inherent reasoning ability and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Jiageng Mao , Junjie Ye , Yuxi Qian , Marco Pavone , Yue Wang

Autonomous agents powered by large language models (LLMs) have the potential to significantly enhance human productivity by reasoning, using tools, and executing complex tasks in diverse environments. However, current approaches to…

Vision-language agents have achieved remarkable progress in a variety of multimodal reasoning tasks; however, their learning remains constrained by the limitations of human-annotated supervision. Recent self-rewarding approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jiaqi Liu , Kaiwen Xiong , Peng Xia , Yiyang Zhou , Haonian Ji , Lu Feng , Siwei Han , Mingyu Ding , Huaxiu Yao

Agentic systems powered by Large Language Models (LLMs) have demonstrated remarkable potential in tackling complex, long-horizon tasks. However, their efficacy is fundamentally constrained by static configurations governing agent behaviors,…

Artificial Intelligence · Computer Science 2026-02-24 Jingqi Zhou , Sheng Wang , DeZhao Deng , Junwen Lu , Junwei Su , Qintong Li , Jiahui Gao , Hao Wu , Jiyue Jiang , Lingpeng Kong , Chuan Wu

Large language models (LLMs) have demonstrated strong reasoning and tool-use capabilities, yet they often fail in real-world tool-interactions due to incorrect parameterization, poor tool selection, or misinterpretation of user intent.…

Artificial Intelligence · Computer Science 2025-09-23 Hy Dang , Tianyi Liu , Zhuofeng Wu , Jingfeng Yang , Haoming Jiang , Tao Yang , Pei Chen , Zhengyang Wang , Helen Wang , Huasheng Li , Bing Yin , Meng Jiang

Recent work has shown that inference-time reasoning and reflection can improve text-to-image generation without retraining. However, existing approaches often rely on implicit, holistic critiques or unconstrained prompt rewrites, making…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 V. Kovalev , A. Kuvshinov , A. Buzovkin , D. Pokidov , D. Timonin