English
Related papers

Related papers: RS-Claw: Progressive Active Tool Exploration via H…

200 papers

Large Language Models (LLMs) have significantly advanced tool-augmented agents, enabling autonomous reasoning via API interactions. However, executing multi-step tasks within massive tool libraries remains challenging due to two critical…

Artificial Intelligence · Computer Science 2026-04-15 Rongzhe Wei , Ge Shi , Min Cheng , Na Zhang , Pan Li , Sarthak Ghosh , Vaibhav Gorde , Leman Akoglu

Large language models (LLMs) have recently emerged as promising tools for solving challenging robotic tasks, even in the presence of action and observation uncertainties. Recent LLM-based decision-making methods (also referred to as…

Artificial Intelligence · Computer Science 2024-09-20 Abhinav Jain , Chris Jermaine , Vaibhav Unhelkar

The rapid evolution of large language model (LLM)-driven autonomous agents has given rise to OpenClaw, a new class of open-source agent frameworks that operate as continuously running, skill-augmented systems with persistent memory,…

Artificial Intelligence · Computer Science 2026-05-26 Yuntao Wang , Jianle Ba , Han Liu , Yanghe Pan , Jintao Wei , Zhou Su , Tom H. Luan , Linkang Du

Reinforcement learning (RL) paradigms have demonstrated strong performance on reasoning-intensive tasks such as code generation. However, limited trajectory diversity often leads to diminishing returns, which constrains the achievable…

Artificial Intelligence · Computer Science 2026-04-17 Pengfei Li , Shijie Wang , Fangyuan Li , Yikun Fu , Kaifeng Liu , Kaiyan Zhang , Dazhi Zhang , Yuqiang Li , Biqing Qi , Bowen Zhou

Large language models (LLMs) have notably progressed in multi-step and long-chain reasoning. However, extending their reasoning capabilities to encompass deep interactions with search remains a non-trivial challenge, as models often fail to…

Computation and Language · Computer Science 2025-06-05 Qingfei Zhao , Ruobing Wang , Dingling Xu , Daren Zha , Limin Liu

Large Language Model (LLM) agents have shown strong results on multi-turn tool-use tasks, yet they operate in isolation during training, failing to leverage experiences accumulated across episodes. Existing experience-augmented methods…

Machine Learning · Computer Science 2026-03-20 Prince Zizhuang Wang , Shuli Jiang

As large language models (LLMs) evolve into agentic problem solvers, they increasingly rely on external, reusable skills to handle tasks beyond their native parametric capabilities. In existing agent systems, the dominant strategy for…

Computation and Language · Computer Science 2026-05-25 Weihang Su , Jianming Long , Qingyao Ai , Yichen Tang , Changyue Wang , Yiteng Tu , Yiqun Liu

Large Language Models (LLMs) have advanced artificial intelligence by enabling human-like text generation and natural language understanding. However, their reliance on static training data limits their ability to respond to dynamic,…

Artificial Intelligence · Computer Science 2026-04-02 Aditi Singh , Abul Ehtesham , Saket Kumar , Tala Talaei Khoei , Athanasios V. Vasilakos

Large Reasoning Models (LRMs) like o3 and DeepSeek-R1 have achieved remarkable progress in reasoning tasks with long cot. However, they remain computationally inefficient and struggle with accuracy when solving problems requiring complex…

Artificial Intelligence · Computer Science 2026-03-03 Haipeng Luo , Huawen Feng , Qingfeng Sun , Can Xu , Kai Zheng , Yufei Wang , Tao Yang , Han Hu , Yansong Tang

Despite impressive advancements in Visual-Language Models (VLMs) for multi-modal tasks, their reliance on RGB inputs limits precise spatial understanding. Existing methods for integrating spatial cues, such as point clouds or depth, either…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Yang Liu , Ming Ma , Xiaomin Yu , Pengxiang Ding , Han Zhao , Mingyang Sun , Siteng Huang , Donglin Wang

Developing autonomous LLM agents capable of making a series of intelligent decisions to solve complex, real-world tasks is a fast-evolving frontier. Like human cognitive development, agents are expected to acquire knowledge and skills…

While language models (LMs) have shown potential across a range of decision-making tasks, their reliance on simple acting processes limits their broad deployment as autonomous agents. In this paper, we introduce Language Agent Tree Search…

Artificial Intelligence · Computer Science 2024-06-07 Andy Zhou , Kai Yan , Michal Shlapentokh-Rothman , Haohan Wang , Yu-Xiong Wang

Reinforcement learning has empowered large language models to act as intelligent agents, yet training them for long-horizon tasks remains challenging due to the scarcity of high-quality trajectories, especially under limited resources.…

Machine Learning · Computer Science 2026-01-29 Jinyang Wu , Shuo Yang , Changpeng Yang , Yuhao Shen , Shuai Zhang , Zhengqi Wen , Jianhua Tao

Large language models (LLMs) exhibit strong symbolic and compositional reasoning, yet they struggle with time series question answering as the data is typically transformed into an LLM-compatible modality, e.g., serialized text, plotted…

Artificial Intelligence · Computer Science 2026-04-08 Penghang Liu , Elizabeth Fons , Annita Vapsi , Mohsen Ghassemi , Svitlana Vyetrenko , Daniel Borrajo , Vamsi K. Potluru , Manuela Veloso

Large Language Models (LLMs) are emerging as promising tools for automated reinforcement learning (RL) reward design, owing to their robust capabilities in commonsense reasoning and code generation. By engaging in dialogues with RL agents,…

Artificial Intelligence · Computer Science 2025-04-14 Zen Kit Heng , Zimeng Zhao , Tianhao Wu , Yuanfei Wang , Mingdong Wu , Yangang Wang , Hao Dong

Frontier language models have demonstrated strong reasoning and long-horizon tool-use capabilities. However, existing RAG systems fail to leverage these capabilities. They still rely on two paradigms: (1) designing an algorithm that…

Computation and Language · Computer Science 2026-02-04 Mingxuan Du , Benfeng Xu , Chiwei Zhu , Shaohan Wang , Pengyu Wang , Xiaorui Wang , Zhendong Mao

Tool learning with foundation models aims to endow AI systems with the ability to invoke external resources -- such as APIs, computational utilities, and specialized models -- to solve complex tasks beyond the reach of standalone language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Gabriele Mattioli , Evelyn Turri , Sara Sarto , Lorenzo Baraldi , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Large Language Models (LLMs) suffer from significant performance degradation when processing long contexts due to proactive interference, where irrelevant information in earlier parts of the context disrupts reasoning and memory recall.…

Computation and Language · Computer Science 2025-09-30 Mo Li , L. H. Xu , Qitai Tan , Long Ma , Ting Cao , Yunxin Liu

We introduce Agentic Reasoning, a framework that enhances large language model (LLM) reasoning by integrating external tool-using agents. Agentic Reasoning dynamically leverages web search, code execution, and structured memory to address…

Artificial Intelligence · Computer Science 2025-07-16 Junde Wu , Jiayuan Zhu , Yuyuan Liu , Min Xu , Yueming Jin

Large Language Model (LLM) Agents exhibit inherent reasoning abilities through the collaboration of multiple tools. However, during agent inference, existing methods often suffer from (i) locally myopic generation, due to the absence of…

Artificial Intelligence · Computer Science 2026-01-15 Jian Zhang , Zhiyuan Wang , Zhangqi Wang , Yu He , Haoran Luo , li yuan , Lingling Zhang , Rui Mao , Qika Lin , Jun Liu