English
Related papers

Related papers: SkillRL: Evolving Agents via Recursive Skill-Augme…

200 papers

Large language models (LLMs) have shown remarkable potential as autonomous agents, particularly in web-based tasks. However, existing LLM web agents heavily rely on expensive proprietary LLM APIs, while open LLMs lack the necessary…

Computation and Language · Computer Science 2025-01-28 Zehan Qi , Xiao Liu , Iat Long Iong , Hanyu Lai , Xueqiao Sun , Wenyi Zhao , Yu Yang , Xinyue Yang , Jiadai Sun , Shuntian Yao , Tianjie Zhang , Wei Xu , Jie Tang , Yuxiao Dong

Large Language Model (LLM) Agents, often trained with Reinforcement Learning (RL), are constrained by a dependency on human-curated data, limiting scalability and tethering AI to human knowledge. Existing self-evolution frameworks offer an…

Machine Learning · Computer Science 2025-11-21 Peng Xia , Kaide Zeng , Jiaqi Liu , Can Qin , Fang Wu , Yiyang Zhou , Caiming Xiong , Huaxiu Yao

Large Language Model (LLM) agents can leverage multiple turns and tools to solve complex tasks, with prompt-based approaches achieving strong performance. This work demonstrates that Reinforcement Learning (RL) can push capabilities…

Computation and Language · Computer Science 2025-10-29 Vivek Kalyan , Martin Andrews

Generating complex, logically-sound SPARQL queries for multi-hop questions remains a critical bottleneck for Knowledge Graph Question Answering, as the brittle nature of one-shot generation by Large Language Models (LLMs) hinders reliable…

Artificial Intelligence · Computer Science 2025-11-18 Floris Vossebeld , Shenghui Wang

Large Language Models (LLMs) often struggle with problems that require multi-step reasoning. For small-scale open-source models, Reinforcement Learning with Verifiable Rewards (RLVR) fails when correct solutions are rarely sampled even…

Computation and Language · Computer Science 2026-03-02 Yihe Deng , I-Hung Hsu , Jun Yan , Zifeng Wang , Rujun Han , Gufeng Zhang , Yanfei Chen , Wei Wang , Tomas Pfister , Chen-Yu Lee

As agentic AI becomes more widespread, agents with distinct and possibly conflicting goals will interact in complex ways. These multi-agent interactions pose a fundamental challenge, particularly in social dilemmas, where agents' individual…

Machine Learning · Computer Science 2025-12-02 Dereck Piche , Mohammed Muqeeth , Milad Aghajohari , Juan Duque , Michael Noukhovitch , Aaron Courville

Reinforcement Learning (RL) is a popular machine learning paradigm where intelligent agents interact with the environment to fulfill a long-term goal. Driven by the resurgence of deep learning, Deep RL (DRL) has witnessed great success over…

Machine Learning · Computer Science 2025-09-01 Yunpeng Qing , Shunyu Liu , Jie Song , Yang Zhou , Kaixuan Chen , Huiqiong Wang , Mingli Song

Large language model (LLM) agents are increasingly used for complex tasks, yet deployed agents often remain static, failing to adapt as user needs evolve. This creates a tension between the need for continuous service and the necessity of…

Machine Learning · Computer Science 2026-03-19 Peng Xia , Jianwen Chen , Xinyu Yang , Haoqin Tu , Jiaqi Liu , Kaiwen Xiong , Siwei Han , Shi Qiu , Haonian Ji , Yuyin Zhou , Zeyu Zheng , Cihang Xie , Huaxiu Yao

Solving long-horizon, temporally-extended tasks using Reinforcement Learning (RL) is challenging, compounded by the common practice of learning without prior knowledge (or tabula rasa learning). Humans can generate and execute plans with…

Machine Learning · Computer Science 2023-11-10 Bharat Prakash , Tim Oates , Tinoosh Mohsenin

Reinforcement learning (RL) has increasingly become a pivotal technique in the post-training of large language models (LLMs). The effective exploration of the output space is essential for the success of RL. We observe that for complex…

Machine Learning · Computer Science 2025-07-08 Shihan Dou , Muling Wu , Jingwen Xu , Rui Zheng , Tao Gui , Qi Zhang , Xuanjing Huang

AI agents, empowered by Large Language Models (LLMs) and communication protocols such as MCP and A2A, have rapidly evolved from simple chatbots to autonomous entities capable of executing complex, multi-step tasks, demonstrating great…

Machine Learning · Computer Science 2025-05-26 Erhu Feng , Wenbo Zhou , Zibin Liu , Le Chen , Yunpeng Dong , Cheng Zhang , Yisheng Zhao , Dong Du , Zhichao Hua , Yubin Xia , Haibo Chen

Agentic reinforcement learning (RL) for Large Language Models (LLMs) critically depends on the exploration capability of the base policy, as training signals emerge only within its in-capability region. For tasks where the base policy…

Computation and Language · Computer Science 2026-05-13 Yuxiang Ji , Zengbin Wang , Yong Wang , Shidong Yang , Ziyu Ma , Guanhua Chen , Zonghua Sun , Liaoni Wu , Xiangxiang Chu

Large Language Models (LLMs) increasingly rely on agentic capabilities-iterative retrieval, tool use, and decision-making-to overcome the limits of static, parametric knowledge. Yet existing agentic frameworks treat external information as…

Computation and Language · Computer Science 2026-04-24 Yuanfu Sun , Kang Li , Dongzhe Fan , Jiajin Liu , Qiaoyu Tan

Deep reinforcement learning (DRL) shows promising potential for autonomous driving decision-making. However, DRL demands extensive computational resources to achieve a qualified policy in complex driving scenarios due to its low learning…

Robotics · Computer Science 2024-12-25 Hao Pang , Zhenpo Wang , Guoqiang Li

Inspired by the insights in cognitive science with respect to human memory and reasoning mechanism, a novel evolvable LLM-based (Large Language Model) agent framework is proposed as REMEMBERER. By equipping the LLM with a long-term…

Computation and Language · Computer Science 2023-10-31 Danyang Zhang , Lu Chen , Situo Zhang , Hongshen Xu , Zihan Zhao , Kai Yu

Effective human-agent collaboration is increasingly prevalent in real-world applications. Current trends in such collaborations are predominantly unidirectional, with users providing instructions or posing questions to agents, where agents…

Artificial Intelligence · Computer Science 2025-12-16 Emre Can Acikgoz , Jinoh Oh , Jie Hao , Joo Hyuk Jeon , Heng Ji , Dilek Hakkani-Tür , Gokhan Tur , Xiang Li , Chengyuan Ma , Xing Fan

Reinforcement Learning (RL) has emerged as a powerful paradigm for training LLM-based agents, yet remains limited by low sample efficiency, stemming not only from sparse outcome feedback but also from the agent's inability to leverage prior…

Machine Learning · Computer Science 2026-03-19 Dilxat Muhtar , Jiashun Liu , Wei Gao , Weixun Wang , Shaopan Xiong , Ju Huang , Siran Yang , Wenbo Su , Jiamang Wang , Ling Pan , Bo Zheng

As large language models (LLMs) evolve into agentic problem solvers, they increasingly rely on external, reusable skills to handle tasks beyond their native parametric capabilities. In existing agent systems, the dominant strategy for…

Computation and Language · Computer Science 2026-05-25 Weihang Su , Jianming Long , Qingyao Ai , Yichen Tang , Changyue Wang , Yiteng Tu , Yiqun Liu

Skills have become the de facto way to enable LLM agents to perform complex real-world tasks with customized instructions, workflows, and tools, but how to learn them automatically and effectively remains unclear. We introduce…

Computation and Language · Computer Science 2026-04-23 Shanshan Zhong , Yi Lu , Jingjie Ning , Yibing Wan , Lihan Feng , Yuyi Ao , Leonardo F. R. Ribeiro , Markus Dreyer , Sean Ammirati , Chenyan Xiong

Reinforcement learning (RL) has demonstrated strong potential in training large language models (LLMs) capable of complex reasoning for real-world problem solving. More recently, RL has been leveraged to create sophisticated LLM-based…

Computation and Language · Computer Science 2025-05-22 Bowen Jin , Jinsung Yoon , Priyanka Kargupta , Sercan O. Arik , Jiawei Han