English
Related papers

Related papers: Skill-Pro: Learning Reusable Skills from Experienc…

200 papers

Reinforcement learning (RL) is a fundamental framework for sequential decision-making, in which an agent learns an optimal policy through interactions with an unknown environment. In settings with function approximation, many existing RL…

Machine Learning · Computer Science 2026-05-05 Ruiquan Huang , Donghao Li , Yingbin Liang , Jing Yang

Reusable skills let LLM agents package task-specific procedures, tool affordances, and execution guidance into modular building blocks. As skill ecosystems grow to tens of thousands of entries, exposing every skill at inference time becomes…

Machine Learning · Computer Science 2026-04-02 YanZhao Zheng , ZhenTao Zhang , Chao Ma , YuanQiang Yu , JiHuai Zhu , Yong Wu , Tianze Xu , Baohua Dong , Hangcheng Zhu , Ruohui Huang , Gang Yu

A persistent skill library allows language model agents to reuse successful strategies across tasks. Maintaining such a library requires three coupled capabilities. The agent selects a relevant skill, utilizes it during execution, and…

Artificial Intelligence · Computer Science 2026-05-13 Yaorui Shi , Yuxin Chen , Zhengxi Lu , Yuchun Miao , Shugui Liu , Qi GU , Xunliang Cai , Xiang Wang , An Zhang

Building a lifelong robot that can effectively leverage prior knowledge for continuous skill acquisition remains significantly challenging. Despite the success of experience replay and parameter-efficient methods in alleviating catastrophic…

Robotics · Computer Science 2025-06-03 Yuanqi Yao , Siao Liu , Haoming Song , Delin Qu , Qizhi Chen , Yan Ding , Bin Zhao , Zhigang Wang , Xuelong Li , Dong Wang

In virtual reality (VR) educational scenarios, Pedagogical agents (PAs) enhance immersive learning through realistic appearances and interactive behaviors. However, most existing PAs rely on static speech and simple gestures. This…

Human-Computer Interaction · Computer Science 2026-03-11 Ninghao Wan , Jiarun Song , Fuzheng Yang

Memory-augmented LLM agents offer an appealing shortcut to continual learning: rather than updating model parameters, they accumulate experience in external memory, seemingly sidestepping the stability-plasticity dilemma of parametric…

Machine Learning · Computer Science 2026-05-01 Qisheng Hu , Quanyu Long , Wenya Wang

Agent Skills, structured packages of procedural knowledge loaded into an LLM agent at inference time, are widely reported to improve task pass rates by an average of 16.2~percentage points across diverse domains. Yet the same benchmarks…

Artificial Intelligence · Computer Science 2026-05-26 Samuel Jacob Chacko , James Hugglestone , Chashi Mahiul Islam , Xiuwen Liu

The ability of Large Language Models (LLMs) to extract context from natural language problem descriptions naturally raises questions about their suitability in autonomous decision-making settings. This paper studies the behaviour of these…

Artificial Intelligence · Computer Science 2025-07-22 Xiao Yang , Juxi Leitner , Michael Burke

While LLM-based agents excel at planning and executing long action sequences, their execution often remains inconsistent across trials, limiting reliability. Consolidating agent consistency requires distilling trial-error trajectories into…

Machine Learning · Computer Science 2026-05-12 Zihan Huang , Junda Wu , Tong Yu , Qianqi Yan , Rohan Surana , Uttaran Bhattacharya , Lina Yao , Xin Eric Wang , Julian McAuley

Large Language Models (LLMs) have demonstrated profound impact on Natural Language Processing (NLP) tasks. However, their effective deployment across diverse domains often require domain-specific adaptation strategies, as generic models may…

Artificial Intelligence · Computer Science 2025-10-15 Jingyi Wang , Hongyuan Zhu , Ye Niu , Yunhui Deng

Large language models (LLMs) hold promise for generating plans for complex tasks, but their effectiveness is limited by sequential execution, lack of control flow models, and difficulties in skill retrieval. Addressing these issues is…

Computation and Language · Computer Science 2024-10-18 Andrei Cosmin Redis , Mohammadreza Fani Sani , Bahram Zarrin , Andrea Burattin

Memory-augmented LLM agents enable interactions that extend beyond finite context windows by storing, updating, and reusing information across sessions. However, training such agents with reinforcement learning in multi-session environments…

Machine Learning · Computer Science 2026-05-22 Sikuan Yan , Ahmed Bahloul , Ercong Nie , Susanna Schwarzmann , Riccardo Trivisonno , Volker Tresp , Yunpu Ma

Deploying large language model (LLM)-driven conversational agents in enterprise settings requires prompts that are simultaneously correct at launch and resilient to the non-deterministic behavioral drift that characterizes production LLM…

Artificial Intelligence · Computer Science 2026-05-18 Keshava Chaitanya , Jahnavi Gundakaram

Symbolic planning can provide an intuitive interface for non-expert users to operate autonomous robots by abstracting away much of the low-level programming. However, symbolic planners assume that the initially provided abstract domain and…

Robotics · Computer Science 2024-10-30 Julian Förster , Lionel Ott , Juan Nieto , Roland Siegwart , Jen Jen Chung

Embodied task planning requires agents to execute long-horizon, goal-directed actions in complex 3D environments, where success depends on both immediate perception and accumulated experience across tasks. However, most existing LLM-based…

Robotics · Computer Science 2026-04-21 Xiaoyu Ma , Lianyu Hu , Wenbing Tang , Zixuan Hu , Zeqin Liao , Zhizhen Wu , Yang Liu

Vision-Language-Action (VLA) models have shown strong potential for general-purpose robotic manipulation, but their reliance on expert demonstrations limits their ability to learn from failures and perform self-corrections. Reinforcement…

Robotics · Computer Science 2025-11-13 Fangqi Zhu , Zhengyang Yan , Zicong Hong , Quanxin Shou , Xiao Ma , Song Guo

Social goods, such as healthcare, smart city, and information networks, often produce ordered event data in continuous time. The generative processes of these event data can be very complex, requiring flexible models to capture their…

Machine Learning · Computer Science 2020-12-29 Shuang Li , Shuai Xiao , Shixiang Zhu , Nan Du , Yao Xie , Le Song

Reinforcement Learning with Verifiable Rewards (RLVR) has advanced the reasoning capability of large language models (LLMs), enabling autonomous agents that can conduct effective multi-turn and tool-integrated reasoning. While instructions…

Machine Learning · Computer Science 2026-02-03 Han Zhou , Xingchen Wan , Ivan Vulić , Anna Korhonen

As large language models (LLMs) evolve into agentic problem solvers, they increasingly rely on external, reusable skills to handle tasks beyond their native parametric capabilities. In existing agent systems, the dominant strategy for…

Computation and Language · Computer Science 2026-05-25 Weihang Su , Jianming Long , Qingyao Ai , Yichen Tang , Changyue Wang , Yiteng Tu , Yiqun Liu

Agent skills, structured packages of procedural knowledge and executable resources that agents dynamically load at inference time, have become a reliable mechanism for augmenting LLM agents. Yet inference-time skill augmentation is…

Machine Learning · Computer Science 2026-05-18 Zhengxi Lu , Zhiyuan Yao , Jinyang Wu , Chengcheng Han , Qi Gu , Xunliang Cai , Weiming Lu , Jun Xiao , Yueting Zhuang , Yongliang Shen