English
Related papers

Related papers: SKILL0: In-Context Agentic Reinforcement Learning …

200 papers

ML-based motion planning is a promising approach to produce agents that exhibit complex behaviors, and automatically adapt to novel environments. In the context of autonomous driving, it is common to treat all available training data…

We study what actually works and what doesn't for training large language models as agents via multi-turn reinforcement learning. Despite rapid progress, existing frameworks and definitions are fragmented, and there is no systematic…

Machine Learning · Computer Science 2025-12-09 Ruiyi Wang , Prithviraj Ammanabrolu

Large language model agents increasingly rely on skill libraries for multi-step tasks, yet these libraries can accumulate persistent defects as skills are added, reused, patched, and linked to changing dependencies. We call this failure…

Software Engineering · Computer Science 2026-05-14 Hongji Pu , Xinyuan Song , Liang Zhao

Operating and maintaining (O&M) large-scale online engine systems (eg, search, recommendation and advertising) demands substantial human effort for release monitoring, alert response, and root cause analysis. Despite the inherent…

Artificial Intelligence · Computer Science 2026-05-12 Bochao Liu , Zhipeng Qian , Yang Zhao , Xinyuan Jiang , Zihan Liang , Yufei Ma , Junpeng Zhuang , Ben Chen , Shuo Yang , Hongen Wan , Yao Wu , Chenyi Lei , Xiao Liang

Zero-shot reinforcement learning (RL) has emerged as a setting for developing general agents, capable of solving downstream tasks without additional training or planning at test-time. While conventional RL optimizes policies for fixed…

Machine Learning · Computer Science 2026-03-10 Jacopo Di Ventura , Jan Felix Kleuker , Aske Plaat , Thomas Moerland

The development of a generalist agent with adaptive multiple manipulation skills has been a long-standing goal in the robotics community. In this paper, we explore a crucial task, skill-incremental learning, in robotic manipulation, which…

Robotics · Computer Science 2025-03-11 Zexin Zheng , Jia-Feng Cai , Xiao-Ming Wu , Yi-Lin Wei , Yu-Ming Tang , Wei-Shi Zheng

Reinforcement learning (RL) agents typically optimize their policies by performing expensive backward passes to update their network parameters. However, some agents can solve new tasks without updating any parameters by simply conditioning…

Machine Learning · Computer Science 2025-02-13 Amir Moeini , Jiuqi Wang , Jacob Beck , Ethan Blaser , Shimon Whiteson , Rohan Chandra , Shangtong Zhang

Large language models (LLMs) increasingly rely on multi-turn tool-integrated planning for knowledge-intensive and complex reasoning tasks. Existing implementations typically rely on a single agent, but they suffer from limited context…

Computation and Language · Computer Science 2025-10-07 Zhanfeng Mo , Xingxuan Li , Yuntao Chen , Lidong Bing

To succeed in common digital tasks such as web navigation, agents must carry out a variety of specialized tasks such as searching for products or planning a travel route. To tackle these tasks, agents can bootstrap themselves by learning…

Computation and Language · Computer Science 2025-09-01 Zora Zhiruo Wang , Apurva Gandhi , Graham Neubig , Daniel Fried

Coding agents produce rich trajectories while solving software-engineering tasks. To enable agent self-evolution, these trajectories can be distilled into reusable procedural skills that compactly encode experience to guide future behavior.…

Artificial Intelligence · Computer Science 2026-05-26 Yanzhou Li , Yiran Zhang , Xiaoyu Zhang , Xiaoxia Liu , Yang Liu

Hierarchies of temporally decoupled policies present a promising approach for enabling structured exploration in complex long-term planning problems. To fully achieve this approach an end-to-end training paradigm is needed. However,…

Machine Learning · Computer Science 2021-11-19 Abdul Rahman Kreidieh , Glen Berseth , Brandon Trabucco , Samyak Parajuli , Sergey Levine , Alexandre M. Bayen

Reusable skills let LLM agents package task-specific procedures, tool affordances, and execution guidance into modular building blocks. As skill ecosystems grow to tens of thousands of entries, exposing every skill at inference time becomes…

Machine Learning · Computer Science 2026-04-02 YanZhao Zheng , ZhenTao Zhang , Chao Ma , YuanQiang Yu , JiHuai Zhu , Yong Wu , Tianze Xu , Baohua Dong , Hangcheng Zhu , Ruohui Huang , Gang Yu

In the intrinsically motivated skills acquisition problem, the agent is set in an environment without any pre-defined goals and needs to acquire an open-ended repertoire of skills. To do so the agent needs to be autotelic (deriving from the…

Multiagent Systems · Computer Science 2023-07-13 Eleni Nisioti , Elías Masquil , Gautier Hamon , and Clément Moulin-Frier

Children can rapidly generalize compositionally-constructed rules to unseen test sets. On the other hand, deep reinforcement learning (RL) agents need to be trained over millions of episodes, and their ability to generalize to unseen…

Machine Learning · Computer Science 2024-05-06 Zijun Lin , Haidi Azaman , M Ganesh Kumar , Cheston Tan

Recent work has shown that, while large language models (LLMs) demonstrate strong word translation or bilingual lexicon induction (BLI) capabilities in few-shot setups, they still cannot match the performance of 'traditional' mapping-based…

Computation and Language · Computer Science 2024-06-06 Yaoyiran Li , Anna Korhonen , Ivan Vulić

Autonomous agents powered by large language models (LLMs) have the potential to enhance human capabilities, assisting with digital tasks from sending emails to performing data analysis. The abilities of existing LLMs at such tasks are often…

Machine Learning · Computer Science 2025-01-22 Hongjin Su , Ruoxi Sun , Jinsung Yoon , Pengcheng Yin , Tao Yu , Sercan Ö. Arık

Multi-Agent Reinforcement Learning (MARL) algorithms are widely adopted in tackling complex tasks that require collaboration and competition among agents in dynamic Multi-Agent Systems (MAS). However, learning such tasks from scratch is…

Artificial Intelligence · Computer Science 2024-02-14 Ayesha Siddika Nipu , Siming Liu , Anthony Harris

Soft real-time applications are becoming increasingly complex, posing significant challenges for scheduling offloaded tasks in edge computing environments while meeting task timing constraints. Moreover, the exponential growth of the search…

Machine Learning · Computer Science 2025-06-11 Amin Avan , Akramul Azim , Qusay Mahmoud

While unsupervised skill discovery has shown promise in autonomously acquiring behavioral primitives, there is still a large methodological disconnect between task-agnostic skill pretraining and downstream, task-aware finetuning. We present…

Machine Learning · Computer Science 2023-05-29 Ademi Adeniji , Amber Xie , Pieter Abbeel

To increase autonomy in reinforcement learning, agents need to learn useful behaviours without reliance on manually designed reward functions. To that end, skill discovery methods have been used to learn the intrinsic options available to…

Artificial Intelligence · Computer Science 2021-08-05 Even Klemsdal , Sverre Herland , Abdulmajid Murad