English
Related papers

Related papers: Skill-R1: Agent Skill Evolution via Reinforcement …

200 papers

Large Language Models (LLMs) increasingly rely on reinforcement learning with verifiable rewards (RLVR) to elicit reliable chain-of-thought reasoning. However, the training process remains bottlenecked by the computationally expensive…

Machine Learning · Computer Science 2026-01-13 Bingshuai Liu , Ante Wang , Zijun Min , Liang Yao , Haibo Zhang , Yang Liu , Xu Han , Peng Li , Anxiang Zeng , Jinsong Su

Reusable skills play a key role in improving LLM-based agents, but existing skill-evolution methods often fail to ensure that evolved skills both cover the knowledge required by the task and remain aligned with the target task. As a result,…

Computation and Language · Computer Science 2026-05-27 Dingzirui Wang , Xuanliang Zhang , Keyan Xu , Qingfu Zhu , Wanxiang Che , Yang Deng

Large Language Models (LLMs) are powerful but prone to hallucinations due to static knowledge. Retrieval-Augmented Generation (RAG) helps by injecting external information, but current methods often are costly, generalize poorly, or ignore…

Computation and Language · Computer Science 2025-05-23 Huatong Song , Jinhao Jiang , Wenqing Tian , Zhipeng Chen , Yuhuan Wu , Jiahao Zhao , Yingqian Min , Wayne Xin Zhao , Lei Fang , Ji-Rong Wen

Skill libraries have become a practical way for LLM agents to reuse procedural experience across tasks. However, existing systems typically treat skills as flat, single-resolution prompt blocks. This creates a tension between relevance and…

Artificial Intelligence · Computer Science 2026-05-12 Yongliang Miao , Ziyang Yu , Liang Zhao , Bowen Zhu , Hasibul Haque

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

Machine Learning · Statistics 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

Reinforcement learning has the potential to automate the acquisition of behavior in complex settings, but in order for it to be successfully deployed, a number of practical challenges must be addressed. First, in real world settings, when…

Machine Learning · Computer Science 2020-11-11 Kelvin Xu , Siddharth Verma , Chelsea Finn , Sergey Levine

With the rapid advancement of commercial multi-modal models, image editing has garnered significant attention due to its widespread applicability in daily life. Despite impressive progress, existing image editing systems, particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yiran Zhao , Yaoqi Ye , Xiang Liu , Michael Qizhe Shieh , Trung Bui

Recently, advanced large language models (LLMs) have emerged at an increasingly rapid pace. However, when faced with complex problems, most users are often unable to provide accurate and effective prompts to interact with LLMs, thus…

Computation and Language · Computer Science 2026-04-17 Wenjin Liu , Haoran Luo , Xueyuan Lin , Haoming Liu , Tiesunlong Shen , Jiapu Wang , Rui Mao , Erik Cambria

Large Language Models (LLMs) often struggle with problems that require multi-step reasoning. For small-scale open-source models, Reinforcement Learning with Verifiable Rewards (RLVR) fails when correct solutions are rarely sampled even…

Computation and Language · Computer Science 2026-03-02 Yihe Deng , I-Hung Hsu , Jun Yan , Zifeng Wang , Rujun Han , Gufeng Zhang , Yanfei Chen , Wei Wang , Tomas Pfister , Chen-Yu Lee

Multi-agent systems (MAS) and reinforcement learning (RL) are widely used to enhance the agentic capabilities of large language models (LLMs). MAS improves task performance through role-based orchestration, while RL uses environmental…

Machine Learning · Computer Science 2026-02-02 Yujie Zhao , Lanxiang Hu , Yang Wang , Minmin Hou , Hao Zhang , Ke Ding , Jishen Zhao

Learning from experience is critical for building capable large language model (LLM) agents, yet prevailing self-evolving paradigms remain inefficient: agents learn in isolation, repeatedly rediscover similar behaviors from limited…

Computation and Language · Computer Science 2026-04-21 Chenxi Wang , Zhuoyun Yu , Xin Xie , Wuguannan Yao , Runnan Fang , Shuofei Qiao , Kexin Cao , Guozhou Zheng , Xiang Qi , Peng Zhang , Shumin Deng

Skills learned through (deep) reinforcement learning often generalizes poorly across domains and re-training is necessary when presented with a new task. We present a framework that combines techniques in \textit{formal methods} with…

Artificial Intelligence · Computer Science 2018-05-22 Xiao Li , Yao Ma , Calin Belta

Reinforcement learning refers to a group of methods from artificial intelligence where an agent performs learning through trial and error. It differs from supervised learning, since reinforcement learning requires no explicit labels;…

Machine Learning · Computer Science 2018-10-02 Nicolas Pröllochs , Stefan Feuerriegel

Large Language Models (LLMs) agents are increasingly pivotal for addressing complex tasks in interactive environments. Existing work mainly focuses on enhancing performance through behavior cloning from stronger experts, yet such approaches…

Artificial Intelligence · Computer Science 2025-03-25 Siyu Yuan , Zehui Chen , Zhiheng Xi , Junjie Ye , Zhengyin Du , Jiecao Chen

Hierarchical reinforcement learning (RL) can accelerate long-horizon decision-making by temporally abstracting a policy into multiple levels. Promising results in sparse reward environments have been seen with skills, i.e. sequences of…

Machine Learning · Computer Science 2024-07-15 Ce Hao , Catherine Weaver , Chen Tang , Kenta Kawamoto , Masayoshi Tomizuka , Wei Zhan

We introduce Skills-Coach, a novel automated framework designed to significantly enhance the self-evolution of skills within Large Language Model (LLM)-based agents. Addressing the current fragmentation of the skill ecosystem, Skills-Coach…

Computation and Language · Computer Science 2026-05-01 Yu Tian , Jiawei Chen , Lifan Zheng , Mingxiang Tao , Xinyi Zeng , Zhaoxia Yin , Hang Su , Xian Sun

Agent skills provide a lightweight way to adapt LLM agents to specialized domains by storing reusable procedural knowledge in structured files. However, whether downloaded from third parties or self-generated, these skills are often…

Artificial Intelligence · Computer Science 2026-05-28 Hanyu Wang , Yifan Lan , Bochuan Cao , Lu Lin , Jinghui Chen

Reinforcement Learning (RL) algorithms often require long training to become useful, especially in complex environments with sparse rewards. While techniques like reward shaping and curriculum learning exist to accelerate training, these…

Machine Learning · Computer Science 2025-09-11 Lukas Toral , Teddy Lazebnik

This paper investigates Reinforcement Learning (RL) approaches to enhance the reasoning capabilities of Large Language Model (LLM) agents in long-horizon, multi-turn scenarios. Although RL algorithms such as Group Relative Policy…

Language Models and Vision Language Models have recently demonstrated unprecedented capabilities in terms of understanding human intentions, reasoning, scene understanding, and planning-like behaviour, in text form, among many others. In…