English
Related papers

Related papers: Policy Compatible Skill Incremental Learning via L…

200 papers

Learning to imitate expert behavior from demonstrations can be challenging, especially in environments with high-dimensional, continuous observations and unknown dynamics. Supervised learning methods based on behavioral cloning (BC) suffer…

Machine Learning · Computer Science 2019-09-27 Siddharth Reddy , Anca D. Dragan , Sergey Levine

Reward-free, unsupervised discovery of skills is an attractive alternative to the bottleneck of hand-designing rewards in environments where task supervision is scarce or expensive. However, current skill pre-training methods, like many RL…

Machine Learning · Computer Science 2022-03-22 Nur Muhammad Shafiullah , Lerrel Pinto

Reinforcement learning (RL) is a framework to optimize a control policy using rewards that are revealed by the system as a response to a control action. In its standard form, RL involves a single agent that uses its policy to accomplish a…

Systems and Control · Electrical Eng. & Systems 2021-11-24 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

Offline reinforcement learning (RL) tasks require the agent to learn from a pre-collected dataset with no further interactions with the environment. Despite the potential to surpass the behavioral policies, RL-based methods are generally…

Machine Learning · Computer Science 2022-01-13 Minghuan Liu , Hanye Zhao , Zhengyu Yang , Jian Shen , Weinan Zhang , Li Zhao , Tie-Yan Liu

The intrinsic compliance and high degree of freedom (DoF) of redundant soft manipulators facilitate safe interaction and flexible task execution. However, effective kinematic control remains highly challenging, as it must handle…

Robotics · Computer Science 2025-07-24 Yinan Meng , Kun Qian , Jiong Yang , Renbo Su , Zhenhong Li , Charlie C. L. Wang

This paper investigates how to efficiently transition and update policies, trained initially with demonstrations, using off-policy actor-critic reinforcement learning. It is well-known that techniques based on Learning from Demonstrations,…

Machine Learning · Computer Science 2020-04-07 Vinicius G. Goecks , Gregory M. Gremillion , Vernon J. Lawhern , John Valasek , Nicholas R. Waytowich

Deep reinforcement learning has demonstrated increasing capabilities for continuous control problems, including agents that can move with skill and agility through their environment. An open problem in this setting is that of developing…

Machine Learning · Computer Science 2018-02-14 Glen Berseth , Cheng Xie , Paul Cernek , Michiel Van de Panne

This paper demonstrates that continual relearning of control policies using incremental deep reinforcement learning (RL) can improve policy learning for non-stationary processes. We demonstrate this approach for a data-driven 'smart…

Machine Learning · Computer Science 2020-08-06 Avisek Naug , Marcos Quiñones-Grueiro , Gautam Biswas

Imitation learning (IL) enables autonomous behavior by learning from expert demonstrations. While more sample-efficient than comparative alternatives like reinforcement learning, IL is sensitive to compounding errors induced by distribution…

Systems and Control · Electrical Eng. & Systems 2025-12-22 Aditya Gahlawat , Ahmed Aboudonia , Sandeep Banik , Naira Hovakimyan , Nikolai Matni , Aaron D. Ames , Gioele Zardini , Alberto Speranzon

Human players in professional team sports achieve high level coordination by dynamically choosing complementary skills and executing primitive actions to perform these skills. As a step toward creating intelligent agents with this…

Machine Learning · Computer Science 2020-05-11 Jiachen Yang , Igor Borovikov , Hongyuan Zha

The ability to effectively reuse prior knowledge is a key requirement when building general and flexible Reinforcement Learning (RL) agents. Skill reuse is one of the most common approaches, but current methods have considerable…

Future warfare will require Command and Control (C2) personnel to make decisions at shrinking timescales in complex and potentially ill-defined situations. Given the need for robust decision-making processes and decision-support tools,…

Language agents have shown some ability to interact with an external environment, e.g., a virtual world such as ScienceWorld, to perform complex tasks, e.g., growing a plant, without the startup costs of reinforcement learning. However,…

Skill libraries enable large language model agents to reuse experience from past interactions, but most existing libraries store skills as isolated entries and retrieve them only by semantic similarity. This leads to two key challenges for…

Computation and Language · Computer Science 2026-05-13 Xiaoyuan Li , Moxin Li , Keqin Bao , Yubo Ma , Wenjie Wang , Dayiheng Liu , Fuli Feng

Decentralized combinatorial optimization in evolving multi-agent systems poses significant challenges, requiring agents to balance long-term decision-making, short-term optimized collective outcomes, while preserving autonomy of interactive…

Multiagent Systems · Computer Science 2025-09-23 Chuhao Qin , Evangelos Pournaras

Real-world tasks such as garment manipulation and table rearrangement demand robots to perform generalizable, highly precise, and long-horizon actions. Although imitation learning has proven to be an effective approach for teaching robots…

Robotics · Computer Science 2025-07-03 Shengjie Wang , Jiacheng You , Yihang Hu , Jiongye Li , Yang Gao

In many sequential decision-making problems (e.g., robotics control, game playing, sequential prediction), human or expert data is available containing useful information about the task. However, imitation learning (IL) from a small amount…

Machine Learning · Computer Science 2022-11-04 Divyansh Garg , Shuvam Chakraborty , Chris Cundy , Jiaming Song , Matthieu Geist , Stefano Ermon

Cross-domain imitation learning (CDIL) accelerates policy learning by transferring expert knowledge across domains, which is valuable in applications where the collection of expert data is costly. Existing methods are either supervised,…

Machine Learning · Computer Science 2026-02-12 Li-Min Chu , Kai-Siang Ma , Ming-Hong Chen , Ping-Chun Hsieh

We present GuidedSAC, a novel reinforcement learning (RL) algorithm that facilitates efficient exploration in vast state-action spaces. GuidedSAC leverages large language models (LLMs) as intelligent supervisors that provide action-level…

Machine Learning · Computer Science 2026-03-19 Hao Ma , Zhiqiang Pu , Xiaolin Ai , Huimu Wang

Large Language Model (LLM) agents have shown strong results on multi-turn tool-use tasks, yet they operate in isolation during training, failing to leverage experiences accumulated across episodes. Existing experience-augmented methods…

Machine Learning · Computer Science 2026-03-20 Prince Zizhuang Wang , Shuli Jiang