English
Related papers

Related papers: Cross Domain Policy Transfer with Effect Cycle-Con…

200 papers

Deep reinforcement learning agents have recently been successful across a variety of discrete and continuous control tasks; however, they can be slow to train and require a large number of interactions with the environment to learn a…

Machine Learning · Computer Science 2018-12-19 Thomas Carr , Maria Chli , George Vogiatzis

A popular paradigm in robotic learning is to train a policy from scratch for every new robot. This is not only inefficient but also often impractical for complex robots. In this work, we consider the problem of transferring a policy across…

Machine Learning · Computer Science 2022-06-22 Xingyu Liu , Deepak Pathak , Kris M. Kitani

Domain randomization (DR) is a successful technique for learning robust policies for robot systems, when the dynamics of the target robot system are unknown. The success of policies trained with domain randomization however, is highly…

Machine Learning · Computer Science 2019-09-18 Melissa Mozifian , Juan Camilo Gamboa Higuera , David Meger , Gregory Dudek

Standard approaches to sequential decision-making exploit an agent's ability to continually interact with its environment and improve its control policy. However, due to safety, ethical, and practicality constraints, this type of…

Machine Learning · Computer Science 2023-05-11 Patrick Emedom-Nnamdi , Abram L. Friesen , Bobak Shahriari , Nando de Freitas , Matt W. Hoffman

Reinforcement learning (RL) can automate a wide variety of robotic skills, but learning each new skill requires considerable real-world data collection and manual representation engineering to design policy classes or features. Using deep…

Machine Learning · Computer Science 2016-09-23 Coline Devin , Abhishek Gupta , Trevor Darrell , Pieter Abbeel , Sergey Levine

End-to-end learning is emerging as a powerful paradigm for robotic manipulation, but its effectiveness is limited by data scarcity and the heterogeneity of action spaces across robot embodiments. In particular, diverse action spaces across…

Robotics · Computer Science 2026-03-23 Erik Bauer , Elvis Nava , Robert K. Katzschmann

We study how an autonomous agent learns to perform a task from demonstrations in a different domain, such as a different environment or different agent. Such cross-domain imitation learning is required to, for example, train an artificial…

Artificial Intelligence · Computer Science 2022-09-27 Tim Franzmeyer , Philip H. S. Torr , João F. Henriques

In reinforcement learning, agents that consider the context, or current state, when selecting source policies for transfer have been shown to outperform context-free approaches. However, none of the existing approaches transfer knowledge…

Machine Learning · Computer Science 2020-06-11 Michael Gimelfarb , Scott Sanner , Chi-Guhn Lee

Humans decompose novel complex tasks into simpler ones to exploit previously learned skills. Analogously, hierarchical reinforcement learning seeks to leverage lower-level policies for simple tasks to solve complex ones. However, because…

Machine Learning · Computer Science 2022-03-15 Ju-Seung Byun , Andrew Perrault

We propose a simple, practical, and intuitive approach for domain adaptation in reinforcement learning. Our approach stems from the idea that the agent's experience in the source domain should look similar to its experience in the target…

Machine Learning · Computer Science 2021-04-16 Benjamin Eysenbach , Swapnil Asawa , Shreyas Chaudhari , Sergey Levine , Ruslan Salakhutdinov

Learning robot skills from scratch is often time-consuming, while reusing data promotes sustainability and improves sample efficiency. This study investigates policy transfer across different robotic platforms, focusing on peg-in-hole task…

Robotics · Computer Science 2026-04-09 Khalil Abuibaid , Vinit Hegiste , Nigora Gafur , Achim Wagner , Martin Ruskowski

Generalizing policies across different domains with dynamics mismatch poses a significant challenge in reinforcement learning. For example, a robot learns the policy in a simulator, but when it is deployed in the real world, the dynamics of…

Machine Learning · Computer Science 2023-10-16 Kang Xu , Chenjia Bai , Xiaoteng Ma , Dong Wang , Bin Zhao , Zhen Wang , Xuelong Li , Wei Li

Efficiently training control policies for robots is a major challenge that can greatly benefit from utilizing knowledge gained from training similar systems through cross-embodiment knowledge transfer. In this work, we focus on accelerating…

Robotics · Computer Science 2026-02-18 Welf Rehberg , Mihir Kulkarni , Philipp Weiss , Kostas Alexis

Behavior cloning has shown promise for robot manipulation, but real-world demonstrations are costly to acquire at scale. While simulated data offers a scalable alternative, particularly with advances in automated demonstration generation,…

Robotics · Computer Science 2026-01-19 Shuo Cheng , Liqian Ma , Zhenyang Chen , Ajay Mandlekar , Caelan Garrett , Danfei Xu

For a robot to learn a good policy, it often requires expensive equipment (such as sophisticated sensors) and a prepared training environment conducive to learning. However, it is seldom possible to perfectly equip robots for economic…

Artificial Intelligence · Computer Science 2019-07-19 Hélène Plisnier , Denis Steckelmacher , Diederik Roijers , Ann Nowé

The high sample complexity of reinforcement learning challenges its use in practice. A promising approach is to quickly adapt pre-trained policies to new environments. Existing methods for this policy adaptation problem typically rely on…

Machine Learning · Computer Science 2020-06-16 Yuda Song , Aditi Mavalankar , Wen Sun , Sicun Gao

Cross-domain reinforcement learning (CDRL) is meant to improve the data efficiency of RL by leveraging the data samples collected from a source domain to facilitate the learning in a similar target domain. Despite its potential,…

Machine Learning · Computer Science 2026-03-13 Ming-Hong Chen , Kuan-Chen Pan , You-De Huang , Xi Liu , Ping-Chun Hsieh

Training robots with reinforcement learning (RL) typically involves heavy interactions with the environment, and the acquired skills are often sensitive to changes in task environments and robot kinematics. Transfer RL aims to leverage…

Robotics · Computer Science 2023-09-26 Pingcheng Jian , Easop Lee , Zachary Bell , Michael M. Zavlanos , Boyuan Chen

The goal of task transfer in reinforcement learning is migrating the action policy of an agent to the target task from the source task. Given their successes on robotic action planning, current methods mostly rely on two requirements:…

Machine Learning · Computer Science 2019-02-19 Mingxuan Jing , Xiaojian Ma , Wenbing Huang , Fuchun Sun , Huaping Liu

Transfer learning is a problem defined over two domains. These two domains share the same feature space and class label space, but have significantly different distributions. One domain has sufficient labels, named as source domain, and the…

Machine Learning · Computer Science 2016-05-24 Hongqi Wang , Anfeng Xu , Shanshan Wang , Sunny Chughtai