English
Related papers

Related papers: Cross Domain Policy Transfer with Effect Cycle-Con…

200 papers

Despite the recent success of deep reinforcement learning (RL), domain adaptation remains an open problem. Although the generalization ability of RL agents is critical for the real-world applicability of Deep RL, zero-shot policy transfer…

Machine Learning · Computer Science 2021-09-06 Jinwei Xing , Takashi Nagata , Kexin Chen , Xinyun Zou , Emre Neftci , Jeffrey L. Krichmar

Recent years in robotics and imitation learning have shown remarkable progress in training large-scale foundation models by leveraging data across a multitude of embodiments. The success of such policies might lead us to wonder: just how…

In this work, we focus on the problem of safe policy transfer in reinforcement learning: we seek to leverage existing policies when learning a new task with specified constraints. This problem is important for safety-critical applications…

Machine Learning · Computer Science 2022-11-11 Zeyu Feng , Bowen Zhang , Jianxin Bi , Harold Soh

Unsupervised domain adaptation aiming to learn a specific task for one domain using another domain data has emerged to address the labeling issue in supervised learning, especially because it is difficult to obtain massive amounts of…

Machine Learning · Computer Science 2019-03-13 Jaeyoon Yoo , Changhwa Park , Yongjun Hong , Sungroh Yoon

Transfer Learning (TL) is a powerful tool that enables robots to transfer learned policies across different environments, tasks, or embodiments. To further facilitate this process, efforts have been made to combine it with Learning from…

Robotics · Computer Science 2025-03-18 Muhan Hou , Koen Hindriks , A. E. Eiben , Kim Baraka

Reusing pre-collected data from different domains is an appealing solution for decision-making tasks, especially when data in the target domain are limited. Existing cross-domain policy transfer methods mostly aim at learning domain…

Robotics · Computer Science 2026-03-10 Haoyi Niu , Qimao Chen , Tenglong Liu , Jianxiong Li , Guyue Zhou , Yi Zhang , Jianming Hu , Xianyuan Zhan

Exploration and adaptation to new tasks in a transfer learning setup is a central challenge in reinforcement learning. In this work, we build on the idea of modeling a distribution over policies in a Bayesian deep reinforcement learning…

Machine Learning · Computer Science 2019-06-11 Disha Shrivastava , Eeshan Gunesh Dhekane , Riashat Islam

The ability to transfer in reinforcement learning is key towards building an agent of general artificial intelligence. In this paper, we consider the problem of learning to simultaneously transfer across both environments (ENV) and tasks…

Machine Learning · Computer Science 2021-05-28 Hexiang Hu , Liyu Chen , Boqing Gong , Fei Sha

We introduce BEACON--Best-Effort Adaptation for Cross-Domain Co-Training--a theory-driven framework for training generative robot policies with abundant source demonstrations and limited target demonstrations. BEACON casts cross-domain…

Robotics · Computer Science 2026-05-13 Antong Zhang , Han Qi , Heng Yang

Humans are masters at quickly learning many complex tasks, relying on an approximate understanding of the dynamics of their environments. In much the same way, we would like our learning agents to quickly adapt to new tasks. In this paper,…

In this paper, we consider a transfer reinforcement learning problem involving agents with different action spaces. Specifically, for any new unseen task, the goal is to use a successful demonstration of this task by an expert agent in its…

Machine Learning · Computer Science 2024-10-21 Kavinayan P. Sivakumar , Yan Zhang , Zachary Bell , Scott Nivison , Michael M. Zavlanos

Distribution shift presents a significant challenge in machine learning, where models often underperform during the test stage when faced with a different distribution than the one they were trained on. This paper focuses on domain shifts,…

Machine Learning · Computer Science 2024-03-19 Huaxiu Yao , Xinyu Yang , Xinyi Pan , Shengchao Liu , Pang Wei Koh , Chelsea Finn

Domain generalization methods aim to learn models robust to domain shift with data from a limited number of source domains and without access to target domain samples during training. Popular domain alignment methods for domain…

Machine Learning · Computer Science 2022-06-17 Wenyu Zhang , Mohamed Ragab , Chuan-Sheng Foo

Developing control policies in simulation is often more practical and safer than directly running experiments in the real world. This applies to policies obtained from planning and optimization, and even more so to policies obtained from…

Classical Domain Adaptation methods acquire transferability by regularizing the overall distributional discrepancies between features in the source domain (labeled) and features in the target domain (unlabeled). They often do not…

Machine Learning · Computer Science 2023-06-01 Shumin Ma , Zhiri Yuan , Qi Wu , Yiyan Huang , Xixu Hu , Cheuk Hang Leung , Dongdong Wang , Zhixiang Huang

Recently, reinforcement learning (RL) algorithms have demonstrated remarkable success in learning complicated behaviors from minimally processed input. However, most of this success is limited to simulation. While there are promising…

Machine Learning · Computer Science 2019-03-29 Quan Vuong , Sharad Vikram , Hao Su , Sicun Gao , Henrik I. Christensen

Domain randomization in reinforcement learning is an established technique for increasing the robustness of control policies trained in simulation. By randomizing environment properties during training, the learned policy can become robust…

It is doubtful that animals have perfect inverse models of their limbs (e.g., what muscle contraction must be applied to every joint to reach a particular location in space). However, in robot control, moving an arm's end-effector to a…

Robotics · Computer Science 2022-09-19 Justus Huebotter , Serge Thill , Marcel van Gerven , Pablo Lanillos

In practice, it is very demanding and sometimes impossible to collect datasets of tagged data large enough to successfully train a machine learning model, and one possible solution to this problem is transfer learning. This study aims to…

Machine Learning · Computer Science 2022-01-13 Erik Otović , Marko Njirjak , Dario Jozinović , Goran Mauša , Alberto Michelini , Ivan Štajduhar

Reinforcement learning has emerged as a promising methodology for training robot controllers. However, most results have been limited to simulation due to the need for a large number of samples and the lack of automated-yet-safe data…

Robotics · Computer Science 2018-03-29 Kendall Lowrey , Svetoslav Kolev , Jeremy Dao , Aravind Rajeswaran , Emanuel Todorov