English
Related papers

Related papers: Meta Reinforcement Learning for Sim-to-real Domain…

200 papers

Realtime model learning proves challenging for complex dynamical systems, such as drones flying in variable wind conditions. Machine learning technique such as deep neural networks have high representation power but is often too slow to…

Robotics · Computer Science 2022-05-26 Michael O'Connell , Guanya Shi , Xichen Shi , Soon-Jo Chung

In this paper, we propose a novel meta-learning method in a reinforcement learning setting, based on evolution strategies (ES), exploration in parameter space and deterministic policy gradients. ES methods are easy to parallelize, which is…

Machine Learning · Computer Science 2019-05-09 Yiming Shen , Kehan Yang , Yufeng Yuan , Simon Cheng Liu

Whereas reinforcement learning has been applied with success to a range of robotic control problems in complex, uncertain environments, reliance on extensive data - typically sourced from simulation environments - limits real-world…

Robotics · Computer Science 2026-01-29 Jamie Hathaway , Alireza Rastegarpanah , Rustam Stolkin

Learning from Demonstration is increasingly used for transferring operator manipulation skills to robots. In practice, it is important to cater for limited data and imperfect human demonstrations, as well as underlying safety constraints.…

Robotics · Computer Science 2020-04-03 Ya-Yen Tsai , Bo Xiao , Edward Johns , Guang-Zhong Yang

We are interested in solving the problem of imitation learning with a limited amount of real-world expert data. Existing offline imitation methods often struggle with poor data coverage and severe performance degradation. We propose a…

Robotics · Computer Science 2025-10-06 Yilin Wang , Shangzhe Li , Haoyi Niu , Zhiao Huang , Weitong Zhang , Hao Su

In this paper, we leverage ideas from model-based control to address the sample efficiency problem of reinforcement learning (RL) algorithms. Accelerating learning is an active field of RL highly relevant in the context of time-varying…

Systems and Control · Electrical Eng. & Systems 2023-05-23 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

Learning adaptable policies is crucial for robots to operate autonomously in our complex and quickly changing world. In this work, we present a new meta-learning method that allows robots to quickly adapt to changes in dynamics. In contrast…

Robotics · Computer Science 2020-07-31 Xingyou Song , Yuxiang Yang , Krzysztof Choromanski , Ken Caluwaerts , Wenbo Gao , Chelsea Finn , Jie Tan

The performance of a machine learning model degrades when it is applied to data from a similar but different domain than the data it has initially been trained on. To mitigate this domain shift problem, domain adaptation (DA) techniques…

Machine Learning · Computer Science 2024-10-08 Felix Ott , David Rügamer , Lucas Heublein , Bernd Bischl , Christopher Mutschler

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

Robotics · Computer Science 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter

Reinforcement learning is an emerging approaches to facilitate multi-stage sequential decision-making problems. This paper studies a real-time multi-stage stochastic power dispatch considering multivariate uncertainties. Current researches…

Machine Learning · Computer Science 2024-01-24 Bairong Deng , Tao Yu , Zhenning Pan , Xuehan Zhang , Yufeng Wu , Qiaoyi Ding

Deep reinforcement learning (DRL) has shown remarkable success in simulation domains, yet its application in designing robot controllers remains limited, due to its single-task orientation and insufficient adaptability to environmental…

Robotics · Computer Science 2024-09-20 Yu Tang Liu , Nilaksh Singh , Aamir Ahmad

Unsupervised reinforcement learning aims to acquire skills without prior goal representations, where an agent automatically explores an open-ended environment to represent goals and learn the goal-conditioned policy. However, this procedure…

Machine Learning · Computer Science 2021-10-27 Jinxin Liu , Hao Shen , Donglin Wang , Yachen Kang , Qiangxing Tian

Reinforcement Learning (RL) provides a framework in which agents can be trained, via trial and error, to solve complex decision-making problems. Learning with little supervision causes RL methods to require large amounts of data, rendering…

Machine Learning · Computer Science 2024-11-22 Sergio A. Serrano , Jose Martinez-Carranza , L. Enrique Sucar

Reinforcement learning algorithms can acquire policies for complex tasks autonomously. However, the number of samples required to learn a diverse set of skills can be prohibitively large. While meta-reinforcement learning methods have…

Machine Learning · Computer Science 2020-06-17 Russell Mendonca , Xinyang Geng , Chelsea Finn , Sergey Levine

In this paper, we propose a new solution to reward adaptation (RA) in reinforcement learning, where the agent adapts to a target reward function based on one or more existing source behaviors learned a priori under the same domain dynamics…

Machine Learning · Computer Science 2025-10-23 Kevin Vora , Yu Zhang

Skill-based reinforcement learning (RL) has emerged as a promising strategy to leverage prior knowledge for accelerated robot learning. Skills are typically extracted from expert demonstrations and are embedded into a latent space from…

Robotics · Computer Science 2022-11-07 Krishan Rana , Ming Xu , Brendan Tidd , Michael Milford , Niko Sünderhauf

Meta-learning is a practical learning paradigm to transfer skills across tasks from a few examples. Nevertheless, the existence of task distribution shifts tends to weaken meta-learners' generalization capability, particularly when the…

Machine Learning · Computer Science 2025-01-07 Cheems Wang , Yiqin Lv , Yixiu Mao , Yun Qu , Yi Xu , Xiangyang Ji

Training robotic policies in simulation suffers from the sim-to-real gap, as simulated dynamics can be different from real-world dynamics. Past works tackled this problem through domain randomization and online system-identification. The…

Robotics · Computer Science 2020-11-09 Jacky Liang , Saumya Saxena , Oliver Kroemer

In this paper, the design of an optimal trajectory for an energy-constrained drone operating in dynamic network environments is studied. In the considered model, a drone base station (DBS) is dispatched to provide uplink connectivity to…

Machine Learning · Computer Science 2020-05-27 Ye Hu , Mingzhe Chen , Walid Saad , H. Vincent Poor , Shuguang Cui

Recent work has shown that complex manipulation skills, such as pushing or pouring, can be learned through state-of-the-art learning based techniques, such as Reinforcement Learning (RL). However, these methods often have high…