English
Related papers

Related papers: Sim2Dust: Mastering Dynamic Waypoint Tracking on G…

200 papers

Deep reinforcement learning has recently seen huge success across multiple areas in the robotics domain. Owing to the limitations of gathering real-world data, i.e., sample inefficiency and the cost of collecting it, simulation environments…

Machine Learning · Computer Science 2021-07-09 Wenshuai Zhao , Jorge Peña Queralta , Tomi Westerlund

Reinforcement Learning (RL), among other learning-based methods, represents powerful tools to solve complex robotic tasks (e.g., actuation, manipulation, navigation, etc.), with the need for real-world data to train these systems as one of…

Robotics · Computer Science 2020-07-28 Kenzo Lobos-Tsunekawa , Tatsuya Harada

Reinforcement learning (RL) has shown promise in robotics, but deploying RL on real vehicles remains challenging due to the complexity of vehicle dynamics and the mismatch between simulation and reality. Factors such as tire…

Robotics · Computer Science 2025-11-11 Thomas Steinecker , Alexander Bienemann , Denis Trescher , Thorsten Luettel , Mirko Maehlisch

Autonomous visual navigation is an essential element in robot autonomy. Reinforcement learning (RL) offers a promising policy training paradigm. However existing RL methods suffer from high sample complexity, poor sim-to-real transfer, and…

Robotics · Computer Science 2025-07-31 Qianzhong Chen , Jiankai Sun , Naixiang Gao , JunEn Low , Timothy Chen , Mac Schwager

Autonomous learning of dexterous, long-horizon robotic skills has been a longstanding pursuit of embodied AI. Recent advances in robotic reinforcement learning (RL) have demonstrated remarkable performance and robustness in real-world…

The gap between simulation and the real-world restrains many machine learning breakthroughs in computer vision and reinforcement learning from being applicable in the real world. In this work, we tackle this gap for the specific case of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Klaas Kelchtermans , Tinne Tuytelaars

Learning visuomotor policies in simulation is much safer and cheaper than in the real world. However, due to discrepancies between the simulated and real data, simulator-trained policies often fail when transferred to real robots. One…

Robotics · Computer Science 2023-07-31 Ricardo Garcia , Robin Strudel , Shizhe Chen , Etienne Arlaud , Ivan Laptev , Cordelia Schmid

Deep Reinforcement Learning has been successfully applied in various computer games [8]. However, it is still rarely used in real-world applications, especially for the navigation and continuous control of real mobile robots [13]. Previous…

Off-road navigation is a challenging problem both at the planning level to get a smooth trajectory and at the control level to avoid flipping over, hitting obstacles, or getting stuck at a rough patch. There have been several recent works…

Robotics · Computer Science 2024-04-16 Dvij Kalaria , Shreya Sharma , Sarthak Bhagat , Haoru Xue , John M. Dolan

Deep reinforcement learning (DRL) is a promising approach to solve complex control tasks by learning policies through interactions with the environment. However, the training of DRL policies requires large amounts of training experiences,…

Machine Learning · Computer Science 2023-01-02 Hongpeng Cao , Mirco Theile , Federico G. Wyrwal , Marco Caccamo

Reinforcement learning (RL) algorithms can enable high-maneuverability in unmanned aerial vehicles (MAVs), but transferring them from simulation to real-world use is challenging. Variable-pitch propeller (VPP) MAVs offer greater agility,…

Robotics · Computer Science 2025-04-11 Zhikun Wang , Shiyu Zhao

For the shape control of deformable free-form surfaces, simulation plays a crucial role in establishing the mapping between the actuation parameters and the deformed shapes. The differentiation of this forward kinematic mapping is usually…

Robotics · Computer Science 2024-05-16 Yingjun Tian , Guoxin Fang , Renbo Su , Weiming Wang , Simeon Gill , Andrew Weightman , Charlie C. L. Wang

Shared autonomy provides an effective framework for human-robot collaboration that takes advantage of the complementary strengths of humans and robots to achieve common goals. Many existing approaches to shared autonomy make restrictive…

Robotics · Computer Science 2020-07-13 Charles Schaff , Matthew R. Walter

Closed-loop control remains an open challenge in soft robotics. The nonlinear responses of soft actuators under dynamic loading conditions limit the use of analytic models for soft robot control. Traditional methods of controlling soft…

We have seen much recent progress in rigid object manipulation, but interaction with deformable objects has notably lagged behind. Due to the large configuration space of deformable objects, solutions using traditional modelling approaches…

Robotics · Computer Science 2018-10-09 Jan Matas , Stephen James , Andrew J. Davison

Model-free reinforcement learning has recently been shown to be effective at learning navigation policies from complex image input. However, these algorithms tend to require large amounts of interaction with the environment, which can be…

Robotics · Computer Science 2018-07-17 Jake Bruce , Niko Sünderhauf , Piotr Mirowski , Raia Hadsell , Michael Milford

Sim-to-real gap has long posed a significant challenge for robot learning in simulation, preventing the deployment of learned models in the real world. Previous work has primarily focused on domain randomization and system identification to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Ziyang Xie , Zhizheng Liu , Zhenghao Peng , Wayne Wu , Bolei Zhou

This paper studies the problem of autonomous exploration under localization uncertainty for a mobile robot with 3D range sensing. We present a framework for self-learning a high-performance exploration policy in a single simulation…

Robotics · Computer Science 2021-05-12 Fanfei Chen , Paul Szenher , Yewei Huang , Jinkun Wang , Tixiao Shan , Shi Bai , Brendan Englot

We propose a model-free deep reinforcement learning method that leverages a small amount of demonstration data to assist a reinforcement learning agent. We apply this approach to robotic manipulation tasks and train end-to-end visuomotor…

Robot learning requires a considerable amount of high-quality data to realize the promise of generalization. However, large data sets are costly to collect in the real world. Physics simulators can cheaply generate vast data sets with broad…