English
Related papers

Related papers: SimLauncher: Launching Sample-Efficient Real-world…

200 papers

In this paper, we explore deep reinforcement learning algorithms for vision-based robotic grasping. Model-free deep reinforcement learning (RL) has been successfully applied to a range of challenging environments, but the proliferation of…

Robotics · Computer Science 2018-03-30 Deirdre Quillen , Eric Jang , Ofir Nachum , Chelsea Finn , Julian Ibarz , Sergey Levine

Reinforcement learning often requires extensive training data. Simulation-to-real transfer offers a promising approach to address this challenge in robotics. While differentiable simulators offer improved sample efficiency through exact…

Robotics · Computer Science 2024-12-02 Severin Bochem , Eduardo Gonzalez-Sanchez , Yves Bicker , Gabriele Fadini

High-quality and representative data is essential for both Imitation Learning (IL)- and Reinforcement Learning (RL)-based motion planning tasks. For real robots, it is challenging to collect enough qualified data either as demonstrations…

Robotics · Computer Science 2023-06-13 Sha Luo , Lambert Schomaker

We present a novel reinforcement learning method to train the quadruped robot in a simulated environment. The idea of controlling quadruped robots in a dynamic environment is quite challenging and my method presents the optimum policy and…

Robotics · Computer Science 2025-02-25 Nabeel Ahmad Khan Jadoon , Mongkol Ekpanyapong

Reinforcement learning (RL) provides an appealing formalism for learning control policies from experience. However, the classic active formulation of RL necessitates a lengthy active exploration process for each behavior, making it…

Machine Learning · Computer Science 2021-04-27 Ashvin Nair , Abhishek Gupta , Murtaza Dalal , Sergey Levine

This letter compares the performance of four different, popular simulation environments for robotics and reinforcement learning (RL) through a series of benchmarks. The benchmarked scenarios are designed carefully with current industrial…

Robotics · Computer Science 2021-03-09 Marian Körber , Johann Lange , Stephan Rediske , Simon Steinmann , Roland Glück

This work focuses on the main challenges and problems in developing a virtual oceanic environment reproducing real experiments using Unmanned Surface Vehicles (USV) digital twins. We introduce the key features for building virtual worlds,…

Vision-Language-Action (VLA) models trained via imitation learning suffer from significant performance degradation in data-scarce scenarios due to their reliance on large-scale demonstration datasets. Although reinforcement learning…

Robotics · Computer Science 2026-04-28 Junjin Xiao , Yandan Yang , Xinyuan Chang , Ronghan Chen , Feng Xiong , Mu Xu , Wei-Shi Zheng , Qing Zhang

As surgical robots become more common, automating away some of the burden of complex direct human operation becomes ever more feasible. Model-free reinforcement learning (RL) is a promising direction toward generalizable automated surgical…

Robotics · Computer Science 2021-05-04 Yotam Barnoy , Molly O'Brien , Will Wang , Gregory Hager

Visual navigation is essential for many applications in robotics, from manipulation, through mobile robotics to automated driving. Deep reinforcement learning (DRL) provides an elegant map-free approach integrating image processing,…

Robotics · Computer Science 2020-10-22 Jonáš Kulhánek , Erik Derner , Robert Babuška

In-Hand Manipulation, as many other dexterous tasks, remains a difficult challenge in robotics by combining complex dynamic systems with the capability to control and manoeuvre various objects using its actuators. This work presents the…

Robotics · Computer Science 2025-12-15 Alexandre Lopes , Catarina Barata , Plinio Moreno

Deep reinforcement learning (RL) algorithms can learn complex robotic skills from raw sensory inputs, but have yet to achieve the kind of broad generalization and applicability demonstrated by deep learning methods in supervised domains. We…

Robotics · Computer Science 2018-12-04 Frederik Ebert , Chelsea Finn , Sudeep Dasari , Annie Xie , Alex Lee , Sergey Levine

Machine learning has facilitated significant advancements across various robotics domains, including navigation, locomotion, and manipulation. Many such achievements have been driven by the extensive use of simulation as a critical tool for…

Recent advances at the intersection of reinforcement learning (RL) and visual intelligence have enabled agents that not only perceive complex visual scenes but also reason, generate, and act within them. This survey offers a critical and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Weijia Wu , Chen Gao , Joya Chen , Kevin Qinghong Lin , Qingwei Meng , Yiming Zhang , Yuke Qiu , Hong Zhou , Mike Zheng Shou

Reinforcement learning is applied to solve actual complex tasks from high-dimensional, sensory inputs. The last decade has developed a long list of reinforcement learning algorithms. Recent progress benefits from deep learning for raw…

Robotics · Computer Science 2023-03-08 Yanfei Xiang , Xin Wang , Shu Hu , Bin Zhu , Xiaomeng Huang , Xi Wu , Siwei Lyu

Simulation is used extensively in autonomous systems, particularly in robotic manipulation. By far, the most common approach is to train a controller in simulation, and then use it as an initial starting point for the real system. We…

Machine Learning · Statistics 2021-10-06 Shirli Di Castro Shashua , Dotan Di Castro , Shie Mannor

Visual model-based reinforcement learning (RL) has the potential to enable sample-efficient robot learning from visual observations. Yet the current approaches typically train a single model end-to-end for learning both visual…

Robotics · Computer Science 2023-05-30 Younggyo Seo , Danijar Hafner , Hao Liu , Fangchen Liu , Stephen James , Kimin Lee , Pieter Abbeel

Mastering robotic manipulation skills through reinforcement learning (RL) typically requires the design of shaped reward functions. Recent developments in this area have demonstrated that using sparse rewards, i.e. rewarding the agent only…

Machine Learning · Computer Science 2021-11-12 Ozsel Kilinc , Giovanni Montana

Cloth manipulation is a ubiquitous task in everyday life, but it remains an open challenge for robotics. The difficulties in developing cloth manipulation policies are attributed to the high-dimensional state space, complex dynamics, and…

Robotics · Computer Science 2026-01-30 Donatien Delehelle , Fei Chen , Darwin Caldwell

The success of reinforcement learning for real world robotics has been, in many cases limited to instrumented laboratory scenarios, often requiring arduous human effort and oversight to enable continuous learning. In this work, we discuss…

Machine Learning · Computer Science 2020-04-28 Henry Zhu , Justin Yu , Abhishek Gupta , Dhruv Shah , Kristian Hartikainen , Avi Singh , Vikash Kumar , Sergey Levine