English
Related papers

Related papers: From Video Game to Real Robot: The Transfer betwee…

200 papers

Over the past few years, deep learning techniques have achieved tremendous success in many visual understanding tasks such as object detection, image segmentation, and caption generation. Despite this thriving in computer vision and natural…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Anh Nguyen

Recent trends in robot arm control have seen a shift towards end-to-end solutions, using deep reinforcement learning to learn a controller directly from raw sensor data, rather than relying on a hand-crafted, modular pipeline. However, the…

Robotics · Computer Science 2016-12-14 Stephen James , Edward Johns

Even though the peg-hole insertion is one of the well-studied problems in robotics, it still remains a challenge for robots, especially when it comes to flexibility and the ability to generalize. Successful completion of the task requires…

Robotics · Computer Science 2020-06-01 Damian Bogunowicz , Aleksandr Rybnikov , Komal Vendidandi , Fedor Chervinskii

Zero-shot sim-to-real transfer of tasks with complex dynamics is a highly challenging and unsolved problem. A number of solutions have been proposed in recent years, but we have found that many works do not present a thorough evaluation in…

Robotics · Computer Science 2020-08-18 Eugene Valassakis , Zihan Ding , Edward Johns

Current vision-based robotics simulation benchmarks have significantly advanced robotic manipulation research. However, robotics is fundamentally a real-world problem, and evaluation for real-world applications has lagged behind in…

Robotics · Computer Science 2025-08-18 Xuning Yang , Clemens Eppner , Jonathan Tremblay , Dieter Fox , Stan Birchfield , Fabio Ramos

To catch a thrown object, a robot must be able to perceive the object's motion and generate control actions in a timely manner. Rather than explicitly estimating the object's 3D position, this work focuses on a novel approach that…

Robotics · Computer Science 2026-02-27 Seongyong Kim , Junhyeon Cho , Kang-Won Lee , Soo-Chul Lim

When autonomous agents interact in the same environment, they must often cooperate to achieve their goals. One way for agents to cooperate effectively is to form a team, make a binding agreement on a joint plan, and execute it. However,…

Though deep reinforcement learning agents have achieved unprecedented success in recent years, their learned policies can be brittle, failing to generalize to even slight modifications of their environments or unfamiliar situations. The…

Artificial Intelligence · Computer Science 2021-12-13 Yiheng Xie , Mingxuan Li , Shangqun Yu , Michael Littman

Current Reinforcement Learning (RL) algorithms struggle with long-horizon tasks where time can be wasted exploring dead ends and task progress may be easily reversed. We develop the SPOT framework, which explores within action safety zones,…

As robots are increasingly deployed in real-world scenarios, a key question is how to best transfer knowledge learned in one environment to another, where shifting constraints and human preferences render adaptation challenging. A central…

Human-Computer Interaction · Computer Science 2022-05-18 Andreea Bobu , Andi Peng

The rise of deep learning has caused a paradigm shift in robotics research, favoring methods that require large amounts of data. Unfortunately, it is prohibitively expensive to generate such data sets on a physical platform. Therefore,…

Robotics · Computer Science 2022-01-19 Fabio Muratore , Fabio Ramos , Greg Turk , Wenhao Yu , Michael Gienger , Jan Peters

Deep reinforcement learning provides a promising approach for vision-based control of real-world robots. However, the generalization of such models depends critically on the quantity and variety of data available for training. This data can…

Machine Learning · Computer Science 2019-02-12 Katie Kang , Suneel Belkhale , Gregory Kahn , Pieter Abbeel , Sergey Levine

Deep Reinforcement Learning (DRL) has shown remarkable success in solving complex tasks across various research fields. However, transferring DRL agents to the real world is still challenging due to the significant discrepancies between…

Machine Learning · Computer Science 2024-10-22 Dianzhao Li , Ostap Okhrin

In this paper, we review the question of which action space is best suited for controlling a real biped robot in combination with Sim2Real training. Position control has been popular as it has been shown to be more sample efficient and…

Robotics · Computer Science 2023-09-01 Donghyeon Kim , Glen Berseth , Mathew Schwartz , Jaeheung Park

Understanding physical phenomena is a key component of human intelligence and enables physical interaction with previously unseen environments. In this paper, we study how an artificial agent can autonomously acquire this intuition through…

Robotics · Computer Science 2017-11-23 Wenbin Li , Jeannette Bohg , Mario Fritz

In this paper, we confront the problem of applying reinforcement learning to agents that perceive the environment through many sensors and that can perform parallel actions using many actuators as is the case in complex autonomous robots.…

Artificial Intelligence · Computer Science 2011-07-04 E. Celaya , J. M. Porta

The U.S. Defense Advanced Research Projects Agency (DARPA) Subterranean Challenge requires teams of robots to traverse difficult and diverse underground environments. Traversing small gaps is one of the challenging scenarios that robots…

Robotics · Computer Science 2021-11-03 Brendan Tidd , Akansel Cosgun , Jurgen Leitner , Nicolas Hudson

Real-world autonomous decision-making systems, from robots to recommendation engines, must operate in environments that change over time. While deep reinforcement learning (RL) has shown an impressive ability to learn optimal policies in…

Machine Learning · Computer Science 2025-05-16 Jonathan Clifford Balloch

Deep Reinforcement Learning (DRL) has been successfully used to solve different challenges, e.g. complex board and computer games, recently. However, solving real-world robotics tasks with DRL seems to be a more difficult challenge. The…

Robotics · Computer Science 2020-10-08 Péter Almási , Róbert Moni , Bálint Gyires-Tóth

Vision guided navigation requires processing complex visual information to inform task-orientated decisions. Applications include autonomous robots, self-driving cars, and assistive vision for humans. A key element is the extraction and…

Robotics · Computer Science 2022-09-20 Jaime Ruiz-Serra , Jack White , Stephen Petrie , Tatiana Kameneva , Chris McCarthy