English
Related papers

Related papers: From Video Game to Real Robot: The Transfer betwee…

200 papers

For service robots to become general-purpose in everyday household environments, they need not only a large library of primitive skills, but also the ability to quickly learn novel tasks specified by users. Fine-tuning neural networks on a…

Robotics · Computer Science 2023-01-16 Yuqian Jiang , Qiaozi Gao , Govind Thattai , Gaurav Sukhatme

Socially aware robots should be able, among others, to support fluent human-robot collaboration in tasks that require interdependent actions in order to be solved. Towards enhancing mutual performance, collaborative robots should be…

Robotics · Computer Science 2022-11-24 Athanasios C. Tsitos , Maria Dagioglou

In this paper, we investigate the problem of fast spectrum sharing in vehicle-to-everything communication. In order to improve the spectrum efficiency of the whole system, the spectrum of vehicle-to-infrastructure links is reused by…

Information Theory · Computer Science 2023-10-02 Kai Huang , Le Liang , Shi Jin , Geoffrey Ye Li

The industrial application of Deep Reinforcement Learning (DRL) is frequently slowed down because of the inability to generate the experience required to train the models. Collecting data often involves considerable time and economic effort…

Robotics · Computer Science 2025-01-27 Lucía Güitta-López , Jaime Boal , Álvaro J. López-López

Coverage path planning (CPP) is the problem of finding a path that covers the entire free space of a confined area, with applications ranging from robotic lawn mowing to search-and-rescue. While for known environments, offline methods can…

Robotics · Computer Science 2025-08-26 Arvi Jonnarth , Ola Johansson , Jie Zhao , Michael Felsberg

Video games are a compelling source of annotated data as they can readily provide fine-grained groundtruth for diverse tasks. However, it is not clear whether the synthetically generated data has enough resemblance to the real-world images…

Computer Vision and Pattern Recognition · Computer Science 2016-08-16 Alireza Shafaei , James J. Little , Mark Schmidt

We present a novel solution to the problem of simulation-to-real transfer, which builds on recent advances in robot skill decomposition. Rather than focusing on minimizing the simulation-reality gap, we learn a set of diverse policies that…

Machine Learning · Computer Science 2018-11-15 Ryan Julian , Eric Heiden , Zhanpeng He , Hejia Zhang , Stefan Schaal , Joseph J. Lim , Gaurav Sukhatme , Karol Hausman

The deep supervised and reinforcement learning paradigms (among others) have the potential to endow interactive multimodal social robots with the ability of acquiring skills autonomously. But it is still not very clear yet how they can be…

Artificial Intelligence · Computer Science 2019-08-29 Heriberto Cuayáhuitl

We propose an approach to learning agents for active robotic mapping, where the goal is to map the environment as quickly as possible. The agent learns to map efficiently in simulated environments by receiving rewards corresponding to how…

Robotics · Computer Science 2018-01-01 Shane Barratt

We apply multi-agent deep reinforcement learning (RL) to train end-to-end robot soccer policies with fully onboard computation and sensing via egocentric RGB vision. This setting reflects many challenges of real-world robotics, including…

Reinforcement learning has exceeded human-level performance in game playing AI with deep learning methods according to the experiments from DeepMind on Go and Atari games. Deep learning solves high dimension input problems which stop the…

Machine Learning · Computer Science 2019-09-12 Yue Zheng

Text-based games are a natural challenge domain for deep reinforcement learning algorithms. Their state and action spaces are combinatorially large, their reward function is sparse, and they are partially observable: the agent is informed…

Artificial Intelligence · Computer Science 2019-12-02 Vishal Jain , William Fedus , Hugo Larochelle , Doina Precup , Marc G. Bellemare

Sim-to-real transfer is a powerful paradigm for robotic reinforcement learning. The ability to train policies in simulation enables safe exploration and large-scale data collection quickly at low cost. However, prior works in sim-to-real…

Sim-to-real transfer is a fundamental challenge in robot reinforcement learning. Discrepancies between simulation and reality can significantly impair policy performance, especially if it receives high-dimensional inputs such as dense depth…

Robotics · Computer Science 2025-05-20 Hang Yu , Christophe De Wagter , Guido C. H. E de Croon

We have seen much recent progress in rigid object manipulation, but interaction with deformable objects has notably lagged behind. Due to the large configuration space of deformable objects, solutions using traditional modelling approaches…

Robotics · Computer Science 2018-10-09 Jan Matas , Stephen James , Andrew J. Davison

We consider the problem of transferring policies to the real world by training on a distribution of simulated scenarios. Rather than manually tuning the randomization of simulations, we adapt the simulation parameter distribution using a…

Robotics · Computer Science 2019-03-07 Yevgen Chebotar , Ankur Handa , Viktor Makoviychuk , Miles Macklin , Jan Issac , Nathan Ratliff , Dieter Fox

Simulation offers a scalable and efficient alternative to real-world data collection for learning visuomotor robotic policies. However, the simulation-to-reality, or Sim2Real distribution shift -- introduced by employing simulation-trained…

Robotics · Computer Science 2025-09-09 Yash Yardi , Samuel Biruduganti , Lars Ankile

A long-standing challenge in Reinforcement Learning is enabling agents to learn a model of their environment which can be transferred to solve other problems in a world with the same underlying rules. One reason this is difficult is the…

Machine Learning · Computer Science 2019-05-16 Kai Olav Ellefsen , Jim Torresen

Reinforcement learning was carried out in a simulated environment to learn continuous velocity control over multiple motor axes. This was then applied to a real-world optical tweezers experiment with the objective of moving a laser-trapped…

Machine Learning · Computer Science 2020-11-11 Matthew Praeger , Yunhui Xie , James A. Grant-Jacob , Robert W. Eason , Ben Mills

We evaluate the use of original game curricula supported by the Atari 2600 console as a heterogeneous transfer benchmark for deep reinforcement learning agents. Game designers created curricula using combinations of several discrete…

Machine Learning · Computer Science 2022-10-25 Andrei A. Rusu , Sebastian Flennerhag , Dushyant Rao , Razvan Pascanu , Raia Hadsell