English
Related papers

Related papers: Zero-Shot Sim-to-Real Reinforcement Learning for F…

200 papers

Real-world robotic manipulation in homes and factories demands reliability, efficiency, and robustness that approach or surpass those of skilled human operators. We present RL-100, a real-world reinforcement learning framework built on…

Robotics · Computer Science 2026-03-11 Kun Lei , Huanyu Li , Dongjie Yu , Zhenyu Wei , Lingxiao Guo , Zhennan Jiang , Ziyu Wang , Shiyu Liang , Huazhe Xu

Reinforcement learning and sim-to-real transfer have made significant progress in dexterous manipulation. However, progress remains limited by the difficulty of simulating complex contact dynamics and multisensory signals, especially…

Robotics · Computer Science 2026-02-26 Elvis Hsieh , Wen-Han Hsieh , Yen-Jen Wang , Toru Lin , Jitendra Malik , Koushil Sreenath , Haozhi Qi

Simulation-to-real transfer is an important strategy for making reinforcement learning practical with real robots. Successful sim-to-real transfer systems have difficulty producing policies which generalize across tasks, despite training…

Recently, reinforcement learning (RL) algorithms have demonstrated remarkable success in learning complicated behaviors from minimally processed input. However, most of this success is limited to simulation. While there are promising…

Machine Learning · Computer Science 2019-03-29 Quan Vuong , Sharad Vikram , Hao Su , Sicun Gao , Henrik I. Christensen

Action-constrained reinforcement learning (RL) is a widely-used approach in various real-world applications, such as scheduling in networked systems with resource constraints and control of a robot with kinematic constraints. While the…

Machine Learning · Computer Science 2021-08-03 Jyun-Li Lin , Wei Hung , Shang-Hsuan Yang , Ping-Chun Hsieh , Xi Liu

Simulation has recently become key for deep reinforcement learning to safely and efficiently acquire general and complex control policies from visual and proprioceptive inputs. Tactile information is not usually considered despite its…

Robotics · Computer Science 2021-11-02 Alex Church , John Lloyd , Raia Hadsell , Nathan F. Lepora

The human labour required for tree crop harvesting is a major cost component in fruit production and is increasing. To address this, many existing research works have sought to demonstrate commercially viable robotic harvesting for tree…

Robotics · Computer Science 2021-10-05 Jasper Brown , Salah Sukkarieh

We explore sim-to-real transfer of deep reinforcement learning controllers for a heavy vehicle with active suspensions designed for traversing rough terrain. While related research primarily focuses on lightweight robots with electric…

In the last decade, data-driven approaches have become popular choices for quadrotor control, thanks to their ability to facilitate the adaptation to unknown or uncertain flight conditions. Among the different data-driven paradigms, Deep…

Robotics · Computer Science 2024-12-30 Alberto Dionigi , Gabriele Costante , Giuseppe Loianno

Reinforcement learning (RL) algorithms can enable high-maneuverability in unmanned aerial vehicles (MAVs), but transferring them from simulation to real-world use is challenging. Variable-pitch propeller (VPP) MAVs offer greater agility,…

Robotics · Computer Science 2025-04-11 Zhikun Wang , Shiyu Zhao

We use model-free reinforcement learning, extensive simulation, and transfer learning to develop a continuous control algorithm that has good zero-shot performance in a real physical environment. We train a simulated agent to act optimally…

Artificial Intelligence · Computer Science 2018-03-09 M Ferguson , K. H. Law

Due to limited resources and public safety concerns, deep reinforcement learning (RL) agents for many cyber-physical systems (e.g., autonomous vehicles) are first trained in simulators. However, when deployed in real world environments,…

Machine Learning · Computer Science 2026-05-28 Gengyue Han , Yiheng Feng

Due to labor shortage and rising labor cost for the apple industry, there is an urgent need for the development of robotic systems to efficiently and autonomously harvest apples. In this paper, we present a system overview and algorithm…

Robotics · Computer Science 2022-11-08 Kaixiang Zhang , Kyle Lammers , Pengyu Chu , Nathan Dickinson , Zhaojian Li , Renfu Lu

Increasing the scale of reinforcement learning experiments has allowed researchers to achieve unprecedented results in both training sophisticated agents for video games, and in sim-to-real transfer for robotics. Typically such experiments…

Machine Learning · Computer Science 2020-06-24 Aleksei Petrenko , Zhehui Huang , Tushar Kumar , Gaurav Sukhatme , Vladlen Koltun

In agricultural automation, inherent occlusion presents a major challenge for robotic harvesting. We propose a novel imitation learning-based viewpoint planning approach to actively adjust camera viewpoint and capture unobstructed images of…

Robotics · Computer Science 2025-03-14 Lun Li , Hamidreza Kasaei

Confinement during COVID-19 has caused serious effects on agriculture all over the world. As one of the efficient solutions, mechanical harvest/auto-harvest that is based on object detection and robotic harvester becomes an urgent need.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 Kevin Riou , Jingwen Zhu , Suiyi Ling , Mathis Piquet , Vincent Truffault , Patrick Le Callet

The industrial application of Deep Reinforcement Learning (DRL) is frequently slowed down because of the inability to generate the experience required to train the models. Collecting data often involves considerable time and economic effort…

Robotics · Computer Science 2025-01-27 Lucía Güitta-López , Jaime Boal , Álvaro J. López-López

Sim-to-real transfer remains a major challenge in reinforcement learning (RL) for robotics, as policies trained in simulation often fail to generalize to the real world due to discrepancies in environment dynamics. Domain Randomization (DR)…

Robotics · Computer Science 2025-11-07 Marco Iannotta , Yuxuan Yang , Johannes A. Stork , Erik Schaffernicht , Todor Stoyanov

Reinforcement learning (RL) has demonstrated great success in the past several years. However, most of the scenarios focus on simulated environments. One of the main challenges of transferring the policy learned in a simulated environment…

Robotics · Computer Science 2021-02-24 Ya-Yen Tsai , Hui Xu , Zihan Ding , Chong Zhang , Edward Johns , Bidan Huang

Bagging is an essential skill that humans perform in their daily activities. However, deformable objects, such as bags, are complex for robots to manipulate. This paper presents an efficient learning-based framework that enables robots to…

Robotics · Computer Science 2023-10-24 Francisco Munguia-Galeano , Jihong Zhu , Juan David Hernández , Ze Ji