English
Related papers

Related papers: Using Simulation Optimization to Improve Zero-shot…

200 papers

Learning visuomotor policies in simulation is much safer and cheaper than in the real world. However, due to discrepancies between the simulated and real data, simulator-trained policies often fail when transferred to real robots. One…

Robotics · Computer Science 2023-07-31 Ricardo Garcia , Robin Strudel , Shizhe Chen , Etienne Arlaud , Ivan Laptev , Cordelia Schmid

Learning robot skills from scratch is often time-consuming, while reusing data promotes sustainability and improves sample efficiency. This study investigates policy transfer across different robotic platforms, focusing on peg-in-hole task…

Robotics · Computer Science 2026-04-09 Khalil Abuibaid , Vinit Hegiste , Nigora Gafur , Achim Wagner , Martin Ruskowski

Tilt-rotor aerial robots enable omnidirectional maneuvering through thrust vectoring, but introduce significant control challenges due to the strong coupling between joint and rotor dynamics. While model-based controllers can achieve high…

Robotics · Computer Science 2026-02-26 Wentao Zhang , Zhaoqi Ma , Jinjie Li , Huayi Wang , Haokun Liu , Junichiro Sugihara , Chen Chen , Yicheng Chen , Moju Zhao

We present Sym2Real, a fully data-driven framework that provides a principled way to train low-level adaptive controllers in a highly data-efficient manner. Using only about 10 trajectories, we achieve robust control of both a quadrotor and…

Robotics · Computer Science 2025-09-22 Easop Lee , Samuel A. Moore , Boyuan Chen

Learning control policies for multi-robot systems (MRS) remains a major challenge due to long-term coordination and the difficulty of obtaining realistic training data. In this work, we address both limitations within an imitation learning…

Robotics · Computer Science 2025-10-03 Jesús Roche , Eduardo Sebastián , Eduardo Montijano

Reinforcement learning encounters many challenges when applied directly in the real world. Sim-to-real transfer is widely used to transfer the knowledge learned from simulation to the real world. Domain randomization -- one of the most…

Machine Learning · Computer Science 2022-03-15 Xiaoyu Chen , Jiachen Hu , Chi Jin , Lihong Li , Liwei Wang

Optimal control holds great potential to improve a variety of robotic applications. The application of optimal control on-board limited platforms has been severely hindered by the large computational requirements of current state of the art…

Robotics · Computer Science 2021-09-23 Shuo Li , Ekin Ozturk , Christophe De Wagter , Guido C. H. E. de Croon , Dario Izzo

Utilizing a servo to tilt each rotor transforms quadrotors from underactuated to overactuated systems, allowing for independent control of both attitude and position, which provides advantages for aerial manipulation. However, this…

Robotics · Computer Science 2024-08-26 Jinjie Li , Junichiro Sugihara , Moju Zhao

Diffusion-based robot navigation policies trained on large-scale imitation learning datasets, can generate multi-modal trajectories directly from the robot's visual observations, bypassing the traditional localization-mapping-planning…

Robotics · Computer Science 2026-03-16 Junhe Sheng , Ruofei Bai , Kuan Xu , Ruimeng Liu , Jie Chen , Shenghai Yuan , Wei-Yun Yau , Lihua Xie

Learning from Demonstration is increasingly used for transferring operator manipulation skills to robots. In practice, it is important to cater for limited data and imperfect human demonstrations, as well as underlying safety constraints.…

Robotics · Computer Science 2020-04-03 Ya-Yen Tsai , Bo Xiao , Edward Johns , Guang-Zhong Yang

Traditional dynamic models of continuum robots are in general computationally expensive and not suitable for real-time control. Recent approaches using learning-based methods to approximate the dynamic model of continuum robots for control…

Robotics · Computer Science 2022-05-16 Xinran Wang , Nicolas Rojas

Simulation is used extensively in autonomous systems, particularly in robotic manipulation. By far, the most common approach is to train a controller in simulation, and then use it as an initial starting point for the real system. We…

Machine Learning · Statistics 2021-10-06 Shirli Di Castro Shashua , Dotan Di Castro , Shie Mannor

Reinforcement learning (RL) policies often fail to generalize to new robots, tasks, or environments with different physical parameters, a challenge that limits their real-world applicability. This paper presents a simple, zero-shot transfer…

Machine Learning · Computer Science 2025-10-13 Francisco Pascoa , Ian Lalonde , Alexandre Girard

Reinforcement learning (RL) is widely used for humanoid control, with on-policy methods such as Proximal Policy Optimization (PPO) enabling robust training via large-scale parallel simulation and, in some cases, zero-shot deployment to real…

Robotics · Computer Science 2026-02-24 Weidong Huang , Zhehan Li , Hangxin Liu , Biao Hou , Yao Su , Jingwen Zhang

The generalization ability of visuomotor policy is crucial, as a good policy should be deployable across diverse scenarios. Some methods can collect large amounts of trajectory augmentation data to train more generalizable imitation…

Robotics · Computer Science 2025-11-14 Hanwen Wang

Robot foundation models are beginning to deliver on the promise of generalist robotic agents, yet progress remains constrained by the scarcity of large-scale real-world manipulation datasets. Simulation and synthetic data generation offer a…

Humanoid whole-body control (WBC) policies trained in simulation often suffer from the sim-to-real gap, which fundamentally arises from simulator inductive bias, the inherent assumptions and limitations of any single simulator. These biases…

Robotics · Computer Science 2025-10-15 Zixing Lei , Zibo Zhou , Sheng Yin , Yueru Chen , Qingyao Xu , Weixin Li , Yunhong Wang , Bowei Tang , Wei Jing , Siheng Chen

This work presents an overview of the technical details behind a high performance reinforcement learning policy deployment with the Spot RL Researcher Development Kit for low level motor access on Boston Dynamics Spot. This represents the…

Machine Learning · Computer Science 2025-07-04 AJ Miller , Fangzhou Yu , Michael Brauckmann , Farbod Farshidian

In this paper, we present a novel developmental reinforcement learning-based controller for a quadcopter with thrust vectoring capabilities. This multirotor UAV design has tilt-enabled rotors. It utilizes the rotor force magnitude and…

Robotics · Computer Science 2020-07-16 Aditya M. Deshpande , Rumit Kumar , Ali A. Minai , Manish Kumar

Reinforcement Learning has been able to solve many complicated robotics tasks without any need for feature engineering in an end-to-end fashion. However, learning the optimal policy directly from the sensory inputs, i.e the observations,…