English
Related papers

Related papers: Sim-To-Real Transfer for Miniature Autonomous Car …

200 papers

We present a control approach for autonomous vehicles based on deep reinforcement learning. A neural network agent is trained to map its estimated state to acceleration and steering commands given the objective of reaching a specific target…

Robotics · Computer Science 2020-03-16 Andreas Folkers , Matthias Rick , Christof Büskens

Robots can learn to do complex tasks in simulation, but often, learned behaviors fail to transfer well to the real world due to simulator imperfections (the reality gap). Some existing solutions to this sim-to-real problem, such as Grounded…

Robotics · Computer Science 2020-08-05 Haresh Karnan , Siddharth Desai , Josiah P. Hanna , Garrett Warnell , Peter Stone

Executing drift maneuvers during high-speed cornering presents significant challenges for autonomous vehicles, yet offers the potential to minimize turning time and enhance driving dynamics. While reinforcement learning (RL) has shown…

Robotics · Computer Science 2024-11-26 Shiyue Zhao , Junzhi Zhang , Neda Masoud , Yuhong Jiang , Heye Huang , Tao Liu

Complex mechanical systems such as vehicle powertrains are inherently subject to multiple nonlinearities and uncertainties arising from parametric variations. Modeling errors are therefore unavoidable, making the transfer of control systems…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Heisei Yonezawa , Ansei Yonezawa , Itsuro Kajiwara

Drifting, characterized by controlled vehicle motion at high sideslip angles, is crucial for safely handling emergency scenarios at the friction limits. While recent reinforcement learning approaches show promise for drifting control, they…

Robotics · Computer Science 2025-08-04 Yihan Zhou , Yiwen Lu , Bo Yang , Jiayun Li , Yilin Mo

This paper proposes a novel alternative to existing sim-to-real methods for training control policies with simulated experiences. Prior sim-to-real methods for legged robots mostly rely on the domain randomization approach, where a fixed…

Robotics · Computer Science 2026-03-26 Junhyeok Rui Cha , Woohyun Cha , Jaeyong Shin , Donghyeon Kim , Jaeheung Park

This paper introduces an open-source, decentralized framework named SigmaRL, designed to enhance both sample efficiency and generalization of multi-agent Reinforcement Learning (RL) for motion planning of connected and automated vehicles.…

Robotics · Computer Science 2025-04-11 Jianye Xu , Pan Hu , Bassam Alrifaee

In this work, we present a rigorous end-to-end control strategy for autonomous vehicles aimed at minimizing lap times in a time attack racing event. We also introduce AutoRACE Simulator developed as a part of this research project, which…

Robotics · Computer Science 2022-11-29 Chinmay Vilas Samak , Tanmay Vilas Samak , Sivanathan Kandhasamy

Learning robot tasks or controllers using deep reinforcement learning has been proven effective in simulations. Learning in simulation has several advantages. For example, one can fully control the simulated environment, including halting…

Machine Learning · Computer Science 2018-09-18 Jeroen van Baar , Alan Sullivan , Radu Cordorel , Devesh Jha , Diego Romeres , Daniel Nikovski

Recent advances in robotic learning in simulation have shown impressive results in accelerating learning complex manipulation skills. However, the sim-to-real gap, caused by discrepancies between simulation and reality, poses significant…

Robotics · Computer Science 2025-03-25 Jacinto Colan , Keisuke Sugita , Ana Davila , Yutaro Yamada , Yasuhisa Hasegawa

Reinforcement learning (RL) control approach with application into power electronics systems has become an emerging topic whilst the sim-to-real issue remains a challenging problem as very few results can be referred to in the literature.…

Systems and Control · Electrical Eng. & Systems 2021-10-22 Chenggang Cui , Tianxiao Yang , Yuxuan Dai , Chuanlin Zhang

Deep Reinforcement Learning (DRL) has become a powerful methodology to solve complex decision-making problems. However, DRL has several limitations when used in real-world problems (e.g., robotics applications). For instance, long training…

Robotics · Computer Science 2019-08-15 Rodrigo Pérez-Dattari , Carlos Celemin , Javier Ruiz-del-Solar , Jens Kober

Domain randomization (DR) enables sim-to-real transfer by training controllers on a distribution of simulated environments, with the goal of achieving robust performance in the real world. Although DR is widely used in practice and is often…

Systems and Control · Electrical Eng. & Systems 2025-04-01 Tesshu Fujinami , Bruce D. Lee , Nikolai Matni , George J. Pappas

Synthetic data is a scalable alternative to manual supervision, but it requires overcoming the sim-to-real domain gap. This discrepancy between virtual and real worlds is addressed by two seemingly opposed approaches: improving the realism…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Sergey Zakharov , Rares Ambrus , Vitor Guizilini , Wadim Kehl , Adrien Gaidon

Sim-to-real transfer remains a significant challenge in robotics due to the discrepancies between simulated and real-world dynamics. Traditional methods like Domain Randomization often fail to capture fine-grained dynamics, limiting their…

Robotics · Computer Science 2025-03-04 Xilun Zhang , Shiqi Liu , Peide Huang , William Jongwon Han , Yiqi Lyu , Mengdi Xu , Ding Zhao

Sim2Real aims at training policies in high-fidelity simulation environments and effectively transferring them to the real world. Despite the developments of accurate simulators and Sim2Real RL approaches, the policies trained purely in…

Machine Learning · Computer Science 2025-10-21 Akhil S Anand , Shambhuraj Sawant , Jasper Hoffmann , Dirk Reinhardt , Sebastien Gros

Most of the current studies on autonomous vehicle decision-making and control tasks based on reinforcement learning are conducted in simulated environments. The training and testing of these studies are carried out under rule-based…

Systems and Control · Electrical Eng. & Systems 2024-04-22 Yuan Lin , Antai Xie , Xiao Liu

In this paper, we study the problem of zero-shot sim-to-real when the task requires both highly precise control with sub-millimetre error tolerance, and wide task space generalisation. Our framework involves a coarse-to-fine controller,…

Robotics · Computer Science 2021-07-30 Eugene Valassakis , Norman Di Palo , Edward Johns

Domain randomization (DR) is a successful technique for learning robust policies for robot systems, when the dynamics of the target robot system are unknown. The success of policies trained with domain randomization however, is highly…

Machine Learning · Computer Science 2019-09-18 Melissa Mozifian , Juan Camilo Gamboa Higuera , David Meger , Gregory Dudek

In order to mitigate the sample complexity of real-world reinforcement learning, common practice is to first train a policy in a simulator where samples are cheap, and then deploy this policy in the real world, with the hope that it…

Machine Learning · Computer Science 2024-10-29 Andrew Wagenmaker , Kevin Huang , Liyiming Ke , Byron Boots , Kevin Jamieson , Abhishek Gupta