English
Related papers

Related papers: RoboTron-Sim: Improving Real-World Driving via Sim…

200 papers

Autonomous driving is complex, requiring sophisticated 3D scene understanding, localization, mapping, and control. Rather than explicitly modelling and fusing each of these components, we instead consider an end-to-end approach via…

Machine Learning · Computer Science 2022-10-27 John So , Amber Xie , Sunggoo Jung , Jeffrey Edlund , Rohan Thakker , Ali Agha-mohammadi , Pieter Abbeel , Stephen James

The limited onboard energy of autonomous mobile robots poses a tremendous challenge for practical deployment. Hence, efficient computing solutions are imperative. A crucial shortcoming of state-of-the-art computing solutions is that they…

Robotics · Computer Science 2021-08-31 Behzad Boroujerdian , Radhika Ghosal , Jonathan Cruz , Brian Plancher , Vijay Janapa Reddi

Data for training learning-enabled self-driving cars in the physical world are typically collected in a safe, normal environment. Such data distribution often engenders a strong bias towards safe driving, making self-driving cars unprepared…

Autonomous vehicles are one of the most popular and also fast-growing technologies in the world. As we go further, there are still a lot of challenges that are unsolved and may cause problems in the future when it comes to testing in real…

Safety-critical scenarios are essential for training and evaluating autonomous driving (AD) systems, yet remain extremely rare in real-world driving datasets. To address this, we propose Real-world Crash Grounding (RCG), a scenario…

Robotics · Computer Science 2025-07-16 Benjamin Stoler , Juliet Yang , Jonathan Francis , Jean Oh

The risen complexity of automotive systems requires new development strategies and methods to master the upcoming challenges. Traditional methods need thus to be changed by an increased level of automation, and a faster continuous…

Software Engineering · Computer Science 2024-04-04 Romina Eramo , Hamzeh Eyal Salman , Matteo Spezialetti , Darko Stern , Pierre Quinton , Antonio Cicchetti

Autonomous racing presents unique challenges due to its non-linear dynamics, the high speed involved, and the critical need for real-time decision-making under dynamic and unpredictable conditions. Most traditional Reinforcement Learning…

Robotics · Computer Science 2025-05-13 Benedict Hildisch , Edoardo Ghignone , Nicolas Baumann , Cheng Hu , Andrea Carron , Michele Magno

Automated Driving Systems (ADSs) have seen rapid progress in recent years. To ensure the safety and reliability of these systems, extensive testings are being conducted before their future mass deployment. Testing the system on the road is…

Software Engineering · Computer Science 2021-12-03 Ziyuan Zhong , Yun Tang , Yuan Zhou , Vania de Oliveira Neves , Yang Liu , Baishakhi Ray

Large real-world robot datasets hold great potential to train generalist robot models, but scaling real-world human data collection is time-consuming and resource-intensive. Simulation has great potential in supplementing large-scale data,…

Autonomous vehicles (AVs) have demonstrated significant potential in revolutionizing transportation, yet ensuring their safety and reliability remains a critical challenge, especially when exposed to dynamic and unpredictable environments.…

Simulation systems have become an essential component in the development and validation of autonomous driving technologies. The prevailing state-of-the-art approach for simulation is to use game engines or high-fidelity computer graphics…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Wei Li , Chengwei Pan , Rong Zhang , Jiaping Ren , Yuexin Ma , Jin Fang , Feilong Yan , Qichuan Geng , Xinyu Huang , Huajun Gong , Weiwei Xu , Guoping Wang , Dinesh Manocha , Ruigang Yang

Over the past few years there has been major progress in the field of synthetic data generation using simulation based techniques. These methods use high-end graphics engines and physics-based ray-tracing rendering in order to represent the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Paul Yudkin , Eli Friedman , Orly Zvitia , Gil Elbaz

Simulation data can be utilized to extend real-world driving data in order to cover edge cases, such as vehicle accidents. The importance of handling edge cases can be observed in the high societal costs in handling car accidents, as well…

Robotics · Computer Science 2020-07-24 Shivam Akhauri , Laura Zheng , Ming Lin

Simulation engines are widely adopted in robotics. However, they lack either full simulation control, ROS integration, realistic physics, or photorealism. Recently, synthetic data generation and realistic rendering has advanced tasks like…

Robotics · Computer Science 2023-05-29 Elia Bonetto , Chenghao Xu , Aamir Ahmad

Advanced collision avoidance and driver hand-off systems can benefit from the ability to accurately predict, in real time, the probability a vehicle will be involved in a collision within an intermediate horizon of 10 to 20 seconds. The…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Blake Wulfe , Sunil Chintakindi , Sou-Cheng T. Choi , Rory Hartong-Redden , Anuradha Kodali , Mykel J. Kochenderfer

Deep reinforcement learning provides a promising approach for vision-based control of real-world robots. However, the generalization of such models depends critically on the quantity and variety of data available for training. This data can…

Machine Learning · Computer Science 2019-02-12 Katie Kang , Suneel Belkhale , Gregory Kahn , Pieter Abbeel , Sergey Levine

For a successful market launch of automated vehicles (AVs), proof of their safety is essential. Due to the open parameter space, an infinite number of traffic situations can occur, which makes the proof of safety an unsolved problem. With…

Robotics · Computer Science 2020-08-27 Thomas Ponn , Matthias Breitfuß , Xiao Yu , Frank Diermeyer

Roadside Collaborative Perception refers to a system where multiple roadside units collaborate to pool their perceptual data, assisting vehicles in enhancing their environmental awareness. Existing roadside perception methods concentrate on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Yuwen Du , Anning Hu , Zichen Chao , Yifan Lu , Junhao Ge , Genjia Liu , Weitao Wu , Lanjun Wang , Siheng Chen

While recent developments in autonomous vehicle (AV) technology highlight substantial progress, we lack tools for rigorous and scalable testing. Real-world testing, the $\textit{de facto}$ evaluation environment, places the public in…

Machine Learning · Computer Science 2019-01-15 Matthew O'Kelly , Aman Sinha , Hongseok Namkoong , John Duchi , Russ Tedrake

With the growing popularity of digital twin and autonomous driving in transportation, the demand for simulation systems capable of generating high-fidelity and reliable scenarios is increasing. Existing simulation systems suffer from a lack…

Systems and Control · Electrical Eng. & Systems 2023-07-27 Licheng Wen , Daocheng Fu , Song Mao , Pinlong Cai , Min Dou , Yikang Li , Yu Qiao