English
Related papers

Related papers: MARS: An Instance-aware, Modular and Realistic Sim…

200 papers

Simulation is essential to validate autonomous driving systems. However, a simple simulation, even for an extremely high number of simulated miles or hours, is not sufficient. We need well-founded criteria showing that simulation does…

Software Engineering · Computer Science 2023-01-24 Changwen Li , Joseph Sifakis , Qiang Wang , Rongjie Yan , Jian Zhang

In rapidly-evolving domains such as autonomous driving, the use of multiple sensors with different modalities is crucial to ensure high operational precision and stability. To correctly exploit the provided information by each sensor in a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Quentin Herau , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou , Cyrille Migniot , Pascal Vasseur , Cédric Demonceaux

Compositional neural scene graph studies have shown that radiance fields can be an efficient tool in an editable autonomous driving simulator. However, previous studies learned within a sequence of autonomous driving datasets, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Tianyu Liu , Hao Zhao , Yang Yu , Guyue Zhou , Ming Liu

Motion planning is a fundamental problem in autonomous driving and perhaps the most challenging to comprehensively evaluate because of the associated risks and expenses of real-world deployment. Therefore, simulations play an important role…

Robotics · Computer Science 2025-02-25 Montgomery Alban , Ehsan Ahmadi , Randy Goebel , Amir Rasouli

High-fidelity sensor simulation of light-based sensors such as cameras and LiDARs is critical for safe and accurate autonomy testing. Neural radiance field (NeRF)-based methods that reconstruct sensor observations via ray-casting of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yun Chen , Matthew Haines , Jingkang Wang , Sahil Jain , Krzysztof Baron-Lis , Sivabalan Manivasagam , Ze Yang , Raquel Urtasun

Neural reconstruction models for autonomous driving simulation have made significant strides in recent years, with dynamic models becoming increasingly prevalent. However, these models are typically limited to handling in-domain objects…

How can we reliably simulate future driving scenarios under a wide range of ego driving behaviors? Recent driving world models, developed exclusively on real-world driving data composed mainly of safe expert trajectories, struggle to follow…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jiazhi Yang , Kashyap Chitta , Shenyuan Gao , Long Chen , Yuqian Shao , Xiaosong Jia , Hongyang Li , Andreas Geiger , Xiangyu Yue , Li Chen

Realistic simulators are critical for training and verifying robotics systems. While most of the contemporary simulators are hand-crafted, a scaleable way to build simulators is to use machine learning to learn how the environment behaves…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Seung Wook Kim , Jonah Philion , Antonio Torralba , Sanja Fidler

Autonomous driving vehicles provide a vast potential for realizing use cases in the on-road and off-road domains. Consequently, remarkable solutions exist to autonomous systems' environmental perception and control. Nevertheless, proof of…

Robotics · Computer Science 2024-03-29 Patrick Wolf

For driver observation frameworks, clean datasets collected in controlled simulated environments often serve as the initial training ground. Yet, when deployed under real driving conditions, such simulator-trained models quickly face the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Walter Morales-Alvarez , Novel Certad , Alina Roitberg , Rainer Stiefelhagen , Cristina Olaverri-Monreal

The development of software components for autonomous driving functions should always include an extensive and rigorous evaluation. Since real-world testing is expensive and safety-critical -- especially when facing dynamic racing scenarios…

Robotics · Computer Science 2020-06-18 Tim Stahl , Johannes Betz

Autonomous race cars require perception, estimation, planning, and control modules which work together asynchronously while driving at the limit of a vehicle's handling capability. A fundamental challenge encountered in designing these…

Robotics · Computer Science 2020-11-17 Achin Jain , Matthew O'Kelly , Pratik Chaudhari , Manfred Morari

The aim of this work is to introduce MaRF, a novel framework able to synthesize the Martian environment using several collections of images from rover cameras. The idea is to generate a 3D scene of Mars' surface to address key challenges in…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Lorenzo Giusti , Josue Garcia , Steven Cozine , Darrick Suen , Christina Nguyen , Ryan Alimo

Simulation is an integral part in the process of developing autonomous vehicles and advantageous for training, validation, and verification of driving functions. Even though simulations come with a series of benefits compared to real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Ferdinand Mütsch , Helen Gremmelmaier , Nicolas Becker , Daniel Bogdoll , Marc René Zofka , J. Marius Zöllner

Simulation-based testing is a promising approach to significantly reduce the validation effort of automated driving functions. Realistic models of environment perception sensors such as camera, radar and lidar play a key role in this…

Signal Processing · Electrical Eng. & Systems 2020-10-13 Anthony Ngo , Max Paul Bauer , Michael Resch

Implicit representations such as Neural Radiance Fields (NeRF) have been shown to be very effective at novel view synthesis. However, these models typically require manual and careful human data collection for training. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Pierre Marza , Laetitia Matignon , Olivier Simonin , Dhruv Batra , Christian Wolf , Devendra Singh Chaplot

With the development of artificial intelligence and breakthroughs in deep learning, large-scale Foundation Models (FMs), such as GPT, Sora, etc., have achieved remarkable results in many fields including natural language processing and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Jianhua Wu , Bingzhao Gao , Jincheng Gao , Jianhao Yu , Hongqing Chu , Qiankun Yu , Xun Gong , Yi Chang , H. Eric Tseng , Hong Chen , Jie Chen

As autonomous driving technology is getting more and more mature today, autonomous delivery companies like Starship, Marble, and Nuro has been making progress in the tests of their autonomous delivery robots. While simulations and…

Robotics · Computer Science 2022-05-18 Zhaofeng Tian , Weisong Shi

Autonomous vehicles need safe development and testing environments. Many traffic scenarios are such that they cannot be tested in the real world. We see hybrid photorealistic simulation as a viable tool for developing AI (artificial…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-10 Jussi Hanhirova , Anton Debner , Matias Hyyppä , Vesa Hirvisalo

In the rapidly evolving landscape of autonomous driving, the capability to accurately predict future events and assess their implications is paramount for both safety and efficiency, critically aiding the decision-making process. World…

Machine Learning · Computer Science 2024-05-08 Yanchen Guan , Haicheng Liao , Zhenning Li , Jia Hu , Runze Yuan , Yunjian Li , Guohui Zhang , Chengzhong Xu