English
Related papers

Related papers: A Study on Quantifying Sim2Real Image Gap in Auton…

200 papers

Synthetic images are an option for augmenting limited medical imaging datasets to improve the performance of various machine learning models. A common metric for evaluating synthetic image quality is the Fr\'echet Inception Distance (FID)…

Image and Video Processing · Electrical Eng. & Systems 2025-07-30 Thomas Wallace , Ik Siong Heng , Senad Subasic , Chris Messenger

In the autonomous driving domain, data collection and annotation from real vehicles are expensive and sometimes unsafe. Simulators are often used for data augmentation, which requires realistic sensor models that are hard to formulate and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Ahmad El Sallab , Ibrahim Sobh , Mohamed Zahran , Nader Essam

Autonomous vehicles need safe development and testing environments. Many traffic scenarios are such that they cannot be tested in the real world. We see hybrid photorealistic simulation as a viable tool for developing AI (artificial…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-10 Jussi Hanhirova , Anton Debner , Matias Hyyppä , Vesa Hirvisalo

Environmental perception is an important aspect within the field of autonomous vehicles that provides crucial information about the driving domain, including but not limited to identifying clear driving areas and surrounding obstacles.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Senay Cakir , Marcel Gauß , Kai Häppeler , Yassine Ounajjar , Fabian Heinle , Reiner Marchthaler

We propose the use of latent space generative world models to address the covariate shift problem in autonomous driving. A world model is a neural network capable of predicting an agent's next state given past states and actions. By…

There is considerable evidence that deep neural networks are vulnerable to adversarial perturbations applied directly to their digital inputs. However, it remains an open question whether this translates to vulnerabilities in real systems.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Jinghan Yang , Adith Boloor , Ayan Chakrabarti , Xuan Zhang , Yevgeniy Vorobeychik

This paper presents a safe imitation learning approach for autonomous vehicle driving, with attention on real-life human driving data and experimental validation. In order to increase occupant's acceptance and gain drivers' trust, the…

Systems and Control · Electrical Eng. & Systems 2021-10-11 Flavia Sofia Acerbo , Mohsen Alirezaei , Herman Van der Auweraer , Tong Duy Son

How can we reliably simulate future driving scenarios under a wide range of ego driving behaviors? Recent driving world models, developed exclusively on real-world driving data composed mainly of safe expert trajectories, struggle to follow…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jiazhi Yang , Kashyap Chitta , Shenyuan Gao , Long Chen , Yuqian Shao , Xiaosong Jia , Hongyang Li , Andreas Geiger , Xiangyu Yue , Li Chen

This paper presents the FPGA design of a convolutional neural network (CNN) based road segmentation algorithm for real-time processing of LiDAR data. For autonomous vehicles, it is important to perform road segmentation and obstacle…

Robotics · Computer Science 2017-11-09 Yecheng Lyu , Lin Bai , Xinming Huang

Based on the direct perception paradigm of autonomous driving, we investigate and modify the CNNs (convolutional neural networks) AlexNet and GoogLeNet that map an input image to few perception indicators (heading angle, distances to…

Machine Learning · Computer Science 2019-11-13 Der-Hau Lee , Kuan-Lin Chen , Kuan-Han Liou , Chang-Lun Liu , Jinn-Liang Liu

In this paper we propose a real-time, calibration-agnostic and effective localization system for self-driving cars. Our method learns to embed the online LiDAR sweeps and intensity map into a joint deep embedding space. Localization is then…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Ioan Andrei Bârsan , Shenlong Wang , Andrei Pokrovsky , Raquel Urtasun

Inspired by human driving focus, this research pioneers networks augmented with Focusing Sampling, Partial Field of View Evaluation, Enhanced FPN architecture and Directional IoU Loss - targeted innovations addressing obstacles to precise…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Liman Wang , Hanyang Zhong

Autonomous vehicles rely heavily upon their perception subsystems to see the environment in which they operate. Unfortunately, the effect of variable weather conditions presents a significant challenge to object detection algorithms, and…

Simulation models for perception sensors are integral components of automotive simulators used for the virtual Verification and Validation (V\&V) of Autonomous Driving Systems (ADS). These models also serve as powerful tools for generating…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Hamed Haghighi , Mehrdad Dianati , Valentina Donzella , Kurt Debattista

How should we integrate representations from complementary sensors for autonomous driving? Geometry-based fusion has shown promise for perception (e.g. object detection, motion forecasting). However, in the context of end-to-end driving, we…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Kashyap Chitta , Aditya Prakash , Bernhard Jaeger , Zehao Yu , Katrin Renz , Andreas Geiger

Sensor simulation is a key component for testing the performance of self-driving vehicles and for data augmentation to better train perception systems. Typical approaches rely on artists to create both 3D assets and their animations to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Ze Yang , Siva Manivasagam , Ming Liang , Bin Yang , Wei-Chiu Ma , Raquel Urtasun

We present a novel method for testing the safety of self-driving vehicles in simulation. We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps. Instead, we directly simulate the outputs…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Kelvin Wong , Qiang Zhang , Ming Liang , Bin Yang , Renjie Liao , Abbas Sadat , Raquel Urtasun

A principal barrier to large-scale deployment of urban autonomous driving systems lies in the prevalence of complex scenarios and edge cases. Existing systems fail to effectively interpret semantic information within traffic contexts and…

Robotics · Computer Science 2025-07-09 Yuhang Zhang , Jiaqi Liu , Chengkai Xu , Peng Hang , Jian Sun

A significant part of contemporary research in autonomous vehicles is dedicated to the development of safety critical systems where state-of-the-art artificial intelligence (AI) algorithms, like computer vision (CV), can play a major role.…

Imitation learning is a promising approach for training autonomous vehicles (AV) to navigate complex traffic environments by mimicking expert driver behaviors. While existing imitation learning frameworks focus on leveraging expert…

Robotics · Computer Science 2025-09-25 Yasin Sonmez , Hanna Krasowski , Murat Arcak