English
Related papers

Related papers: RealDriveSim: A Realistic Multi-Modal Multi-Task S…

200 papers

Recent advancements in driving world models enable controllable generation of high-quality RGB videos or multimodal videos. Existing methods primarily focus on metrics related to generation quality and controllability. However, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Kai Zeng , Zhanqian Wu , Kaixin Xiong , Xiaobao Wei , Xiangyu Guo , Zhenxin Zhu , Kalok Ho , Lijun Zhou , Bohan Zeng , Ming Lu , Haiyang Sun , Bing Wang , Guang Chen , Hangjun Ye , Wentao Zhang

Semantic segmentation is key in autonomous driving. Using deep visual learning architectures is not trivial in this context, because of the challenges in creating suitable large scale annotated datasets. This issue has been traditionally…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Emanuele Alberti , Antonio Tavera , Carlo Masone , Barbara Caputo

This article presents UrbanTwin datasets, high-fidelity, realistic replicas of three public roadside lidar datasets: LUMPI, V2X-Real-IC, and TUMTraf-I. Each UrbanTwin dataset contains 10K annotated frames corresponding to one of the public…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Muhammad Shahbaz , Shaurya Agarwal

Reliable autonomous driving relies on large-scale, well-labeled data and robust models. However, manual data collection is resource-intensive, and traditional simulation suffers from a persistent reality gap. While recent generative…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Kaicong Huang , Talha Azfar , Weisong Shi , Ruimin Ke

With the gradual maturity of 5G technology,autonomous driving technology has attracted moreand more attention among the research commu-nity. Autonomous driving vehicles rely on the co-operation of artificial intelligence, visual comput-ing,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Lichao Wang , Lanxin Lei , Hongli Song , Weibao Wang

How can we reliably simulate future driving scenarios under a wide range of ego driving behaviors? Recent driving world models, developed exclusively on real-world driving data composed mainly of safe expert trajectories, struggle to follow…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jiazhi Yang , Kashyap Chitta , Shenyuan Gao , Long Chen , Yuqian Shao , Xiaosong Jia , Hongyang Li , Andreas Geiger , Xiangyu Yue , Li Chen

Deep Learning has seen an unprecedented increase in vision applications since the publication of large-scale object recognition datasets and introduction of scalable compute hardware. State-of-the-art methods for most vision tasks for…

Computer Vision and Pattern Recognition · Computer Science 2020-04-30 Nikita Jaipuria , Xianling Zhang , Rohan Bhasin , Mayar Arafa , Punarjay Chakravarty , Shubham Shrivastava , Sagar Manglani , Vidya N. Murali

Aiming at facilitating a real-world, ever-evolving and scalable autonomous driving system, we present a large-scale dataset for standardizing the evaluation of different self-supervised and semi-supervised approaches by learning from raw…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Jianhua Han , Xiwen Liang , Hang Xu , Kai Chen , Lanqing Hong , Jiageng Mao , Chaoqiang Ye , Wei Zhang , Zhenguo Li , Xiaodan Liang , Chunjing Xu

Radar has stronger adaptability in adverse scenarios for autonomous driving environmental perception compared to widely adopted cameras and LiDARs. Compared with commonly used 3D radars, the latest 4D radars have precise vertical resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Xinyu Zhang , Li Wang , Jian Chen , Cheng Fang , Lei Yang , Ziying Song , Guangqi Yang , Yichen Wang , Xiaofei Zhang , Jun Li , Zhiwei Li , Qingshan Yang , Zhenlin Zhang , Shuzhi Sam Ge

The performance of supervised deep learning algorithms depends significantly on the scale, quality and diversity of the data used for their training. Collecting and manually annotating large amount of data can be both time-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 C. Symeonidis , P. Nousi , P. Tosidis , K. Tsampazis , N. Passalis , A. Tefas , N. Nikolaidis

Object detection in radar imagery with neural networks shows great potential for improving autonomous driving. However, obtaining annotated datasets from real radar images, crucial for training these networks, is challenging, especially in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Oded Bialer , Yuval Haitman

Recent advancements in deep learning and the availability of high-quality real-world driving datasets have propelled end-to-end autonomous driving. Despite this progress, relying solely on real-world data limits the variety of driving…

Robotics · Computer Science 2025-10-29 Jongsuk Kim , Jaeyoung Lee , Gyojin Han , Dongjae Lee , Minki Jeong , Junmo Kim

We present a novel synthetically generated multi-modal dataset, SCaRL, to enable the training and validation of autonomous driving solutions. Multi-modal datasets are essential to attain the robustness and high accuracy required by…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Avinash Nittur Ramesh , Aitor Correas-Serrano , María González-Huici

Datasets are essential for training and testing vehicle perception algorithms. However, the collection and annotation of real-world images is time-consuming and expensive. Driving simulators offer a solution by automatically generating…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Haonan Zhao , Yiting Wang , Thomas Bashford-Rogers , Valentina Donzella , Kurt Debattista

Accurate lane detection is essential for automated driving, enabling safe and reliable vehicle navigation across a variety of road scenarios. Numerous datasets have been introduced to support the development and evaluation of lane detection…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Jörg Gamerdinger , Sven Teufel , Oliver Bringmann

We tackle the problem of producing realistic simulations of LiDAR point clouds, the sensor of preference for most self-driving vehicles. We argue that, by leveraging real data, we can simulate the complex world more realistically compared…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Sivabalan Manivasagam , Shenlong Wang , Kelvin Wong , Wenyuan Zeng , Mikita Sazanovich , Shuhan Tan , Bin Yang , Wei-Chiu Ma , Raquel Urtasun

Data scaling is fundamental to modern deep learning, and grows increasingly critical as autonomous driving shifts to end-to-end learning. Real-world driving data is expensive to annotate and scene-biased, making real-synthetic co-training…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Hongzhi Ruan , Pei Liu , Weiliang Ma , Zhengning Li , Xueyang Zhang , Jun Ma , Dan Xu , Kun Zhan

Synthesizing free-view photo-realistic images is an important task in multimedia. With the development of advanced driver assistance systems~(ADAS) and their applications in autonomous vehicles, experimenting with different scenarios…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Zhuopeng Li , Lu Li , Zeyu Ma , Ping Zhang , Junbo Chen , Jianke Zhu

The rapid advancement of deep learning has intensified the need for comprehensive data for use by autonomous driving algorithms. High-quality datasets are crucial for the development of effective data-driven autonomous driving solutions.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Lianqing Zheng , Long Yang , Qunshu Lin , Wenjin Ai , Minghao Liu , Shouyi Lu , Jianan Liu , Hongze Ren , Jingyue Mo , Xiaokai Bai , Jie Bai , Zhixiong Ma , Xichan Zhu

Existing evaluation paradigms for Autonomous Vehicles (AVs) face critical limitations. Real-world evaluation is often challenging due to safety concerns and a lack of reproducibility, whereas closed-loop simulation can face insufficient…