English
Related papers

Related papers: RealDriveSim: A Realistic Multi-Modal Multi-Task S…

200 papers

Large vision-language models (VLMs) have garnered increasing interest in autonomous driving areas, due to their advanced capabilities in complex reasoning tasks essential for highly autonomous vehicle behavior. Despite their potential,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ming Nie , Renyuan Peng , Chunwei Wang , Xinyue Cai , Jianhua Han , Hang Xu , Li Zhang

Neural networks need big annotated datasets for training. However, manual annotation can be too expensive or even unfeasible for certain tasks, like multi-person 2D pose estimation with severe occlusions. A remedy for this is synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 David T. Hoffmann , Dimitrios Tzionas , Micheal J. Black , Siyu Tang

We present the updated version of the HSI-Drive dataset aimed at developing automated driving systems (ADS) using hyperspectral imaging (HSI). The v2.0 version includes new annotated images from videos recorded during winter and fall in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jon Gutiérrez-Zaballa , Koldo Basterretxea , Javier Echanobe , M. Victoria Martínez , Unai Martínez-Corral

With the rapid growth of urban transportation and the continuous progress in autonomous driving, a demand for robust benchmarking autonomous driving algorithms has emerged, calling for accurate modeling of large-scale urban traffic…

Robotics · Computer Science 2025-02-14 Yuheng Zhang , Tianjian Ouyang , Fudan Yu , Lei Qiao , Wei Wu , Jingtao Ding , Jian Yuan , Yong Li

In Autonomous Driving (AD), detection and tracking of obstacles on the roads is a critical task. Deep-learning based methods using annotated LiDAR data have been the most widely adopted approach for this. Unfortunately, annotating 3D point…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Jin Fang , Dingfu Zhou , Feilong Yan , Tongtong Zhao , Feihu Zhang , Yu Ma , Liang Wang , Ruigang Yang

Achieving level-5 driving automation in autonomous vehicles necessitates a robust semantic visual perception system capable of parsing data from different sensors across diverse conditions. However, existing semantic perception datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Tim Brödermann , David Bruggemann , Christos Sakaridis , Kevin Ta , Odysseas Liagouris , Jason Corkill , Luc Van Gool

The next-generation high-resolution automotive radar (4D radar) can provide additional elevation measurement and denser point clouds, which has great potential for 3D sensing in autonomous driving. In this paper, we introduce a dataset…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Lianqing Zheng , Zhixiong Ma , Xichan Zhu , Bin Tan , Sen Li , Kai Long , Weiqi Sun , Sihan Chen , Lu Zhang , Mengyue Wan , Libo Huang , Jie Bai

Synthetic datasets, recognized for their cost effectiveness, play a pivotal role in advancing computer vision tasks and techniques. However, when it comes to remote sensing image processing, the creation of synthetic datasets becomes…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Jian Song , Hongruixuan Chen , Naoto Yokoya

Benchmarking vision-based driving policies is challenging. On one hand, open-loop evaluation with real data is easy, but these results do not reflect closed-loop performance. On the other, closed-loop evaluation is possible in simulation,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Daniel Dauner , Marcel Hallgarten , Tianyu Li , Xinshuo Weng , Zhiyu Huang , Zetong Yang , Hongyang Li , Igor Gilitschenski , Boris Ivanovic , Marco Pavone , Andreas Geiger , Kashyap Chitta

Datasets drive vision progress, yet existing driving datasets are impoverished in terms of visual content and supported tasks to study multitask learning for autonomous driving. Researchers are usually constrained to study a small set of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Fisher Yu , Haofeng Chen , Xin Wang , Wenqi Xian , Yingying Chen , Fangchen Liu , Vashisht Madhavan , Trevor Darrell

Autonomous driving relies on a huge volume of real-world data to be labeled to high precision. Alternative solutions seek to exploit driving simulators that can generate large amounts of labeled data with a plethora of content variations.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 David Acuna , Jonah Philion , Sanja Fidler

Closed-loop simulation environments play a crucial role in the validation and enhancement of autonomous driving systems (ADS). However, certain challenges warrant significant attention, including balancing simulation accuracy with duration,…

Robotics · Computer Science 2025-02-14 Daocheng Fu , Naiting Zhong , Xu Han , Pinlong Cai , Licheng Wen , Song Mao , Botian Shi , Yu Qiao

We use reinforcement learning in simulation to obtain a driving system controlling a full-size real-world vehicle. The driving policy takes RGB images from a single camera and their semantic segmentation as input. We use mostly synthetic…

Reconstructing accurate 3D surfaces for street-view scenarios is crucial for applications such as digital entertainment and autonomous driving simulation. However, existing street-view datasets, including KITTI, Waymo, and nuScenes, only…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Yubin Hu , Kairui Wen , Heng Zhou , Xiaoyang Guo , Yong-Jin Liu

This work presents AutoDRIVE, a comprehensive research and education platform for implementing and validating intelligent transportation algorithms pertaining to vehicular autonomy as well as smart city management. It is an openly…

Robotics · Computer Science 2022-11-18 Tanmay Vilas Samak , Chinmay Vilas Samak

We propose a perception imitation method to simulate results of a certain perception model, and discuss a new heuristic route of autonomous driving simulator without data synthesis. The motivation is that original sensor data is not always…

Robotics · Computer Science 2023-04-20 Xiaoliang Ju , Yiyang Sun , Yiming Hao , Yikang Li , Yu Qiao , Hongsheng Li

Computer-assisted surgical (CAS) systems enhance surgical execution and outcomes by providing advanced support to surgeons. These systems often rely on deep learning models trained on complex, challenging-to-annotate data. While synthetic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Sabina Martyniak , Joanna Kaleta , Diego Dall'Alba , Michał Naskręt , Szymon Płotka , Przemysław Korzeniowski

Collaborative perception has attracted growing interest from academia and industry due to its potential to enhance perception accuracy, safety, and robustness in autonomous driving through multi-agent information fusion. With the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Naibang Wang , Deyong Shang , Yan Gong , Xiaoxi Hu , Ziying Song , Lei Yang , Yuhan Huang , Xiaoyu Wang , Jianli Lu

Autonomous driving has attracted much attention over the years but turns out to be harder than expected, probably due to the difficulty of labeled data collection for model training. Self-supervised learning (SSL), which leverages unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Kai Chen , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung

With the rapid advancements of sensor technology and deep learning, autonomous driving systems are providing safe and efficient access to intelligent vehicles as well as intelligent transportation. Among these equipped sensors, the radar…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shanliang Yao , Runwei Guan , Zitian Peng , Chenhang Xu , Yilu Shi , Weiping Ding , Eng Gee Lim , Yong Yue , Hyungjoon Seo , Ka Lok Man , Jieming Ma , Xiaohui Zhu , Yutao Yue