English
Related papers

Related papers: RS2AD-LiDAR: End-to-End Autonomous Driving LiDAR D…

200 papers

Image-based 3D object detection is an inevitable part of autonomous driving because cheap onboard cameras are already available in most modern cars. Because of the accurate depth information, currently, most state-of-the-art 3D object…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Hendrik Königshof , Kun Li , Christoph Stiller

The capability for open vocabulary perception represents a significant advancement in autonomous driving systems, facilitating the comprehension and interpretation of a wide array of textual inputs in real-time. Despite extensive research…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xinlong Cheng , Lei Li

Localization is one of the core parts of modern robotics. Classic localization methods typically follow the retrieve-then-register paradigm, achieving remarkable success. Recently, the emergence of end-to-end localization approaches has…

Robotics · Computer Science 2025-03-17 Ziyue Wang , Chenghao Shi , Neng Wang , Qinghua Yu , Xieyuanli Chen , Huimin Lu

We present a review of 3D point cloud processing and learning for autonomous driving. As one of the most important sensors in autonomous vehicles, light detection and ranging (LiDAR) sensors collect 3D point clouds that precisely record the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Siheng Chen , Baoan Liu , Chen Feng , Carlos Vallespi-Gonzalez , Carl Wellington

LiDAR has become a standard sensor for autonomous driving applications as they provide highly precise 3D point clouds. LiDAR is also robust for low-light scenarios at night-time or due to shadows where the performance of cameras is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Khaled El Madawy , Hazem Rashed , Ahmad El Sallab , Omar Nasr , Hanan Kamel , Senthil Yogamani

Recently, Gaussian Splatting (GS) has shown great potential for urban scene reconstruction in the field of autonomous driving. However, current urban scene reconstruction methods often depend on multimodal sensors as inputs, \textit{i.e.}…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Kejing Xia , Jidong Jia , Ke Jin , Yucai Bai , Li Sun , Dacheng Tao , Youjian Zhang

Generative models have significantly improved the generation and prediction quality on either camera images or LiDAR point clouds for autonomous driving. However, a real-world autonomous driving system uses multiple kinds of input modality,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Zehuan Wu , Jingcheng Ni , Xiaodong Wang , Yuxin Guo , Rui Chen , Lewei Lu , Jifeng Dai , Yuwen Xiong

High-definition (HD) semantic mapping of complex intersections poses significant challenges for traditional vehicle-based approaches due to occlusions and limited perspectives. This paper introduces a novel camera-LiDAR fusion framework…

Robotics · Computer Science 2025-07-15 Zhongzhang Chen , Miao Fan , Shengtong Xu , Mengmeng Yang , Kun Jiang , Xiangzeng Liu , Haoyi Xiong

Recent advances in autonomous driving systems have shifted towards reducing reliance on high-definition maps (HDMaps) due to the huge costs of annotation and maintenance. Instead, researchers are focusing on online vectorized HDMap…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Sen Yang , Minyue Jiang , Ziwei Fan , Xiaolu Xie , Xiao Tan , Yingying Li , Errui Ding , Liang Wang , Jingdong Wang

End-to-end learning from sensory data has shown promising results in autonomous driving. While employing many sensors enhances world perception and should lead to more robust and reliable behavior of autonomous vehicles, it is challenging…

Robotics · Computer Science 2020-09-21 Shihong Fang , Anna Choromanska

End-to-end autonomous driving has gained significant attention for its potential to learn robust behavior in interactive scenarios and scale with data. Popular architectures often build on separate modules for perception and planning…

Robotics · Computer Science 2026-03-17 David Holtz , Niklas Hanselmann , Simon Doll , Marius Cordts , Bernt Schiele

Traditional methods for autonomous driving are implemented with many building blocks from perception, planning and control, making them difficult to generalize to varied scenarios due to complex assumptions and interdependencies. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Peide Cai , Yuxiang Sun , Hengli Wang , Ming Liu

Synthesizing high-fidelity and controllable 4D LiDAR data is crucial for creating scalable simulation environments for autonomous driving. This task is inherently challenging due to the sensor's unique spherical geometry, the temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Pei Liu , Songtao Wang , Lang Zhang , Xingyue Peng , Yuandong Lyu , Jiaxin Deng , Songxin Lu , Weiliang Ma , Xueyang Zhang , Yifei Zhan , XianPeng Lang , Jun Ma

We study an important, yet largely unexplored problem of large-scale cross-modal visual localization by matching ground RGB images to a geo-referenced aerial LIDAR 3D point cloud (rendered as depth images). Prior works were demonstrated on…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Niluthpol Chowdhury Mithun , Karan Sikka , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar

Recently, the advancement of deep learning in discriminative feature learning from 3D LiDAR data has led to rapid development in the field of autonomous driving. However, automated processing uneven, unstructured, noisy, and massive 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-05-21 Ying Li , Lingfei Ma , Zilong Zhong , Fei Liu , Dongpu Cao , Jonathan Li , Michael A. Chapman

LiDAR is used in autonomous driving to provide 3D spatial information and enable accurate perception in off-road environments, aiding in obstacle detection, mapping, and path planning. Learning-based LiDAR semantic segmentation utilizes…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Kasi Viswanath , Peng Jiang , Sujit PB , Srikanth Saripalli

The need for simulated data in autonomous driving applications has become increasingly important, both for validation of pretrained models and for training new models. In order for these models to generalize to real-world applications, it…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Åsmund Brekke , Fredrik Vatsendvik , Frank Lindseth

Robust road segmentation is a key challenge in self-driving research. Though many image-based methods have been studied and high performances in dataset evaluations have been reported, developing robust and reliable road segmentation is…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Huafeng Liu , Yazhou Yao , Zeren Sun , Xiangrui Li , Ke Jia , Zhenmin Tang

Efficient data utilization is crucial for advancing 3D scene understanding in autonomous driving, where reliance on heavily human-annotated LiDAR point clouds challenges fully supervised methods. Addressing this, our study extends into…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Lingdong Kong , Xiang Xu , Jiawei Ren , Wenwei Zhang , Liang Pan , Kai Chen , Wei Tsang Ooi , Ziwei Liu

Scene flow allows autonomous vehicles to reason about the arbitrary motion of multiple independent objects which is the key to long-term mobile autonomy. While estimating the scene flow from LiDAR has progressed recently, it remains largely…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Fangqiang Ding , Zhijun Pan , Yimin Deng , Jianning Deng , Chris Xiaoxuan Lu