English
Related papers

Related papers: AYDIV: Adaptable Yielding 3D Object Detection via …

200 papers

Integrating LiDAR and Camera information into Bird's-Eye-View (BEV) has become an essential topic for 3D object detection in autonomous driving. Existing methods mostly adopt an independent dual-branch framework to generate LiDAR and camera…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Hongxiang Cai , Zeyuan Zhang , Zhenyu Zhou , Ziyin Li , Wenbo Ding , Jiuhua Zhao

In this paper, we propose an accurate and robust perception module for Autonomous Vehicles (AVs) for drivable space extraction. Perception is crucial in autonomous driving, where many deep learning-based methods, while accurate on benchmark…

Camera and LiDAR sensor modalities provide complementary appearance and geometric information useful for detecting 3D objects for autonomous vehicle applications. However, current end-to-end fusion methods are challenging to train and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Anas Mahmoud , Jordan S. K. Hu , Steven L. Waslander

Camera and LiDAR serve as informative sensors for accurate and robust autonomous driving systems. However, these sensors often exhibit heterogeneous natures, resulting in distributional modality gaps that present significant challenges for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yiran Yang , Xu Gao , Tong Wang , Xin Hao , Yifeng Shi , Xiao Tan , Xiaoqing Ye , Jingdong Wang

Estimating and understanding the surroundings of the vehicle precisely forms the basic and crucial step for the autonomous vehicle. The perception system plays a significant role in providing an accurate interpretation of a vehicle's…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Sreenivasa Hikkal Venugopala

The detection of moving infrared dim-small targets has been a challenging and prevalent research topic. The current state-of-the-art methods are mainly based on ConvLSTM to aggregate information from adjacent frames to facilitate the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Dengyan Luo , Yanping Xiang , Hu Wang , Luping Ji , Shuai Li , Mao Ye

Fusing data from cameras and LiDAR sensors is an essential technique to achieve robust 3D object detection. One key challenge in camera-LiDAR fusion involves mitigating the large domain gap between the two sensors in terms of coordinates…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Yecheol Kim , Konyul Park , Minwook Kim , Dongsuk Kum , Jun Won Choi

More and more research works fuse the LiDAR and camera information to improve the 3D object detection of the autonomous driving system. Recently, a simple yet effective fusion framework has achieved an excellent detection performance,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Yun Zhao , Zhan Gong , Peiru Zheng , Hong Zhu , Shaohua Wu

Leveraging multi-modal fusion, especially between camera and LiDAR, has become essential for building accurate and robust 3D object detection systems for autonomous vehicles. Until recently, point decorating approaches, in which point…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Philip Jacobson , Yiyang Zhou , Wei Zhan , Masayoshi Tomizuka , Ming C. Wu

Accurate 3D object detection in autonomous driving is critical yet challenging due to occlusions, varying object sizes, and complex urban environments. This paper introduces the KAN-RCBEVDepth method, an innovative approach aimed at…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Zhihao Lai , Chuanhao Liu , Shihui Sheng , Zhiqiang Zhang

Sensor fusion of camera, LiDAR, and 4-dimensional (4D) Radar has brought a significant performance improvement in autonomous driving. However, there still exist fundamental challenges: deeply coupled fusion methods assume continuous sensor…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Dong-Hee Paek , Seung-Hyun Kong

End-to-end perception and trajectory prediction from raw sensor data is one of the key capabilities for autonomous driving. Modular pipelines restrict information flow and can amplify upstream errors. Recent query-based, fully…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Matej Halinkovic , Nina Masarykova , Alexey Vinel , Marek Galinski

Perceiving the surrounding environment is a fundamental task in autonomous driving. To obtain highly accurate perception results, modern autonomous driving systems typically employ multi-modal sensors to collect comprehensive environmental…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zhiwei Lin , Zhe Liu , Yongtao Wang , Le Zhang , Ce Zhu

Accurate and robust LiDAR 3D object detection is essential for comprehensive scene understanding in autonomous driving. Despite its importance, LiDAR detection performance is limited by inherent constraints of point cloud data, particularly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Rui Yu , Runkai Zhao , Cong Nie , Heng Wang , HuaiCheng Yan , Meng Wang

Multimodal 3D object detection based on deep neural networks has indeed made significant progress. However, it still faces challenges due to the misalignment of scale and spatial information between features extracted from 2D images and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Bonan Ding , Jin Xie , Jing Nie , Jiale Cao

We propose a late-to-early recurrent feature fusion scheme for 3D object detection using temporal LiDAR point clouds. Our main motivation is fusing object-aware latent embeddings into the early stages of a 3D object detector. This feature…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Tong He , Pei Sun , Zhaoqi Leng , Chenxi Liu , Dragomir Anguelov , Mingxing Tan

Accurately localizing 3D objects like pedestrians, cyclists, and other vehicles is essential in Autonomous Driving. To ensure high detection performance, Autonomous Vehicles complement RGB cameras with LiDAR sensors, but effectively…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Carlo Sgaravatti , Riccardo Pieroni , Matteo Corno , Sergio M. Savaresi , Luca Magri , Giacomo Boracchi

3D object detection is a critical task in autonomous driving. Recently multi-modal fusion-based 3D object detection methods, which combine the complementary advantages of LiDAR and camera, have shown great performance improvements over…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Hao Liu , Zhuoran Xu , Dan Wang , Baofeng Zhang , Guan Wang , Bo Dong , Xin Wen , Xinyu Xu

Fusing the camera and LiDAR information has become a de-facto standard for 3D object detection tasks. Current methods rely on point clouds from the LiDAR sensor as queries to leverage the feature from the image space. However, people…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Tingting Liang , Hongwei Xie , Kaicheng Yu , Zhongyu Xia , Zhiwei Lin , Yongtao Wang , Tao Tang , Bing Wang , Zhi Tang

Fusing LiDAR and camera information is essential for achieving accurate and reliable 3D object detection in autonomous driving systems. This is challenging due to the difficulty of combining multi-granularity geometric and semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Jiao , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang