English
Related papers

Related papers: Fully Sparse Fusion for 3D Object Detection

200 papers

Environmental perception with the multi-modal fusion of radar and camera is crucial in autonomous driving to increase accuracy, completeness, and robustness. This paper focuses on utilizing millimeter-wave (MMW) radar and camera sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Taohua Zhou , Yining Shi , Junjie Chen , Kun Jiang , Mengmeng Yang , Diange Yang

Camera-radar fusion offers a robust and low-cost alternative to Camera-lidar fusion for the 3D object detection task in real-time under adverse weather and lighting conditions. However, currently, in the literature, it is possible to find…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Ruan Bispo , Dane Mitrev , Letizia Mariotti , Clément Botty , Denver Humphrey , Anthony Scanlan , Ciarán Eising

LiDAR point clouds have become the most common data source in autonomous driving. However, due to the sparsity of point clouds, accurate and reliable detection cannot be achieved in specific scenarios. Because of their complementarity with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Leichao Cui , Xiuxian Li , Min Meng , Xiaoyu Mo

LiDAR-camera fusion can enhance the performance of 3D object detection by utilizing complementary information between depth-aware LiDAR points and semantically rich images. Existing voxel-based methods face significant challenges when…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Ziying Song , Guoxin Zhang , Jun Xie , Lin Liu , Caiyan Jia , Shaoqing Xu , Zhepeng Wang

Most autonomous vehicles are equipped with LiDAR sensors and stereo cameras. The former is very accurate but generates sparse data, whereas the latter is dense, has rich texture and color information but difficult to extract robust 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Farzin Negahbani , Onur Berk Töre , Fatma Güney , Baris Akgun

In the field of autonomous driving, 3D object detection is a very important perception module. Although the current SOTA algorithm combines Camera and Lidar sensors, limited by the high price of Lidar, the current mainstream landing schemes…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Kai Lei , Zhan Chen , Shuman Jia , Xiaoteng Zhang

4D radar has received significant attention in autonomous driving thanks to its robustness under adverse weathers. Due to the sparse points and noisy measurements of the 4D radar, most of the research finish the 3D object detection task by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hanzhi Zhong , Zhiyu Xiang , Ruoyu Xu , Jingyun Fu , Peng Xu , Shaohong Wang , Zhihao Yang , Tianyu Pu , Eryun Liu

3D object detection with surround-view images is an essential task for autonomous driving. In this work, we propose DETR4D, a Transformer-based framework that explores sparse attention and direct feature query for 3D object detection in…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Zhipeng Luo , Changqing Zhou , Gongjie Zhang , Shijian Lu

Nowadays, an increasing number of works fuse LiDAR and RGB data in the bird's-eye view (BEV) space for 3D object detection in autonomous driving systems. However, existing methods suffer from over-reliance on the LiDAR branch, with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Kang Luo , Xin Chen , Yangyi Xiao , Hesheng Wang

3D object detection is fundamental for safe and robust intelligent transportation systems. Current multi-modal 3D object detectors often rely on complex architectures and training strategies to achieve higher detection accuracy. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Xiangxuan Ren , Zhongdao Wang , Pin Tang , Guoqing Wang , Jilai Zheng , Chao Ma

Three-dimensional Object Detection from multi-view cameras and LiDAR is a crucial component for autonomous driving and smart transportation. However, in the process of basic feature extraction, perspective transformation, and feature…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhongyu Xia , Hansong Yang , Yongtao Wang

Recently 3D object detection from surround-view images has made notable advancements with its low deployment cost. However, most works have primarily focused on close perception range while leaving long-range detection less explored.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Xiaohui Jiang , Shuailin Li , Yingfei Liu , Shihao Wang , Fan Jia , Tiancai Wang , Lijin Han , Xiangyu Zhang

Beam prediction is critical for reducing beam-training overhead in millimeter-wave (mmWave) systems, especially in high-mobility vehicular scenarios. This paper presents a BEV-Fusion based framework that unifies camera, LiDAR, radar, and…

Signal Processing · Electrical Eng. & Systems 2026-04-08 Jiaming Zeng , Cunhua Pan , Haoyang Weng , Ruijing Liu , Hong Ren , Jiangzhou Wang

Multimodal sensor fusion has demonstrated remarkable performance improvements over unimodal approaches in 3D object detection for autonomous vehicles. Typically, existing methods transform multimodal data from independent sensors, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Markus Essl , Marta Moscati , Mubashir Noman , Muhammad Zaigham Zaheer , Usman Naseem , Shah Nawaz , Markus Schedl

Multi-sensor fusion is essential for an accurate and reliable autonomous driving system. Recent approaches are based on point-level fusion: augmenting the LiDAR point cloud with camera features. However, the camera-to-LiDAR projection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zhijian Liu , Haotian Tang , Alexander Amini , Xinyu Yang , Huizi Mao , Daniela Rus , Song Han

In this paper, we propose a new deep architecture for fusing camera and LiDAR sensors for 3D object detection. Because the camera and LiDAR sensor signals have different characteristics and distributions, fusing these two modalities is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Jin Hyeok Yoo , Yecheol Kim , Jisong Kim , Jun Won Choi

LiDAR-based fully sparse architecture has garnered increasing attention. FSDv1 stands out as a representative work, achieving impressive efficacy and efficiency, albeit with intricate structures and handcrafted designs. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Lue Fan , Feng Wang , Naiyan Wang , Zhaoxiang Zhang

Accurate and robust 3D object detection is essential for autonomous driving, where fusing data from sensors like LiDAR and camera enhances detection accuracy. However, sensor malfunctions such as corruption or disconnection can degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Reza Sadeghian , Niloofar Hooshyaripour , Chris Joslin , WonSook Lee

Besides standard cameras, autonomous vehicles typically include multiple additional sensors, such as lidars and radars, which help acquire richer information for perceiving the content of the driving scene. While several recent works focus…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Tim Broedermann , Christos Sakaridis , Dengxin Dai , Luc Van Gool

Detecting objects in 3D LiDAR data is a core technology for autonomous driving and other robotics applications. Although LiDAR data is acquired over time, most of the 3D object detection algorithms propose object bounding boxes…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Rui Huang , Wanyue Zhang , Abhijit Kundu , Caroline Pantofaru , David A Ross , Thomas Funkhouser , Alireza Fathi