English
Related papers

Related papers: PointFusion: Deep Sensor Fusion for 3D Bounding Bo…

200 papers

For 3D object detection, both camera and lidar have been demonstrated to be useful sensory devices for providing complementary information about the same scenery with data representations in different modalities, e.g., 2D RGB image vs 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Xinhao Xiang , Jiawei Zhang

LIDAR point clouds and RGB-images are both extremely essential for 3D object detection. So many state-of-the-art 3D detection algorithms dedicate in fusing these two types of data effectively. However, their fusion methods based on Birds…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Liang Xie , Chao Xiang , Zhengxu Yu , Guodong Xu , Zheng Yang , Deng Cai , Xiaofei He

Multi-modal 3D object detection has received growing attention as the information from different sensors like LiDAR and cameras are complementary. Most fusion methods for 3D detection rely on an accurate alignment and calibration between 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Zhe Liu , Xiaoqing Ye , Zhikang Zou , Xinwei He , Xiao Tan , Errui Ding , Jingdong Wang , Xiang Bai

Good 3D object detection performance from LiDAR-Camera sensors demands seamless feature alignment and fusion strategies. We propose the 3DifFusionDet framework in this paper, which structures 3D object detection as a denoising diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Xinhao Xiang , Simon Dräger , Jiawei Zhang

In LiDAR-based 3D detection, history point clouds contain rich temporal information helpful for future prediction. In the same way, history detections should contribute to future detections. In this paper, we propose a detection enhancement…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Xirui Li , Feng Wang , Naiyan Wang , Chao Ma

Fusing LiDAR and camera information is essential for achieving accurate and reliable 3D object detection in autonomous driving systems. This is challenging due to the difficulty of combining multi-granularity geometric and semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Jiao , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang

Recently, cross-source point cloud registration from different sensors has become a significant research focus. However, traditional methods confront challenges due to the varying density and structure of cross-source point clouds. In order…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Yu Wang , Shuhui Bu , Lin Chen , Yifei Dong , Kun Li , Xuefeng Cao , Ke Li

Fusion of 2D images and 3D point clouds is important because information from dense images can enhance sparse point clouds. However, fusion is challenging because 2D and 3D data live in different spaces. In this work, we propose MVPNet…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Maximilian Jaritz , Jiayuan Gu , Hao Su

In this paper, we propose PointRCNN for 3D object detection from raw point cloud. The whole framework is composed of two stages: stage-1 for the bottom-up 3D proposal generation and stage-2 for refining proposals in the canonical…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Shaoshuai Shi , Xiaogang Wang , Hongsheng Li

Three-dimensional Object Detection from multi-view cameras and LiDAR is a crucial component for autonomous driving and smart transportation. However, in the process of basic feature extraction, perspective transformation, and feature…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhongyu Xia , Hansong Yang , Yongtao Wang

LiDAR-camera fusion can enhance the performance of 3D object detection by utilizing complementary information between depth-aware LiDAR points and semantically rich images. Existing voxel-based methods face significant challenges when…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Ziying Song , Guoxin Zhang , Jun Xie , Lin Liu , Caiyan Jia , Shaoqing Xu , Zhepeng Wang

Current 3D object detection methods are heavily influenced by 2D detectors. In order to leverage architectures in 2D detectors, they often convert 3D point clouds to regular grids (i.e., to voxel grids or to bird's eye view images), or rely…

Computer Vision and Pattern Recognition · Computer Science 2019-08-26 Charles R. Qi , Or Litany , Kaiming He , Leonidas J. Guibas

3D object detection is a crucial research topic in computer vision, which usually uses 3D point clouds as input in conventional setups. Recently, there is a trend of leveraging multiple sources of input data, such as complementing the 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Yikai Wang , TengQi Ye , Lele Cao , Wenbing Huang , Fuchun Sun , Fengxiang He , Dacheng Tao

In autonomous driving, 3D object detection based on multi-modal data has become an indispensable approach when facing complex environments around the vehicle. During multi-modal detection, LiDAR and camera are simultaneously applied for…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Rui Wan , Tianyun Zhao , Wei Zhao

In this work, we study 3D object detection from RGB-D data in both indoor and outdoor scenes. While previous methods focus on images or 3D voxels, often obscuring natural 3D patterns and invariances of 3D data, we directly operate on raw…

Computer Vision and Pattern Recognition · Computer Science 2018-04-16 Charles R. Qi , Wei Liu , Chenxia Wu , Hao Su , Leonidas J. Guibas

In this work, we present a novel method for combining predictions of object detection models: weighted boxes fusion. Our algorithm utilizes confidence scores of all proposed bounding boxes to constructs the averaged boxes. We tested method…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Roman Solovyev , Weimin Wang , Tatiana Gabruseva

The perception system in autonomous vehicles is responsible for detecting and tracking the surrounding objects. This is usually done by taking advantage of several sensing modalities to increase robustness and accuracy, which makes sensor…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Ramin Nabati , Hairong Qi

3D object detection is a common function within the perception system of an autonomous vehicle and outputs a list of 3D bounding boxes around objects of interest. Various 3D object detection methods have relied on fusion of different sensor…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Eduardo Arnold , Mehrdad Dianati , Robert de Temple , Saber Fallah

3D shape recognition has attracted more and more attention as a task of 3D vision research. The proliferation of 3D data encourages various deep learning methods based on 3D data. Now there have been many deep learning models based on…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Yaxin Zhao , Jichao Jiao , Tangkun Zhang

Existing LiDAR-Camera fusion methods have achieved strong results in 3D object detection. To address the sparsity of point clouds, previous approaches typically construct spatial pseudo point clouds via depth completion as auxiliary input…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Jijun Wang , Yan Wu , Yujian Mo , Junqiao Zhao , Jun Yan , Yinghao Hu