English
Related papers

Related papers: Cross-Modality 3D Object Detection

200 papers

Point cloud 3D object detection has recently received major attention and becomes an active research topic in 3D computer vision community. However, recognizing 3D objects in LiDAR (Light Detection and Ranging) is still a challenge due to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Yilin Wang , Jiayi Ye

This paper presents a new approach to 3D object detection that leverages the properties of the data obtained by a LiDAR sensor. State-of-the-art detectors use neural network architectures based on assumptions valid for camera images.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Guus Engels , Nerea Aranjuelo , Ignacio Arganda-Carreras , Marcos Nieto , Oihana Otaegui

3D detection is a critical task that enables machines to identify and locate objects in three-dimensional space. It has a broad range of applications in several fields, including autonomous driving, robotics and augmented reality. Monocular…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Aakash Kumar , Chen Chen , Ajmal Mian , Neils Lobo , Mubarak Shah

LiDAR and camera fusion techniques are promising for achieving 3D object detection in autonomous driving. Most multi-modal 3D object detection frameworks integrate semantic knowledge from 2D images into 3D LiDAR point clouds to enhance…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shaoqing Xu , Fang Li , Ziying Song , Jin Fang , Sifen Wang , Zhi-Xin Yang

The rise of autonomous vehicles has significantly increased the demand for robust 3D object detection systems. While cameras and LiDAR sensors each offer unique advantages--cameras provide rich texture information and LiDAR offers precise…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Zitian Wang , Zehao Huang , Yulu Gao , Naiyan Wang , Si Liu

3D object detection has achieved remarkable progress by taking point clouds as the only input. However, point clouds often suffer from incomplete geometric structures and the lack of semantic information, which makes detectors hard to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Hao Yang , Chen Shi , Yihong Chen , Liwei Wang

LiDAR point clouds can effectively depict the motion and posture of objects in three-dimensional space. Many studies accomplish the 3D object detection by voxelizing point clouds. However, in autonomous driving scenarios, the sparsity and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yongxin Shao , Aihong Tan , Binrui Wang , Tianhong Yan , Zhetao Sun , Yiyang Zhang , Jiaxin Liu

We propose a new method for fusing a LIDAR point cloud and camera-captured images in the deep convolutional neural network (CNN). The proposed method constructs a new layer called non-homogeneous pooling layer to transform features between…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Zining Wang , Wei Zhan , Masayoshi Tomizuka

In this paper, we propose PointRCNN for 3D object detection from raw point cloud. The whole framework is composed of two stages: stage-1 for the bottom-up 3D proposal generation and stage-2 for refining proposals in the canonical…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Shaoshuai Shi , Xiaogang Wang , Hongsheng Li

There is a trend to fuse multi-modal information for 3D object detection (3OD). However, the challenging problems of low lightweightness, poor flexibility of plug-and-play, and inaccurate alignment of features are still not well-solved,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Lipeng Gu , Xuefeng Yan , Peng Cui , Lina Gong , Haoran Xie , Fu Lee Wang , Jin Qin , Mingqiang Wei

Feature fusion and similarity computation are two core problems in 3D object tracking, especially for object tracking using sparse and disordered point clouds. Feature fusion could make similarity computing more efficient by including…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Yubo Cui , Zheng Fang , Jiayao Shan , Zuoxu Gu , Sifan Zhou

3D object detection from LiDAR point cloud is a challenging problem in 3D scene understanding and has many practical applications. In this paper, we extend our preliminary work PointRCNN to a novel and strong point-cloud-based 3D object…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Shaoshuai Shi , Zhe Wang , Jianping Shi , Xiaogang Wang , Hongsheng Li

There have been significant advances in neural networks for both 3D object detection using LiDAR and 2D object detection using video. However, it has been surprisingly difficult to train networks to effectively use both modalities in a way…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Su Pang , Daniel Morris , Hayder Radha

Fusing LiDAR and camera information is essential for achieving accurate and reliable 3D object detection in autonomous driving systems. This is challenging due to the difficulty of combining multi-granularity geometric and semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Jiao , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang

This paper aims at high-accuracy 3D object detection in autonomous driving scenario. We propose Multi-View 3D networks (MV3D), a sensory-fusion framework that takes both LIDAR point cloud and RGB images as input and predicts oriented 3D…

Computer Vision and Pattern Recognition · Computer Science 2017-06-23 Xiaozhi Chen , Huimin Ma , Ji Wan , Bo Li , Tian Xia

For 3D object detection, both camera and lidar have been demonstrated to be useful sensory devices for providing complementary information about the same scenery with data representations in different modalities, e.g., 2D RGB image vs 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Xinhao Xiang , Jiawei Zhang

This paper focuses on the construction of stronger local features and the effective fusion of image and LiDAR data. We adopt different modalities of LiDAR data to generate richer features and present an adaptive and azimuth-aware network to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Yonglin Tian , Kunfeng Wang , Yuang Wang , Yulin Tian , Zilei Wang , Fei-Yue Wang

LiDAR-camera fusion can enhance the performance of 3D object detection by utilizing complementary information between depth-aware LiDAR points and semantically rich images. Existing voxel-based methods face significant challenges when…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Ziying Song , Guoxin Zhang , Jun Xie , Lin Liu , Caiyan Jia , Shaoqing Xu , Zhepeng Wang

Object detection has been extensively utilized in autonomous systems in recent years, encompassing both 2D and 3D object detection. Recent research in this field has primarily centered around multimodal approaches for addressing this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Wendong Zhang

Occluded and long-range objects are ubiquitous and challenging for 3D object detection. Point cloud sequence data provide unique opportunities to improve such cases, as an occluded or distant object can be observed from different viewpoints…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Yingwei Li , Charles R. Qi , Yin Zhou , Chenxi Liu , Dragomir Anguelov