English
Related papers

Related papers: Multistream Network for LiDAR and Camera-based 3D …

200 papers

In this paper, we propose the LiDAR Distillation to bridge the domain gap induced by different LiDAR beams for 3D object detection. In many real-world applications, the LiDAR points used by mass-produced robots and vehicles usually have…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Yi Wei , Zibu Wei , Yongming Rao , Jiaxin Li , Jie Zhou , Jiwen Lu

While 2D object detection has improved significantly over the past, real world applications of computer vision often require an understanding of the 3D layout of a scene. Many recent approaches to 3D detection use LiDAR point clouds for…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Jihao Andreas Lin , Jakob Brünker , Daniel Fährmann

Multi-object tracking (MOT) has important applications in monitoring, logistics, and other fields. This paper develops a real-time multi-object tracking and prediction system in rugged environments. A 3D object detection algorithm based on…

Robotics · Computer Science 2023-08-24 Shixing Huang , Zhihao Wang , Junyuan Ouyang , Haoyao Chen

Multimodal sensor fusion methods for 3D object detection have been revolutionizing the autonomous driving research field. Nevertheless, most of these methods heavily rely on dense LiDAR data and accurately calibrated sensors which is often…

Robotics · Computer Science 2023-06-14 Maciej K. Wozniak , Viktor Karefjards , Marko Thiel , Patric Jensfelt

Accurate and robust LiDAR 3D object detection is essential for comprehensive scene understanding in autonomous driving. Despite its importance, LiDAR detection performance is limited by inherent constraints of point cloud data, particularly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Rui Yu , Runkai Zhao , Cong Nie , Heng Wang , HuaiCheng Yan , Meng Wang

More and more research works fuse the LiDAR and camera information to improve the 3D object detection of the autonomous driving system. Recently, a simple yet effective fusion framework has achieved an excellent detection performance,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Yun Zhao , Zhan Gong , Peiru Zheng , Hong Zhu , Shaohua Wu

2D RGB images and 3D LIDAR point clouds provide complementary knowledge for the perception system of autonomous vehicles. Several 2D and 3D fusion methods have been explored for the LIDAR semantic segmentation task, but they suffer from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Jun Cen , Shiwei Zhang , Yixuan Pei , Kun Li , Hang Zheng , Maochun Luo , Yingya Zhang , Qifeng Chen

Multi-sensor fusion using LiDAR and RGB cameras significantly enhances 3D object detection task. However, conventional LiDAR sensors perform dense, stateless scans, ignoring the strong temporal continuity in real-world scenes. This leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Sara Shoouri , Morteza Tavakoli Taba , Hun-Seok Kim

LiDAR and camera fusion techniques are promising for achieving 3D object detection in autonomous driving. Most multi-modal 3D object detection frameworks integrate semantic knowledge from 2D images into 3D LiDAR point clouds to enhance…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shaoqing Xu , Fang Li , Ziying Song , Jin Fang , Sifen Wang , Zhi-Xin Yang

Multi-modal 3D object detection models for automated driving have demonstrated exceptional performance on computer vision benchmarks like nuScenes. However, their reliance on densely sampled LiDAR point clouds and meticulously calibrated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Till Beemelmanns , Quan Zhang , Christian Geller , Lutz Eckstein

Many LiDAR-based methods for detecting large objects, single-class object detection, or under easy situations were claimed to perform quite well. However, their performances of detecting small objects or under hard situations did not…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Chia-Hung Wang , Hsueh-Wei Chen , Li-Chen Fu

3D object detection has become an emerging task in autonomous driving scenarios. Previous works process 3D point clouds using either projection-based or voxel-based models. However, both approaches contain some drawbacks. The voxel-based…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Qingdong He , Zhengning Wang , Hao Zeng , Yijun Liu , Shuaicheng Liu , Bing Zeng

3D object detection using LiDAR-based point cloud data and deep neural networks is essential in autonomous driving technology. However, deploying state-of-the-art models on edge devices present challenges due to high computational demands…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-13 Taisuke Noguchi , Takayuki Nishio , Takuya Azumi

Accurate multi-view 3D object detection is essential for applications such as autonomous driving. Researchers have consistently aimed to leverage LiDAR's precise spatial information to enhance camera-based detectors through methods like…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Shaoqing Xu , Fang Li , Peixiang Huang , Ziying Song , Zhi-Xin Yang

We propose a new method for fusing a LIDAR point cloud and camera-captured images in the deep convolutional neural network (CNN). The proposed method constructs a new layer called non-homogeneous pooling layer to transform features between…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Zining Wang , Wei Zhan , Masayoshi Tomizuka

Multi-view camera-based 3D object detection has become popular due to its low cost, but accurately inferring 3D geometry solely from camera data remains challenging and may lead to inferior performance. Although distilling precise 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Haimei Zhao , Qiming Zhang , Shanshan Zhao , Zhe Chen , Jing Zhang , Dacheng Tao

With the rapid proliferation of autonomous driving, there has been a heightened focus on the research of lidar-based 3D semantic segmentation and object detection methodologies, aiming to ensure the safety of traffic participants. In recent…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Jiahua Xu , Si Zuo , Chenfeng Wei , Wei Zhou

We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different view…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Sudeep Fadadu , Shreyash Pandey , Darshan Hegde , Yi Shi , Fang-Chieh Chou , Nemanja Djuric , Carlos Vallespi-Gonzalez

There are two critical sensors for 3D perception in autonomous driving, the camera and the LiDAR. The camera provides rich semantic information such as color, texture, and the LiDAR reflects the 3D shape and locations of surrounding…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Kaicheng Yu , Tang Tao , Hongwei Xie , Zhiwei Lin , Zhongwei Wu , Zhongyu Xia , Tingting Liang , Haiyang Sun , Jiong Deng , Dayang Hao , Yongtao Wang , Xiaodan Liang , Bing Wang

Promising complementarity exists between the texture features of color images and the geometric information of LiDAR point clouds. However, there still present many challenges for efficient and robust feature fusion in the field of 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Chaokang Jiang , Guangming Wang , Jinxing Wu , Yanzi Miao , Hesheng Wang