English
Related papers

Related papers: Multistream Network for LiDAR and Camera-based 3D …

200 papers

LiDAR is crucial for robust 3D scene perception in autonomous driving. LiDAR perception has the largest body of literature after camera perception. However, multi-task learning across tasks like detection, segmentation, and motion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Sambit Mohapatra , Senthil Yogamani , Varun Ravi Kumar , Stefan Milz , Heinrich Gotzig , Patrick Mäder

Multi-modal 3D object detection with bird's eye view (BEV) has achieved desired advances on benchmarks. Nonetheless, the accuracy may drop significantly in the real world due to data corruption such as sensor configurations for LiDAR and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Rui Ding , Zhaonian Kuang , Yuzhe Ji , Meng Yang , Xinhu Zheng , Gang Hua

Multi-modal systems have the capacity of producing more reliable results than systems with a single modality in road detection due to perceiving different aspects of the scene. We focus on using raw sensor inputs instead of, as it is…

Robotics · Computer Science 2023-08-24 Erkan Milli , Özgür Erkent , Asım Egemen Yılmaz

3D object detection is an essential task in autonomous driving. Recent techniques excel with highly accurate detection rates, provided the 3D input data is obtained from precise but expensive LiDAR technology. Approaches based on cheaper…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Yan Wang , Wei-Lun Chao , Divyansh Garg , Bharath Hariharan , Mark Campbell , Kilian Q. Weinberger

In the field of autonomous driving, 3D object detection is a very important perception module. Although the current SOTA algorithm combines Camera and Lidar sensors, limited by the high price of Lidar, the current mainstream landing schemes…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Kai Lei , Zhan Chen , Shuman Jia , Xiaoteng Zhang

LiDAR has become a standard sensor for autonomous driving applications as they provide highly precise 3D point clouds. LiDAR is also robust for low-light scenarios at night-time or due to shadows where the performance of cameras is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Khaled El Madawy , Hazem Rashed , Ahmad El Sallab , Omar Nasr , Hanan Kamel , Senthil Yogamani

LiDAR-based 3D object detection models have traditionally struggled under rainy conditions due to the degraded and noisy scanning signals. Previous research has attempted to address this by simulating the noise from rain to improve the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Xun Huang , Hai Wu , Xin Li , Xiaoliang Fan , Chenglu Wen , Cheng Wang

Recently, fusing the LiDAR point cloud and camera image to improve the performance and robustness of 3D object detection has received more and more attention, as these two modalities naturally possess strong complementarity. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Zhe Liu , Tengteng Huang , Bingling Li , Xiwu Chen , Xi Wang , Xiang Bai

LiDAR (Light Detection and Ranging) is an advanced active remote sensing technique working on the principle of time of travel (ToT) for capturing highly accurate 3D information of the surroundings. LiDAR has gained wide attention in…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Shreelakshmi C R , Surya S. Durbha , Gaganpreet Singh

The rotation robustness property has drawn much attention to point cloud analysis, whereas it still poses a critical challenge in 3D object detection. When subjected to arbitrary rotation, most existing detectors fail to produce expected…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Zhaoxuan Wang , Xu Han , Hongxin Liu , Xianzhi Li

In the field of 3D object detection for autonomous driving, LiDAR-Camera (LC) fusion is the top-performing sensor configuration. Still, LiDAR is relatively high cost, which hinders adoption of this technology for consumer automobiles.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Lingjun Zhao , Jingyu Song , Katherine A. Skinner

This work presents a probabilistic deep neural network that combines LiDAR point clouds and RGB camera images for robust, accurate 3D object detection. We explicitly model uncertainties in the classification and regression tasks, and…

Robotics · Computer Science 2020-02-04 Di Feng , Yifan Cao , Lars Rosenbaum , Fabian Timm , Klaus Dietmayer

Single image rain streak removal is an extremely challenging problem due to the presence of non-uniform rain densities in images. We present a novel density-aware multi-stream densely connected convolutional neural network-based algorithm,…

Computer Vision and Pattern Recognition · Computer Science 2018-02-22 He Zhang , Vishal M. Patel

The combination of LiDAR and camera modalities is proven to be necessary and typical for 3D object detection according to recent studies. Existing fusion strategies tend to overly rely on the LiDAR modal in essence, which exploits the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Yang Yang , Weijie Ma , Hao Chen , Linlin Ou , Xinyi Yu

In this work, we study 3D object detection from RGB-D data in both indoor and outdoor scenes. While previous methods focus on images or 3D voxels, often obscuring natural 3D patterns and invariances of 3D data, we directly operate on raw…

Computer Vision and Pattern Recognition · Computer Science 2018-04-16 Charles R. Qi , Wei Liu , Chenxia Wu , Hao Su , Leonidas J. Guibas

Detecting objects in 3D LiDAR data is a core technology for autonomous driving and other robotics applications. Although LiDAR data is acquired over time, most of the 3D object detection algorithms propose object bounding boxes…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Rui Huang , Wanyue Zhang , Abhijit Kundu , Caroline Pantofaru , David A Ross , Thomas Funkhouser , Alireza Fathi

3D single object tracking with LiDAR points is an important task in the computer vision field. Previous methods usually adopt the matching-based or motion-centric paradigms to estimate the current target status. However, the former is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zhiheng Li , Yu Lin , Yubo Cui , Shuo Li , Zheng Fang

Large driving datasets are a key component in the current development and safeguarding of automated driving functions. Various methods can be used to collect such driving data records. In addition to the use of sensor equipped research…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Laurent Kloeker , Christian Geller , Amarin Kloeker , Lutz Eckstein

Fusing data from cameras and LiDAR sensors is an essential technique to achieve robust 3D object detection. One key challenge in camera-LiDAR fusion involves mitigating the large domain gap between the two sensors in terms of coordinates…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Yecheol Kim , Konyul Park , Minwook Kim , Dongsuk Kum , Jun Won Choi

In this paper, we present an extension to LaserNet, an efficient and state-of-the-art LiDAR based 3D object detector. We propose a method for fusing image data with the LiDAR data and show that this sensor fusion method improves the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Gregory P. Meyer , Jake Charland , Darshan Hegde , Ankit Laddha , Carlos Vallespi-Gonzalez