English
Related papers

Related papers: ImLiDAR: Cross-Sensor Dynamic Message Propagation …

200 papers

In complex environments, autonomous robot navigation and environmental perception pose higher requirements for SLAM technology. This paper presents a novel method for semantically enhancing 3D point cloud maps with thermal information. By…

Robotics · Computer Science 2026-01-15 Jiajun Sun , Yangyi Ou , Haoyuan Zheng , Chao yang , Yue Ma

In this paper, we propose a new deep architecture for fusing camera and LiDAR sensors for 3D object detection. Because the camera and LiDAR sensor signals have different characteristics and distributions, fusing these two modalities is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Jin Hyeok Yoo , Yecheol Kim , Jisong Kim , Jun Won Choi

LiDAR has become a standard sensor for autonomous driving applications as they provide highly precise 3D point clouds. LiDAR is also robust for low-light scenarios at night-time or due to shadows where the performance of cameras is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Khaled El Madawy , Hazem Rashed , Ahmad El Sallab , Omar Nasr , Hanan Kamel , Senthil Yogamani

This paper presents a novel framework for robust 3D object detection from point clouds via cross-modal hallucination. Our proposed approach is agnostic to either hallucination direction between LiDAR and 4D radar. We introduce multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Jianning Deng , Gabriel Chan , Hantao Zhong , Chris Xiaoxuan Lu

Although LiDAR sensors are crucial for autonomous systems due to providing precise depth information, they struggle with capturing fine object details, especially at a distance, due to sparse and non-uniform data. Recent advances introduced…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Tiago Cortinhal , Idriss Gouigah , Eren Erdal Aksoy

The combination of LiDAR and camera modalities is proven to be necessary and typical for 3D object detection according to recent studies. Existing fusion strategies tend to overly rely on the LiDAR modal in essence, which exploits the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Yang Yang , Weijie Ma , Hao Chen , Linlin Ou , Xinyi Yu

Camera and LiDAR serve as informative sensors for accurate and robust autonomous driving systems. However, these sensors often exhibit heterogeneous natures, resulting in distributional modality gaps that present significant challenges for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yiran Yang , Xu Gao , Tong Wang , Xin Hao , Yifeng Shi , Xiao Tan , Xiaoqing Ye , Jingdong Wang

We propose DeepFusion, a modular multi-modal architecture to fuse lidars, cameras and radars in different combinations for 3D object detection. Specialized feature extractors take advantage of each modality and can be exchanged easily,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Florian Drews , Di Feng , Florian Faion , Lars Rosenbaum , Michael Ulrich , Claudius Gläser

This paper presents a new approach to 3D object detection that leverages the properties of the data obtained by a LiDAR sensor. State-of-the-art detectors use neural network architectures based on assumptions valid for camera images.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Guus Engels , Nerea Aranjuelo , Ignacio Arganda-Carreras , Marcos Nieto , Oihana Otaegui

LiDAR sensors can be used to obtain a wide range of measurement signals other than a simple 3D point cloud, and those signals can be leveraged to improve perception tasks like 3D object detection. A single laser pulse can be partially…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Yunze Man , Xinshuo Weng , Prasanna Kumar Sivakuma , Matthew O'Toole , Kris Kitani

The worldwide commercialization of fifth generation (5G) wireless networks and the exciting possibilities offered by connected and autonomous vehicles (CAVs) are pushing toward the deployment of heterogeneous sensors for tracking dynamic…

Image and Video Processing · Electrical Eng. & Systems 2022-02-03 Francesco Nardo , Davide Peressoni , Paolo Testolina , Marco Giordani , Andrea Zanella

Point cloud segmentation is a fundamental task in 3D scene understanding. Its progress is constrained by the high cost and time required for dense 3D annotations, making labeled samples difficult to obtain. Beyond annotation scarcity,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Thenukan Pathmanathan , Kanchan Keisham , Thangarajah Akilan

Three-dimensional Object Detection from multi-view cameras and LiDAR is a crucial component for autonomous driving and smart transportation. However, in the process of basic feature extraction, perspective transformation, and feature…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhongyu Xia , Hansong Yang , Yongtao Wang

This paper presents a novel indoor layout estimation system based on the fusion of 2D LiDAR and intensity camera data. A ground robot explores an indoor space with a single floor and vertical walls, and collects a sequence of intensity…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Jieyu Li , Robert Stevenson

2D RGB images and 3D LIDAR point clouds provide complementary knowledge for the perception system of autonomous vehicles. Several 2D and 3D fusion methods have been explored for the LIDAR semantic segmentation task, but they suffer from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Jun Cen , Shiwei Zhang , Yixuan Pei , Kun Li , Hang Zheng , Maochun Luo , Yingya Zhang , Qifeng Chen

In this paper, we focus on exploring the fusion of images and point clouds for 3D object detection in view of the complementary nature of the two modalities, i.e., images possess more semantic information while point clouds specialize in…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Ming Zhu , Chao Ma , Pan Ji , Xiaokang Yang

Object segmentation in three-dimensional (3-D) point clouds is a critical task for robots capable of 3-D perception. Despite the impressive performance of deep learning-based approaches on object segmentation in 2-D images, deep learning…

Image and Video Processing · Electrical Eng. & Systems 2019-10-31 Brian H. Wang , Wei-Lun Chao , Yan Wang , Bharath Hariharan , Kilian Q. Weinberger , Mark Campbell

LiDAR datasets for autonomous driving exhibit biases in properties such as point cloud density, range, and object dimensions. As a result, object detection networks trained and evaluated in different environments often experience…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Deepti Hegde , Suhas Lohit , Kuan-Chuan Peng , Michael J. Jones , Vishal M. Patel

Stereo-LiDAR fusion is a promising task in that we can utilize two different types of 3D perceptions for practical usage -- dense 3D information (stereo cameras) and highly-accurate sparse point clouds (LiDAR). However, due to their…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Jaesung Choe , Kyungdon Joo , Tooba Imtiaz , In So Kweon

3D detection is a critical task that enables machines to identify and locate objects in three-dimensional space. It has a broad range of applications in several fields, including autonomous driving, robotics and augmented reality. Monocular…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Aakash Kumar , Chen Chen , Ajmal Mian , Neils Lobo , Mubarak Shah