English
Related papers

Related papers: Calibrating LiDAR and Camera using Semantic Mutual…

200 papers

LiDAR-camera extrinsic calibration (LCEC) is crucial for multi-modal data fusion in autonomous robotic systems. Existing methods, whether target-based or target-free, typically rely on customized calibration targets or fixed scene types,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Zhiwei Huang , Jiaqi Li , Hongbo Zhao , Xiao Ma , Ping Zhong , Xiaohu Zhou , Wei Ye , Rui Fan

We propose LiDAL, a novel active learning method for 3D LiDAR semantic segmentation by exploiting inter-frame uncertainty among LiDAR frames. Our core idea is that a well-trained model should generate robust results irrespective of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Zeyu Hu , Xuyang Bai , Runze Zhang , Xin Wang , Guangyuan Sun , Hongbo Fu , Chiew-Lan Tai

This paper presents a novel automatic calibration system to estimate the extrinsic parameters of LiDAR mounted on a mobile platform for sensor misalignment inspection in the large-scale production of highly automated vehicles. To obtain…

Image and Video Processing · Electrical Eng. & Systems 2020-08-25 Ji-Hwan You , Seon Taek Oh , Jae-Eun Park , Azim Eskandarian , Young-Keun Kim

Camera and LiDAR serve as informative sensors for accurate and robust autonomous driving systems. However, these sensors often exhibit heterogeneous natures, resulting in distributional modality gaps that present significant challenges for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yiran Yang , Xu Gao , Tong Wang , Xin Hao , Yifeng Shi , Xiao Tan , Xiaoqing Ye , Jingdong Wang

Mobile robotic applications need precise information about the geometric position of the individual sensors on the platform. This information is given by the extrinsic calibration parameters which define how the sensor is rotated and…

Robotics · Computer Science 2022-07-11 Philipp Glira , Christoph Weidinger , Johann Weichselbaum

Camera calibration is a crucial step in photogrammetry and 3D vision applications. This paper introduces a novel camera calibration method using a designed collimator system. Our collimator system provides a reliable and controllable…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Shunkun Liang , Banglei Guan , Zhenbao Yu , Dongcai Tan , Pengju Sun , Zibin Liu , Qifeng Yu , Yang Shang

Semantic segmentation on LiDAR imaging is increasingly gaining attention, as it can provide useful knowledge for perception systems and potential for autonomous driving. However, collecting and labeling real LiDAR data is an expensive and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Javier Montalvo , Pablo Carballeira , Álvaro García-Martín

The goal of extrinsic calibration is the alignment of sensor data to ensure an accurate representation of the surroundings and enable sensor fusion applications. From a safety perspective, sensor calibration is a key enabler of autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Ilir Tahiraj , Jeremialie Swadiryus , Felix Fent , Markus Lienkamp

Accurate extrinsic calibration of multiple LiDARs is crucial for improving the foundational performance of three-dimensional (3D) map reconstruction systems. This paper presents a novel targetless extrinsic calibration framework for…

Robotics · Computer Science 2025-07-15 Han Ye , Yuqiang Jin , Jinyuan Liu , Tao Li , Wen-An Zhang , Minglei Fu

Despite an emerging interest in MIMO radar, the utilization of its complementary strengths in combination with optical depth sensors has so far been limited to far-field applications, due to the challenges that arise from mutual sensor…

Reliable operation in inclement weather is essential to the deployment of safe autonomous vehicles (AVs). Robustness and reliability can be achieved by fusing data from the standard AV sensor suite (i.e., lidars, cameras) with weather…

Robotics · Computer Science 2021-11-18 Emmett Wise , Juraj Peršić , Christopher Grebe , Ivan Petrović , Jonathan Kelly

In the typical urban intersection scenario, both vehicles and infrastructures are equipped with visual and LiDAR sensors. By successfully integrating the data from vehicle-side and road monitoring devices, a more comprehensive and accurate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Xinyu Zhang , Yijin Xiong , Qianxin Qu , Renjie Wang , Xin Gao , Jing Liu , Shichun Guo , Jun Li

LiDAR and camera, as two different sensors, supply geometric (point clouds) and semantic (RGB images) information of 3D scenes. However, it is still challenging for existing methods to fuse data from the two cross sensors, making them…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Yiyang Shen , Rongwei Yu , Peng Wu , Haoran Xie , Lina Gong , Jing Qin , Mingqiang Wei

Camera calibration is a crucial step in photogrammetry and 3D vision applications. In practical scenarios with a long working distance to cover a wide area, target-based calibration methods become complicated and inflexible due to site…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Shunkun Liang , Banglei Guan , Zhenbao Yu , Pengju Sun , Yang Shang

In this paper, we present an extension to LaserNet, an efficient and state-of-the-art LiDAR based 3D object detector. We propose a method for fusing image data with the LiDAR data and show that this sensor fusion method improves the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Gregory P. Meyer , Jake Charland , Darshan Hegde , Ankit Laddha , Carlos Vallespi-Gonzalez

Multi-camera systems are an important sensor platform for intelligent systems such as self-driving cars. Pattern-based calibration techniques can be used to calibrate the intrinsics of the cameras individually. However, extrinsic…

Computer Vision and Pattern Recognition · Computer Science 2020-09-17 Yukai Lin , Viktor Larsson , Marcel Geppert , Zuzana Kukelova , Marc Pollefeys , Torsten Sattler

Cameras and LiDAR are essential sensors for autonomous vehicles. Camera-LiDAR data fusion compensate for deficiencies of stand-alone sensors but relies on precise extrinsic calibration. Many learning-based calibration methods predict…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Ni Ou , Zhuo Chen , Xinru Zhang , Junzheng Wang

We propose a semantic similarity metric for image registration. Existing metrics like Euclidean Distance or Normalized Cross-Correlation focus on aligning intensity values, giving difficulties with low intensity contrast or noise. Our…

Machine Learning · Computer Science 2021-04-21 Steffen Czolbe , Oswin Krause , Aasa Feragen

Conventional sensor-based localization relies on high-precision maps, which are generally built using specialized mapping techniques involving high labor and computational costs. In the architectural, engineering and construction industry,…

Robotics · Computer Science 2022-11-30 Huan Yin , Zhiyi Lin , Justin K. W. Yeoh

Efficient data utilization is crucial for advancing 3D scene understanding in autonomous driving, where reliance on heavily human-annotated LiDAR point clouds challenges fully supervised methods. Addressing this, our study extends into…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Lingdong Kong , Xiang Xu , Jiawei Ren , Wenwei Zhang , Liang Pan , Kai Chen , Wei Tsang Ooi , Ziwei Liu