English
Related papers

Related papers: End-to-End Lidar-Camera Self-Calibration for Auton…

200 papers

The research on extrinsic calibration between Light Detection and Ranging(LiDAR) and camera are being promoted to a more accurate, automatic and generic manner. Since deep learning has been employed in calibration, the restrictions on the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Zhaotong Luo , Guohang Yan , Yikang Li

The integration of multiple cameras and 3D Li- DARs has become basic configuration of augmented reality devices, robotics, and autonomous vehicles. The calibration of multi-modal sensors is crucial for a system to properly function, but it…

Robotics · Computer Science 2021-07-13 Chuan Fang , Shuai Ding , Zilong Dong , Honghua Li , Siyu Zhu , Ping Tan

Multiple lidars are prevalently used on mobile vehicles for rendering a broad view to enhance the performance of localization and perception systems. However, precise calibration of multiple lidars is challenging since the feature…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Jianhao Jiao , Qinghai Liao , Yilong Zhu , Tianyu Liu , Yang Yu , Rui Fan , Lujia Wang , Ming Liu

The core task of any autonomous driving system is to transform sensory inputs into driving commands. In end-to-end driving, this is achieved via a neural network, with one or multiple cameras as the most commonly used input and low-level…

Artificial Intelligence · Computer Science 2022-07-01 Ardi Tampuu , Romet Aidla , Jan Are van Gent , Tambet Matiisen

Camera calibration involves estimating camera parameters to infer geometric features from captured sequences, which is crucial for computer vision and robotics. However, conventional calibration is laborious and requires dedicated…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Kang Liao , Lang Nie , Shujuan Huang , Chunyu Lin , Jing Zhang , Yao Zhao , Moncef Gabbouj , Dacheng Tao

Sensor setups consisting of a combination of 3D range scanner lasers and stereo vision systems are becoming a popular choice for on-board perception systems in vehicles; however, the combined use of both sources of information implies a…

Computer Vision and Pattern Recognition · Computer Science 2017-07-28 Carlos Guindel , Jorge Beltrán , David Martín , Fernando García

LiDAR-camera fusion is one of the core processes for the perception system of current automated driving systems. The typical sensor fusion process includes a list of coordinate transformation operations following system calibration.…

Robotics · Computer Science 2023-11-09 Dan Shen , Zhengming Zhang , Renran Tian , Yaobin Chen , Rini Sherony

This paper presents a groundbreaking approach - the first online automatic geometric calibration method for radar and camera systems. Given the significant data sparsity and measurement uncertainty in radar height data, achieving automatic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Van-Tin Luu , Yon-Lin Cai , Vu-Hoang Tran , Wei-Chen Chiu , Yi-Ting Chen , Ching-Chun Huang

Self-driving vehicles (SDVs) require accurate calibration of LiDARs and cameras to fuse sensor data accurately for autonomy. Traditional calibration methods typically leverage fiducials captured in a controlled and structured scene and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Ze Yang , George Chen , Haowei Zhang , Kevin Ta , Ioan Andrei Bârsan , Daniel Murphy , Sivabalan Manivasagam , Raquel Urtasun

Advances in autonomous driving are inseparable from sensor fusion. Heterogeneous sensors are widely used for sensor fusion due to their complementary properties, with radar and camera being the most equipped sensors. Intrinsic and extrinsic…

Robotics · Computer Science 2023-07-31 Lei Cheng , Arindam Sengupta , Siyang Cao

Advanced autonomous systems rely on multi-sensor fusion for safer and more robust perception. To enable effective fusion, calibrating directly from natural driving scenes (i.e., target-free) with high accuracy is crucial for precise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Aditya Ranjan Dash , Ramy Battrawy , René Schuster , Didier Stricker

In this paper we perform an experimental comparison of three different target based 3D-LIDAR camera calibration algorithms. We briefly elucidate the mathematical background behind each method and provide insights into practical aspects like…

Robotics · Computer Science 2020-07-07 Subodh Mishra , Philip R. Osteen , Gaurav Pandey , Srikanth Saripalli

LiDAR-camera calibration is a precondition for many heterogeneous systems that fuse data from LiDAR and camera. However, the constraint from common field of view and the requirement for strict time synchronization make the calibration a…

Robotics · Computer Science 2019-07-31 Bo Fu , Yue Wang , Xiaqing Ding , Yanmei Jiao , Li Tang , Rong Xiong

This paper proposes SemCal: an automatic, targetless, extrinsic calibration algorithm for a LiDAR and camera system using semantic information. We leverage a neural information estimator to estimate the mutual information (MI) of semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Peng Jiang , Philip Osteen , Srikanth Saripalli

Camera calibration is a necessity in various tasks including 3D reconstruction, hand-eye coordination for a robotic interaction, autonomous driving, etc. In this work we propose a novel method to predict extrinsic (baseline, pitch, and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Talha Hanif Butt , Murtaza Taj

Accurate spatiotemporal calibration is a prerequisite for multisensor fusion. However, sensors are typically asynchronous, and there is no overlap between the fields of view of cameras and LiDARs, posing challenges for intrinsic and…

Robotics · Computer Science 2025-01-07 Yuezhang Lv , Yunzhou Zhang , Chao Lu , Jiajun Zhu , Song Wu

In view of contemporary panoramic camera-laser scanner system, the traditional calibration method is not suitable for panoramic cameras whose imaging model is extremely nonlinear. The method based on statistical optimization has the…

Computer Vision and Pattern Recognition · Computer Science 2017-09-14 Mingwei Cao , Ming Yang , Chunxiang Wang , Yeqiang Qian , Bing Wang

In this letter, we present a novel method for automatic extrinsic calibration of high-resolution LiDARs and RGB cameras in targetless environments. Our approach does not require checkerboards but can achieve pixel-level accuracy by aligning…

Robotics · Computer Science 2021-06-28 Chongjian Yuan , Xiyuan Liu , Xiaoping Hong , Fu Zhang

This paper presents MFCalib, an innovative extrinsic calibration technique for LiDAR and RGB camera that operates automatically in targetless environments with a single data capture. At the heart of this method is using a rich set of edge…

Robotics · Computer Science 2024-09-04 Tianyong Ye , Wei Xu , Chunran Zheng , Yukang Cui

LiDAR-camera extrinsic calibration (LCEC) is crucial for multi-modal data fusion in autonomous robotic systems. Existing methods, whether target-based or target-free, typically rely on customized calibration targets or fixed scene types,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Zhiwei Huang , Jiaqi Li , Hongbo Zhao , Xiao Ma , Ping Zhong , Xiaohu Zhou , Wei Ye , Rui Fan