English

Environment-Driven Online LiDAR-Camera Extrinsic Calibration

Computer Vision and Pattern Recognition 2025-11-11 v3 Artificial Intelligence Robotics

Abstract

LiDAR-camera extrinsic calibration (LCEC) is crucial for multi-modal data fusion in autonomous robotic systems. Existing methods, whether target-based or target-free, typically rely on customized calibration targets or fixed scene types, which limit their applicability in real-world scenarios. To address these challenges, we present EdO-LCEC, the first environment-driven online calibration approach. Unlike traditional target-free methods, EdO-LCEC employs a generalizable scene discriminator to estimate the feature density of the application environment. Guided by this feature density, EdO-LCEC extracts LiDAR intensity and depth features from varying perspectives to achieve higher calibration accuracy. To overcome the challenges of cross-modal feature matching between LiDAR and camera, we introduce dual-path correspondence matching (DPCM), which leverages both structural and textural consistency for reliable 3D-2D correspondences. Furthermore, we formulate the calibration process as a joint optimization problem that integrates global constraints across multiple views and scenes, thereby enhancing overall accuracy. Extensive experiments on real-world datasets demonstrate that EdO-LCEC outperforms state-of-the-art methods, particularly in scenarios involving sparse point clouds or partially overlapping sensor views.

Keywords

Cite

@article{arxiv.2502.00801,
  title  = {Environment-Driven Online LiDAR-Camera Extrinsic Calibration},
  author = {Zhiwei Huang and Jiaqi Li and Hongbo Zhao and Xiao Ma and Ping Zhong and Xiaohu Zhou and Wei Ye and Rui Fan},
  journal= {arXiv preprint arXiv:2502.00801},
  year   = {2025}
}
R2 v1 2026-06-28T21:29:33.588Z