English
Related papers

Related papers: Targetless LiDAR-Camera Calibration with Neural Ga…

200 papers

The integration of multiple cameras and 3D Li- DARs has become basic configuration of augmented reality devices, robotics, and autonomous vehicles. The calibration of multi-modal sensors is crucial for a system to properly function, but it…

Robotics · Computer Science 2021-07-13 Chuan Fang , Shuai Ding , Zilong Dong , Honghua Li , Siyu Zhu , Ping Tan

Conventional single LiDAR systems are inherently constrained by their limited field of view (FoV), leading to blind spots and incomplete environmental awareness, particularly on robotic platforms with strict payload limitations. Integrating…

Robotics · Computer Science 2025-02-26 Jianping Li , Zhongyuan Liu , Xinhang Xu , Jinxin Liu , Shenghai Yuan , Fang Xu , Lihua Xie

Autonomous vehicles (AVs) fuse data from multiple sensors and sensing modalities to impart a measure of robustness when operating in adverse conditions. Radars and cameras are popular choices for use in sensor fusion; although radar…

Robotics · Computer Science 2023-12-12 Emmett Wise , Qilong Cheng , Jonathan Kelly

With the development of neural networks and the increasing popularity of automatic driving, the calibration of the LiDAR and the camera has attracted more and more attention. This calibration task is multi-modal, where the rich color and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Pengjin Wei , Guohang Yan , Yikang Li , Kun Fang , Jie Yang , Wei Liu

We propose an algorithm for automatic, targetless, extrinsic calibration of a LiDAR and camera system using semantic information. We achieve this goal by maximizing mutual information (MI) of semantic information between sensors, leveraging…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Peng Jiang , Philip Osteen , Srikanth Saripalli

Owing to the capability for reliable and all-weather long-range sensing, the fusion of LiDAR and Radar has been widely applied to autonomous vehicles for robust perception. In practical operation, well manually calibrated extrinsic…

Robotics · Computer Science 2025-03-24 Weimin Wang , Yu Du , Ting Yang , Yu Liu

Multiple LiDARs have progressively emerged on autonomous vehicles for rendering a wide field of view and dense measurements. However, the lack of precise calibration negatively affects their potential applications in localization and…

Robotics · Computer Science 2019-05-14 Jianhao Jiao , Yang Yu , Qinghai Liao , Haoyang Ye , Ming Liu

With information from multiple input modalities, sensor fusion-based algorithms usually out-perform their single-modality counterparts in robotics. Camera and LIDAR, with complementary semantic and depth information, are the typical choices…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Akio Kodaira , Yiyang Zhou , Pengwei Zang , Wei Zhan , Masayoshi Tomizuka

Determining the extrinsic parameter between multiple LiDARs and cameras is essential for autonomous robots, especially for solid-state LiDARs, where each LiDAR unit has a very small Field-of-View (FoV), and multiple units are often used…

Robotics · Computer Science 2022-09-27 Xiyuan Liu , Chongjian Yuan , Fu Zhang

This work proposes a novel motion guided method for target-less self-calibration of a LiDAR and camera and use the re-projection of LiDAR points onto the image reference frame for real-time depth upsampling. The calibration parameters are…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Juan Castorena , Gint Puskorius , Gaurav Pandey

Sensor calibration, which can be intrinsic or extrinsic, is an essential step to achieve the measurement accuracy required for modern perception and navigation systems deployed on autonomous robots. To date, intrinsic calibration models for…

Robotics · Computer Science 2021-07-29 Jiunn-Kai Huang , Chenxi Feng , Madhav Achar , Maani Ghaffari , Jessy W. Grizzle

The fusion of LiDARs and cameras has been increasingly adopted in autonomous driving for perception tasks. The performance of such fusion-based algorithms largely depends on the accuracy of sensor calibration, which is challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yuxuan Xiao , Yao Li , Chengzhen Meng , Xingchen Li , Jianmin Ji , Yanyong Zhang

Multiple lidars are prevalently used on mobile vehicles for rendering a broad view to enhance the performance of localization and perception systems. However, precise calibration of multiple lidars is challenging since the feature…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Jianhao Jiao , Qinghai Liao , Yilong Zhu , Tianyu Liu , Yang Yu , Rui Fan , Lujia Wang , Ming Liu

Mobile robotic applications need precise information about the geometric position of the individual sensors on the platform. This information is given by the extrinsic calibration parameters which define how the sensor is rotated and…

Robotics · Computer Science 2022-07-11 Philipp Glira , Christoph Weidinger , Johann Weichselbaum

We present a novel multi-modal extrinsic calibration framework designed to simultaneously estimate the relative poses between event cameras, LiDARs, and RGB cameras, with particular focus on the challenging event camera calibration. Core of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Andrea Bertogalli , Giacomo Boracchi , Luca Magri

3D LiDARs and 2D cameras are increasingly being used alongside each other in sensor rigs for perception tasks. Before these sensors can be used to gather meaningful data, however, their extrinsics (and intrinsics) need to be accurately…

Robotics · Computer Science 2019-08-06 Ganesh Iyer , R. Karnik Ram. , J. Krishna Murthy , K. Madhava Krishna

Reliable operation in inclement weather is essential to the deployment of safe autonomous vehicles (AVs). Robustness and reliability can be achieved by fusing data from the standard AV sensor suite (i.e., lidars, cameras) with weather…

Robotics · Computer Science 2021-11-18 Emmett Wise , Juraj Peršić , Christopher Grebe , Ivan Petrović , Jonathan Kelly

In this paper, we address extrinsic calibration for camera, lidar, and 4D radar sensors. Accurate extrinsic calibration of radar remains a challenge due to the sparsity of its data. We propose CLRNet, a novel, multi-modal end-to-end deep…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Marcell Kegl , Andras Palffy , Csaba Benedek , Dariu M. Gavrila

While camera and LiDAR are widely used in most of the assisted and autonomous driving systems, only a few works have been proposed to associate the temporal synchronization and extrinsic calibration for camera and LiDAR which are dedicated…

Robotics · Computer Science 2022-07-22 Shouan Wang , Xinyu Zhang , GuiPeng Zhang , Yijin Xiong , Ganglin Tian , Shichun Guo , Jun Li

Camera-LiDAR extrinsic calibration is a critical task for multi-sensor fusion in autonomous systems, such as self-driving vehicles and mobile robots. Traditional techniques often require manual intervention or specific environments, making…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Mathieu Cocheteux , Julien Moreau , Franck Davoine