English
Related papers

Related papers: An optimization-based IMU/Lidar/Camera Co-calibrat…

200 papers

In this work we present a novel method to jointly calibrate a sensor suite consisting a 3D-LiDAR, Inertial Measurement Unit (IMU) and Camera under an Extended Kalman Filter (EKF) framework. We exploit pairwise constraints between the 3…

Robotics · Computer Science 2022-05-19 Subodh Mishra , Srikanth Saripalli

Sensor setups consisting of a combination of 3D range scanner lasers and stereo vision systems are becoming a popular choice for on-board perception systems in vehicles; however, the combined use of both sources of information implies a…

Computer Vision and Pattern Recognition · Computer Science 2017-07-28 Carlos Guindel , Jorge Beltrán , David Martín , Fernando García

Sensor calibration is the fundamental block for a multi-sensor fusion system. This paper presents an accurate and repeatable LiDAR-IMU calibration method (termed LI-Calib), to calibrate the 6-DOF extrinsic transformation between the 3D…

Robotics · Computer Science 2020-07-30 Jiajun Lv , Jinhong Xu , Kewei Hu , Yong Liu , Xingxing Zuo

Pose estimation purely based on 3D point-cloud could suffer from degradation, e.g. scan blocks or scans in repetitive environments. To deal with this problem, we propose an approach for fusing 3D spinning LiDAR and IMU to estimate the…

Robotics · Computer Science 2017-10-20 Haoyang Ye , Ming Liu

This paper presents a tightly-coupled multi-sensor fusion algorithm termed LiDAR-inertial-camera fusion (LIC-Fusion), which efficiently fuses IMU measurements, sparse visual features, and extracted LiDAR points. In particular, the proposed…

Robotics · Computer Science 2019-11-04 Xingxing Zuo , Patrick Geneva , Woosik Lee , Yong Liu , Guoquan Huang

In this paper, we study state estimation of multi-visual-inertial systems (MVIS) and develop sensor fusion algorithms to optimally fuse an arbitrary number of asynchronous inertial measurement units (IMUs) or gyroscopes and global and(or)…

Robotics · Computer Science 2024-09-04 Yulin Yang , Patrick Geneva , Guoquan Huang

This paper presents a new method for jointly calibrating a magnetometer and inertial measurement unit (IMU), focusing on balancing calibration accuracy and computational efficiency. The proposed method is based on a maximum a posteriori…

Robotics · Computer Science 2026-04-22 Chuan Huang , Gustaf Hendeby , Isaac Skog

For an autonomous vehicle, the ability to sense its surroundings and to build an overall representation of the environment by fusing different sensor data streams is fundamental. To this end, the poses of all sensors need to be accurately…

Robotics · Computer Science 2022-11-07 Brahayam Ponton , Magda Ferri , Lars Koenig , Marcus Bartels

Sensor fusion has become a popular topic in robotics. However, conventional fusion methods encounter many difficulties, such as data representation differences, sensor variations, and extrinsic calibration. For example, the calibration…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Shuyi Zhou , Shuxiang Xie , Ryoichi Ishikawa , Ken Sakurada , Masaki Onishi , Takeshi Oishi

With the development of neural networks and the increasing popularity of automatic driving, the calibration of the LiDAR and the camera has attracted more and more attention. This calibration task is multi-modal, where the rich color and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Pengjin Wei , Guohang Yan , Yikang Li , Kun Fang , Jie Yang , Wei Liu

Multiple lidars are prevalently used on mobile vehicles for rendering a broad view to enhance the performance of localization and perception systems. However, precise calibration of multiple lidars is challenging since the feature…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Jianhao Jiao , Qinghai Liao , Yilong Zhu , Tianyu Liu , Yang Yu , Rui Fan , Lujia Wang , Ming Liu

With information from multiple input modalities, sensor fusion-based algorithms usually out-perform their single-modality counterparts in robotics. Camera and LIDAR, with complementary semantic and depth information, are the typical choices…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Akio Kodaira , Yiyang Zhou , Pengwei Zang , Wei Zhan , Masayoshi Tomizuka

This article presents an innovative study in exploring, evaluating, and implementing deep learning architectures for the calibration of multi-modal sensor systems. The focus behind this is to leverage the use of sensor fusion to achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Venkat Karramreddy , Liam Mitchell

Cameras and LiDAR are essential sensors for autonomous vehicles. The fusion of camera and LiDAR data addresses the limitations of individual sensors but relies on precise extrinsic calibration. Recently, numerous end-to-end calibration…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Ni Ou , Zhuo Chen , Xinru Zhang , Junzheng Wang

In this paper, we propose a method of targetless and automatic Camera-LiDAR calibration. Our approach is an extension of hand-eye calibration framework to 2D-3D calibration. By using the sensor fusion odometry method, the scaled camera…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Ryoichi Ishikawa , Takeshi Oishi , Katsushi Ikeuchi

Mobile robot positioning, mapping, and navigation systems generally employ an inertial measurement unit (IMU) to obtain the acceleration and angular velocity of the robot. However, errors in the internal and external parameters of an IMU…

Robotics · Computer Science 2020-05-19 Gang Peng , Zezao Lu , Zejie Tan , Dingxin He , Xinde Li

LiDAR-camera calibration is a precondition for many heterogeneous systems that fuse data from LiDAR and camera. However, the constraint from common field of view and the requirement for strict time synchronization make the calibration a…

Robotics · Computer Science 2019-07-31 Bo Fu , Yue Wang , Xiaqing Ding , Yanmei Jiao , Li Tang , Rong Xiong

This paper proposes an automated method to obtain the extrinsic calibration parameters between a camera and a 3D lidar with as low as 16 beams. We use a checkerboard as a reference to obtain features of interest in both sensor frames. The…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Surabhi Verma , Julie Stephany Berrio , Stewart Worrall , Eduardo Nebot

Sensor fusion is essential for autonomous driving and autonomous robots, and radar-camera fusion systems have gained popularity due to their complementary sensing capabilities. However, accurate calibration between these two sensors is…

Robotics · Computer Science 2024-01-26 Lei Cheng , Siyang Cao

In this paper we perform an experimental comparison of three different target based 3D-LIDAR camera calibration algorithms. We briefly elucidate the mathematical background behind each method and provide insights into practical aspects like…

Robotics · Computer Science 2020-07-07 Subodh Mishra , Philip R. Osteen , Gaurav Pandey , Srikanth Saripalli