English
Related papers

Related papers: CFNet: LiDAR-Camera Registration Using Calibration…

200 papers

This work proposes a novel motion guided method for target-less self-calibration of a LiDAR and camera and use the re-projection of LiDAR points onto the image reference frame for real-time depth upsampling. The calibration parameters are…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Juan Castorena , Gint Puskorius , Gaurav Pandey

Camera calibration is a crucial technique which significantly influences the performance of many robotic systems. Robustness and high precision have always been the pursuit of diverse calibration methods. State-of-the-art calibration…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Yesheng Zhang , Xu Zhao , Dahong Qian

With information from multiple input modalities, sensor fusion-based algorithms usually out-perform their single-modality counterparts in robotics. Camera and LIDAR, with complementary semantic and depth information, are the typical choices…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Akio Kodaira , Yiyang Zhou , Pengwei Zang , Wei Zhan , Masayoshi Tomizuka

In this paper we present CMRNet, a realtime approach based on a Convolutional Neural Network to localize an RGB image of a scene in a map built from LiDAR data. Our network is not trained in the working area, i.e. CMRNet does not learn the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Daniele Cattaneo , Matteo Vaghi , Augusto Luis Ballardini , Simone Fontana , Domenico Giorgio Sorrenti , Wolfram Burgard

We present an approach for estimating the pose of an external camera with respect to a robot using a single RGB image of the robot. The image is processed by a deep neural network to detect 2D projections of keypoints (such as joints)…

This paper presents a novel indoor layout estimation system based on the fusion of 2D LiDAR and intensity camera data. A ground robot explores an indoor space with a single floor and vertical walls, and collects a sequence of intensity…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Jieyu Li , Robert Stevenson

This paper proposes SemCal: an automatic, targetless, extrinsic calibration algorithm for a LiDAR and camera system using semantic information. We leverage a neural information estimator to estimate the mutual information (MI) of semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Peng Jiang , Philip Osteen , Srikanth Saripalli

The primary requirement for cross-modal data fusion is the precise alignment of data from different sensors. However, the calibration between LiDAR point clouds and camera images is typically time-consuming and needs external calibration…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Yuanchao Yue , Hui Yuan , Zhengxin Li , Shuai Li , Wei Zhang

In view of contemporary panoramic camera-laser scanner system, the traditional calibration method is not suitable for panoramic cameras whose imaging model is extremely nonlinear. The method based on statistical optimization has the…

Computer Vision and Pattern Recognition · Computer Science 2017-09-14 Mingwei Cao , Ming Yang , Chunxiang Wang , Yeqiang Qian , Bing Wang

This paper presents a framework for the targetless extrinsic calibration of stereo cameras and Light Detection and Ranging (LiDAR) sensors with a non-overlapping Field of View (FOV). In order to solve the extrinsic calibrations problem…

Robotics · Computer Science 2019-03-07 Jinyong Jeong , Lucas Y. Cho , Ayoung Kim

We propose a generic event camera calibration framework using image reconstruction. Instead of relying on blinking LED patterns or external screens, we show that neural-network-based image reconstruction is well suited for the task of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-27 Manasi Muglikar , Mathias Gehrig , Daniel Gehrig , Davide Scaramuzza

Accurate and reliable sensor calibration is essential to fuse LiDAR and inertial measurements, which are usually available in robotic applications. In this paper, we propose a novel LiDAR-IMU calibration method within the continuous-time…

Robotics · Computer Science 2022-05-09 Jiajun Lv , Xingxing Zuo , Kewei Hu , Jinhong Xu , Guoquan Huang , Yong Liu

In this paper, we study the problem of jointly estimating the optical flow and scene flow from synchronized 2D and 3D data. Previous methods either employ a complex pipeline that splits the joint task into independent stages, or fuse 2D and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Haisong Liu , Tao Lu , Yihui Xu , Jia Liu , Limin Wang

While camera and LiDAR are widely used in most of the assisted and autonomous driving systems, only a few works have been proposed to associate the temporal synchronization and extrinsic calibration for camera and LiDAR which are dedicated…

Robotics · Computer Science 2022-07-22 Shouan Wang , Xinyu Zhang , GuiPeng Zhang , Yijin Xiong , Ganglin Tian , Shichun Guo , Jun Li

This paper presents MFCalib, an innovative extrinsic calibration technique for LiDAR and RGB camera that operates automatically in targetless environments with a single data capture. At the heart of this method is using a rich set of edge…

Robotics · Computer Science 2024-09-04 Tianyong Ye , Wei Xu , Chunran Zheng , Yukang Cui

An accurate and robust large-scale localization system is an integral component for active areas of research such as autonomous vehicles and augmented reality. To this end, many learning algorithms have been proposed that predict 6DOF…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Ali Raza , Lazar Lolic , Shahmir Akhter , Alfonso Dela Cruz , Michael Liut

This work proposes a method for depth completion of sparse LiDAR data using a convolutional neural network which can be used to generate semi-dense depth maps and "almost" full 3D point-clouds with significantly lower root mean squared…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Hamid Hekmatian , Jingfu Jin , Samir Al-Stouhi

Monocular camera sensors are vital to intelligent vehicle operation and automated driving assistance and are also heavily employed in traffic control infrastructure. Calibrating the monocular camera, though, is time-consuming and often…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Alexander Tsaregorodtsev , Johannes Müller , Jan Strohbeck , Martin Herrmann , Michael Buchholz , Vasileios Belagiannis

Accurate sensor calibration is crucial for autonomous systems, yet its uncertainty quantification remains underexplored. We present the first approach to integrate uncertainty awareness into online extrinsic calibration, combining Monte…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Mathieu Cocheteux , Julien Moreau , Franck Davoine

Modern autonomous systems typically use several sensors for perception. For best performance, accurate and reliable extrinsic calibration is necessary. In this research, we propose a reliable technique for the extrinsic calibration of…

Robotics · Computer Science 2023-09-14 Sandipan Das , Bengt Boberg , Maurice Fallon , Saikat Chatterjee