English
Related papers

Related papers: An Interactive LiDAR to Camera Calibration

200 papers

Accurate multi-sensor calibration is essential for deploying robust perception systems in applications such as autonomous driving and intelligent transportation. Existing LiDAR-camera calibration methods often rely on manually placed…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Lei Cheng , Lihao Guo , Tianya Zhang , Tam Bang , Austin Harris , Mustafa Hajij , Mina Sartipi , Siyang Cao

Accurate and reliable sensor calibration is critical for fusing LiDAR and inertial measurements in autonomous driving. This paper proposes a novel three-stage extrinsic calibration method between LiDAR and GNSS/INS for autonomous driving.…

Robotics · Computer Science 2023-03-01 Guohang Yan , Jiahao Pi , Chengjie Wang , Xinyu Cai , Yikang Li

Lidars and cameras are critical sensors that provide complementary information for 3D detection in autonomous driving. While prevalent multi-modal methods simply decorate raw lidar point clouds with camera features and feed them directly to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Yingwei Li , Adams Wei Yu , Tianjian Meng , Ben Caine , Jiquan Ngiam , Daiyi Peng , Junyang Shen , Bo Wu , Yifeng Lu , Denny Zhou , Quoc V. Le , Alan Yuille , Mingxing Tan

In recent years, the fusion of camera data with LiDAR measurements has emerged as a powerful approach to enhance spatial understanding. This study introduces a novel, hardware-agnostic methodology that generates colourised point clouds from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Pasindu Ranasinghe , Dibyayan Patra , Bikram Banerjee , Simit Raval

We propose an algorithm for automatic, targetless, extrinsic calibration of a LiDAR and camera system using semantic information. We achieve this goal by maximizing mutual information (MI) of semantic information between sensors, leveraging…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Peng Jiang , Philip Osteen , Srikanth Saripalli

This paper presents a novel indoor layout estimation system based on the fusion of 2D LiDAR and intensity camera data. A ground robot explores an indoor space with a single floor and vertical walls, and collects a sequence of intensity…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Jieyu Li , Robert Stevenson

For an autonomous vehicle, the ability to sense its surroundings and to build an overall representation of the environment by fusing different sensor data streams is fundamental. To this end, the poses of all sensors need to be accurately…

Robotics · Computer Science 2022-11-07 Brahayam Ponton , Magda Ferri , Lars Koenig , Marcus Bartels

In the typical urban intersection scenario, both vehicles and infrastructures are equipped with visual and LiDAR sensors. By successfully integrating the data from vehicle-side and road monitoring devices, a more comprehensive and accurate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Xinyu Zhang , Yijin Xiong , Qianxin Qu , Renjie Wang , Xin Gao , Jing Liu , Shichun Guo , Jun Li

Sensor fusion has become a popular topic in robotics. However, conventional fusion methods encounter many difficulties, such as data representation differences, sensor variations, and extrinsic calibration. For example, the calibration…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Shuyi Zhou , Shuxiang Xie , Ryoichi Ishikawa , Ken Sakurada , Masaki Onishi , Takeshi Oishi

An automated vehicle operating in an urban environment must be able to perceive and recognise object/obstacles in a three-dimensional world while navigating in a constantly changing environment. In order to plan and execute accurate…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Julie Stephany Berrio , Mao Shan , Stewart Worrall , Eduardo Nebot

4D radar has emerged as a critical sensor for autonomous driving, primarily due to its enhanced capabilities in elevation measurement and higher resolution compared to traditional 3D radar. Effective integration of 4D radar with cameras…

Accurate camera-LiDAR calibration is a prerequisite for robust multi-modal perception in robotics. Recent target-less approaches based on deep point correspondences achieve remarkable performance for extrinsic calibration but assume…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Simon Bultmann , Daniele Cattaneo , Abhinav Valada

Depth cameras, typically in RGB-D configurations, are common devices in mobile robotic platforms given their appealing features: high frequency and resolution, low price and power requirements, among others. These sensors may come with…

Robotics · Computer Science 2019-07-04 David Zuñiga-Noël , Jose-Raul Ruiz-Sarmiento , Javier Gonzalez-Jimenez

Precise LiDAR-camera calibration is crucial for integrating these two sensors into robotic systems to achieve robust perception. In applications like autonomous driving, online targetless calibration enables a prompt sensor misalignment…

Robotics · Computer Science 2025-08-12 Shu Han , Xubo Zhu , Ji Wu , Ximeng Cai , Wen Yang , Huai Yu , Gui-Song Xia

Extrinsic Calibration represents the cornerstone of autonomous driving. Its accuracy plays a crucial role in the perception pipeline, as any errors can have implications for the safety of the vehicle. Modern sensor systems collect different…

Robotics · Computer Science 2025-11-25 Lorenzo Gentilini , Pierpaolo Serio , Valentina Donzella , Lorenzo Pollini

Sensor fusion is essential for autonomous driving and autonomous robots, and radar-camera fusion systems have gained popularity due to their complementary sensing capabilities. However, accurate calibration between these two sensors is…

Robotics · Computer Science 2024-01-26 Lei Cheng , Siyang Cao

Object detection and global localization play a crucial role in robotics, spanning across a great spectrum of applications from autonomous cars to multi-layered 3D Scene Graphs for semantic scene understanding. This article proposes BOX3D,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Mario A. V. Saucedo , Nikolaos Stathoulopoulos , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos

Camera-based perception systems play a central role in modern autonomous vehicles. These camera based perception algorithms require an accurate calibration to map the real world distances to image pixels. In practice, calibration is a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Ciarán Hogan , Ganesh Sistu , Ciarán Eising

LiDAR and camera are two important sensors for 3D object detection in autonomous driving. Despite the increasing popularity of sensor fusion in this field, the robustness against inferior image conditions, e.g., bad illumination and sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xuyang Bai , Zeyu Hu , Xinge Zhu , Qingqiu Huang , Yilun Chen , Hongbo Fu , Chiew-Lan Tai

Current traditional methods for LiDAR-camera extrinsics estimation depend on offline targets and human efforts, while learning-based approaches resort to iterative refinement for calibration results, posing constraints on their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shuang Xu , Sifan Zhou , Zhi Tian , Jizhou Ma , Qiong Nie , Xiangxiang Chu