English
Related papers

Related papers: What Really Matters for Learning-based LiDAR-Camer…

200 papers

Accurate extrinsic calibration of multiple LiDARs is crucial for improving the foundational performance of three-dimensional (3D) map reconstruction systems. This paper presents a novel targetless extrinsic calibration framework for…

Robotics · Computer Science 2025-07-15 Han Ye , Yuqiang Jin , Jinyuan Liu , Tao Li , Wen-An Zhang , Minglei Fu

The homogeneous transformation between a LiDAR and monocular camera is required for sensor fusion tasks, such as SLAM. While determining such a transformation is not considered glamorous in any sense of the word, it is nonetheless crucial…

Robotics · Computer Science 2020-07-30 Jiunn-Kai Huang , Jessy W. Grizzle

In this paper, we propose a method of targetless and automatic Camera-LiDAR calibration. Our approach is an extension of hand-eye calibration framework to 2D-3D calibration. By using the sensor fusion odometry method, the scaled camera…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Ryoichi Ishikawa , Takeshi Oishi , Katsushi Ikeuchi

Accurate estimation of predictive uncertainty (model calibration) is essential for the safe application of neural networks. Many instances of miscalibration in modern neural networks have been reported, suggesting a trend that newer, more…

Machine Learning · Computer Science 2021-10-27 Matthias Minderer , Josip Djolonga , Rob Romijnders , Frances Hubis , Xiaohua Zhai , Neil Houlsby , Dustin Tran , Mario Lucic

The combination of LiDARs and cameras enables a mobile robot to perceive environments with multi-modal data, becoming a key factor in achieving robust perception. Traditional frame cameras are sensitive to changing illumination conditions,…

Robotics · Computer Science 2023-03-20 Jianhao Jiao , Feiyi Chen , Hexiang Wei , Jin Wu , Ming Liu

Camera-based perception systems play a central role in modern autonomous vehicles. These camera based perception algorithms require an accurate calibration to map the real world distances to image pixels. In practice, calibration is a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Ciarán Hogan , Ganesh Sistu , Ciarán Eising

This paper introduces a novel self-supervised learning framework for enhancing 3D perception in autonomous driving scenes. Specifically, our approach, namely NCLR, focuses on 2D-3D neural calibration, a novel pretext task that estimates the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Yifan Zhang , Junhui Hou , Siyu Ren , Jinjian Wu , Yixuan Yuan , Guangming Shi

In a multi-sensor fusion system composed of cameras and LiDAR, precise extrinsic calibration contributes to the system's long-term stability and accurate perception of the environment. However, methods based on extracting and registering…

Robotics · Computer Science 2024-07-29 Tianle Zeng , Dengke He , Feifan Yan , Meixi He

Accurate extrinsic calibration of LiDAR, RADAR, and camera sensors is essential for reliable perception in autonomous vehicles. Still, it remains challenging due to factors such as mechanical vibrations and cumulative sensor drift in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Hafeez Husain Cholakkal , Stefano Arrigoni , Francesco Braghin

Multiple lidars are prevalently used on mobile vehicles for rendering a broad view to enhance the performance of localization and perception systems. However, precise calibration of multiple lidars is challenging since the feature…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Jianhao Jiao , Qinghai Liao , Yilong Zhu , Tianyu Liu , Yang Yu , Rui Fan , Lujia Wang , Ming Liu

Camera calibration is the foundation of 3D vision. Generic camera calibration can yield more accurate results than parametric cam era calibration. However, calibrating a generic camera model using printed calibration boards requires far…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Zezhun Shi

LiDAR sensors are often considered essential for autonomous driving, but high-resolution sensors remain expensive while affordable low-resolution sensors produce sparse point clouds that miss critical details. LiDAR super-resolution…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 June Moh Goo , Zichao Zeng , Jan Boehm

LiDAR mapping is important yet challenging in self-driving and mobile robotics. To tackle such a global point cloud registration problem, DeepMapping converts the complex map estimation into a self-supervised training of simple deep…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Chao Chen , Xinhao Liu , Yiming Li , Li Ding , Chen Feng

The research on extrinsic calibration between Light Detection and Ranging(LiDAR) and camera are being promoted to a more accurate, automatic and generic manner. Since deep learning has been employed in calibration, the restrictions on the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Zhaotong Luo , Guohang Yan , Yikang Li

Camera calibration is integral to robotics and computer vision algorithms that seek to infer geometric properties of the scene from visual input streams. In practice, calibration is a laborious procedure requiring specialized data…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Jiading Fang , Igor Vasiljevic , Vitor Guizilini , Rares Ambrus , Greg Shakhnarovich , Adrien Gaidon , Matthew R. Walter

Robust road segmentation in all road conditions is required for safe autonomous driving and advanced driver assistance systems. Supervised deep learning methods provide accurate road segmentation in the domain of their training data but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Eerik Alamikkotervo , Henrik Toikka , Kari Tammi , Risto Ojala

For a number of tasks, such as 3D reconstruction, robotic interface, autonomous driving, etc., camera calibration is essential. In this study, we present a unique method for predicting intrinsic (principal point offset and focal length) and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Talha Hanif Butt , Murtaza Taj

LiDAR and camera are two important sensors for 3D object detection in autonomous driving. Despite the increasing popularity of sensor fusion in this field, the robustness against inferior image conditions, e.g., bad illumination and sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xuyang Bai , Zeyu Hu , Xinge Zhu , Qingqiu Huang , Yilun Chen , Hongbo Fu , Chiew-Lan Tai

Sensor calibration, which can be intrinsic or extrinsic, is an essential step to achieve the measurement accuracy required for modern perception and navigation systems deployed on autonomous robots. To date, intrinsic calibration models for…

Robotics · Computer Science 2021-07-29 Jiunn-Kai Huang , Chenxi Feng , Madhav Achar , Maani Ghaffari , Jessy W. Grizzle

In many fields of robotics, knowing the relative position and orientation between two sensors is a mandatory precondition to operate with multiple sensing modalities. In this context, the pair LiDAR-RGB cameras offer complementary features:…