English
Related papers

Related papers: What Really Matters for Learning-based LiDAR-Camer…

200 papers

With the development of neural networks and the increasing popularity of automatic driving, the calibration of the LiDAR and the camera has attracted more and more attention. This calibration task is multi-modal, where the rich color and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Pengjin Wei , Guohang Yan , Yikang Li , Kun Fang , Jie Yang , Wei Liu

For an autonomous vehicle, the ability to sense its surroundings and to build an overall representation of the environment by fusing different sensor data streams is fundamental. To this end, the poses of all sensors need to be accurately…

Robotics · Computer Science 2022-11-07 Brahayam Ponton , Magda Ferri , Lars Koenig , Marcus Bartels

Accurate camera-LiDAR fusion relies on precise extrinsic calibration, which fundamentally depends on establishing reliable cross-modal correspondences under potentially large misalignments. Existing learning-based methods typically project…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Ni Ou , Zhuo Chen , Xinru Zhang , Junzheng Wang

LiDAR-camera extrinsic calibration (LCEC) is crucial for multi-modal data fusion in autonomous robotic systems. Existing methods, whether target-based or target-free, typically rely on customized calibration targets or fixed scene types,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Zhiwei Huang , Jiaqi Li , Hongbo Zhao , Xiao Ma , Ping Zhong , Xiaohu Zhou , Wei Ye , Rui Fan

With the advent of autonomous vehicles, LiDAR and cameras have become an indispensable combination of sensors. They both provide rich and complementary data which can be used by various algorithms and machine learning to sense and make…

Robotics · Computer Science 2017-05-30 Ankit Dhall , Kunal Chelani , Vishnu Radhakrishnan , K. M. Krishna

Fusing data from LiDAR and camera is conceptually attractive because of their complementary properties. For instance, camera images are higher resolution and have colors, while LiDAR data provide more accurate range measurements and have a…

Robotics · Computer Science 2019-07-02 Weikun Zhen , Yaoyu Hu , Jingfeng Liu , Sebastian Scherer

LiDAR-camera systems have become increasingly popular in robotics recently. A critical and initial step in integrating the LiDAR and camera data is the calibration of the LiDAR-camera system. Most existing calibration methods rely on…

Robotics · Computer Science 2025-04-02 Shuyi Zhou , Shuxiang Xie , Ryoichi Ishikawa , Takeshi Oishi

Most current single image camera calibration methods rely on specific image features or user input, and cannot be applied to natural images captured in uncontrolled settings. We propose directly inferring camera calibration parameters from…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Yannick Hold-Geoffroy , Kalyan Sunkavalli , Jonathan Eisenmann , Matt Fisher , Emiliano Gambaretto , Sunil Hadap , Jean-François Lalonde

Calibrating deep neural models plays an important role in building reliable, robust AI systems in safety-critical applications. Recent work has shown that modern neural networks that possess high predictive capability are poorly calibrated…

Machine Learning · Computer Science 2025-09-16 Cheng Wang

3D LiDARs and 2D cameras are increasingly being used alongside each other in sensor rigs for perception tasks. Before these sensors can be used to gather meaningful data, however, their extrinsics (and intrinsics) need to be accurately…

Robotics · Computer Science 2019-08-06 Ganesh Iyer , R. Karnik Ram. , J. Krishna Murthy , K. Madhava Krishna

LIDAR and RADAR are two commonly used sensors in autonomous driving systems. The extrinsic calibration between the two is crucial for effective sensor fusion. The challenge arises due to the low accuracy and sparse information in RADAR…

Robotics · Computer Science 2023-05-19 Peng Jiang , Srikanth Saripalli

Confidence calibration -- the problem of predicting probability estimates representative of the true correctness likelihood -- is important for classification models in many applications. We discover that modern neural networks, unlike…

Machine Learning · Computer Science 2017-08-04 Chuan Guo , Geoff Pleiss , Yu Sun , Kilian Q. Weinberger

Camera-LiDAR extrinsic calibration is a critical task for multi-sensor fusion in autonomous systems, such as self-driving vehicles and mobile robots. Traditional techniques often require manual intervention or specific environments, making…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Mathieu Cocheteux , Julien Moreau , Franck Davoine

LiDAR-camera fusion is one of the core processes for the perception system of current automated driving systems. The typical sensor fusion process includes a list of coordinate transformation operations following system calibration.…

Robotics · Computer Science 2023-11-09 Dan Shen , Zhengming Zhang , Renran Tian , Yaobin Chen , Rini Sherony

The integration of multiple cameras and 3D Li- DARs has become basic configuration of augmented reality devices, robotics, and autonomous vehicles. The calibration of multi-modal sensors is crucial for a system to properly function, but it…

Robotics · Computer Science 2021-07-13 Chuan Fang , Shuai Ding , Zilong Dong , Honghua Li , Siyu Zhu , Ping Tan

Continual Learning (CL) focuses on maximizing the predictive performance of a model across a non-stationary stream of data. Unfortunately, CL models tend to forget previous knowledge, thus often underperforming when compared with an offline…

Machine Learning · Computer Science 2024-04-15 Lanpei Li , Elia Piccoli , Andrea Cossu , Davide Bacciu , Vincenzo Lomonaco

Sensor setups of robotic platforms commonly include both camera and LiDAR as they provide complementary information. However, fusing these two modalities typically requires a highly accurate calibration between them. In this paper, we…

In multimodal perception systems, achieving precise extrinsic calibration between LiDAR and camera is of critical importance. Previous calibration methods often required specific targets or manual adjustments, making them both…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Xingchen Li , Yifan Duan , Beibei Wang , Haojie Ren , Guoliang You , Yu Sheng , Jianmin Ji , Yanyong Zhang

The task of camera calibration is to estimate the intrinsic and extrinsic parameters of a camera model. Though there are some restricted techniques to infer the 3-D information about the scene from uncalibrated cameras, effective camera…

Computer Vision and Pattern Recognition · Computer Science 2016-08-31 Lili Ma , YangQuan Chen , Kevin L. Moore

Cameras and LiDARs are both important sensors for autonomous driving, playing critical roles in 3D object detection. Camera-LiDAR Fusion has been a prevalent solution for robust and accurate driving perception. In contrast to the vast…

Robotics · Computer Science 2024-03-05 Ye Li , Hanjiang Hu , Zuxin Liu , Xiaohao Xu , Xiaonan Huang , Ding Zhao