English
Related papers

Related papers: Calibrating LiDAR and Camera using Semantic Mutual…

200 papers

Combining multiple LiDARs enables a robot to maximize its perceptual awareness of environments and obtain sufficient measurements, which is promising for simultaneous localization and mapping (SLAM). This paper proposes a system to achieve…

Robotics · Computer Science 2021-05-06 Jianhao Jiao , Haoyang Ye , Yilong Zhu , Ming Liu

We propose a semantic similarity metric for image registration. Existing metrics like euclidean distance or normalized cross-correlation focus on aligning intensity values, giving difficulties with low intensity contrast or noise. Our…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Steffen Czolbe , Oswin Krause , Aasa Feragen

This paper presents MFCalib, an innovative extrinsic calibration technique for LiDAR and RGB camera that operates automatically in targetless environments with a single data capture. At the heart of this method is using a rich set of edge…

Robotics · Computer Science 2024-09-04 Tianyong Ye , Wei Xu , Chunran Zheng , Yukang Cui

Clustering objects from the LiDAR point cloud is an important research problem with many applications such as autonomous driving. To meet the real-time requirement, existing research proposed to apply the connected-component-labeling (CCL)…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Yiming Zhao , Xiao Zhang , Xinming Huang

The purpose of this study is to develop an automated and accurate external camera calibration method for multi-camera systems used in 3D surgical scene reconstruction (3D-SSR), eliminating the need for operator intervention or specialized…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Tim Flückiger , Jonas Hein , Valery Fischer , Philipp Fürnstahl , Lilian Calvet

Visual-Inertial (VI) sensors are popular in robotics, self-driving vehicles, and augmented and virtual reality applications. In order to use them for any computer vision or state-estimation task, a good calibration is essential. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Christopher L. Choi , Binbin Xu , Stefan Leutenegger

As camera and LiDAR sensors capture complementary information used in autonomous driving, great efforts have been made to develop semantic segmentation algorithms through multi-modality data fusion. However, fusion-based approaches require…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Xu Yan , Jiantao Gao , Chaoda Zheng , Chao Zheng , Ruimao Zhang , Shenghui Cui , Zhen Li

Accurate LiDAR-camera calibration is fundamental to fusing multi-modal perception in autonomous driving and robotic systems. Traditional calibration methods require extensive data collection in controlled environments and cannot compensate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Weiduo Yuan , Jerry Li , Justin Yue , Divyank Shah , Konstantinos Karydis , Hang Qiu

Estimating camera intrinsic parameters without prior scene knowledge is a fundamental challenge in computer vision. This capability is particularly important for applications such as autonomous driving and vehicle platooning, where…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Gregory Schroeder , Mohamed Sabry , Cristina Olaverri-Monreal

Semantic grids are a useful representation of the environment around a robot. They can be used in autonomous vehicles to concisely represent the scene around the car, capturing vital information for downstream tasks like navigation or…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Manuel Alejandro Diaz-Zapata , Özgür Erkent , Christian Laugier , Jilles Dibangoye , David Sierra González

There are two critical sensors for 3D perception in autonomous driving, the camera and the LiDAR. The camera provides rich semantic information such as color, texture, and the LiDAR reflects the 3D shape and locations of surrounding…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Kaicheng Yu , Tang Tao , Hongwei Xie , Zhiwei Lin , Zhongwei Wu , Zhongyu Xia , Tingting Liang , Haiyang Sun , Jiong Deng , Dayang Hao , Yongtao Wang , Xiaodan Liang , Bing Wang

We present a novel method for extrinsically calibrating a camera and a 2D Laser Rangefinder (LRF) whose beams are invisible from the camera image. We show that point-to-plane constraints from a single observation of a V-shaped calibration…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Wenbo Dong , Volkan Isler

Learned object detection methods based on fusion of LiDAR and camera data require labeled training samples, but niche applications, such as warehouse robotics or automated infrastructure, require semantic classes not available in large…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Ryan Rubel , Andrew Dudash , Mohammad Goli , James O'Hara , Karl Wunderlich

This paper proposes FAST-Calib, a fast and user-friendly LiDAR-camera extrinsic calibration tool based on a custom-made 3D target. FAST-Calib supports both mechanical and solid-state LiDARs by leveraging an efficient and reliable edge…

Robotics · Computer Science 2025-07-24 Chunran Zheng , Fu Zhang

The integration of sensor data is crucial in the field of robotics to take full advantage of the various sensors employed. One critical aspect of this integration is determining the extrinsic calibration parameters, such as the relative…

Robotics · Computer Science 2024-03-28 Sangwoo Jung , Hyesu Jang , Minwoo Jung , Ayoung Kim , Myung-Hwan Jeon

Segmenting objects in an environment is a crucial task for autonomous driving and robotics, as it enables a better understanding of the surroundings of each agent. Although camera sensors provide rich visual details, they are vulnerable to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Huawei Sun , Bora Kunter Sahin , Georg Stettinger , Maximilian Bernhard , Matthias Schubert , Robert Wille

Camera calibration is an essential process in photogrammetry, serving as a crucial link between the 2D image coordinate system and the 3D world coordinate system. However, when observations are conducted through refractive interfaces, the…

Cameras and LiDARs are both important sensors for autonomous driving, playing critical roles in 3D object detection. Camera-LiDAR Fusion has been a prevalent solution for robust and accurate driving perception. In contrast to the vast…

Robotics · Computer Science 2024-03-05 Ye Li , Hanjiang Hu , Zuxin Liu , Xiaohao Xu , Xiaonan Huang , Ding Zhao

This report accompanies a dataset release on visual and thermal camera data and details a procedure followed to align such multi-modal camera frames in order to provide pixel-level correspondence between the two without using intrinsic or…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Frank Mascarich , Kostas Alexis

This paper describes a calibration algorithm to simultaneously calibrate a magnetometer and an accelerometer without any information besides the sensors readings. Using a linear sensor model and maximum likelihood cost, the algorithm is…

Optimization and Control · Mathematics 2015-05-22 Conrado Silva Miranda , Janito Vaqueiro Ferreira