English
Related papers

Related papers: An Interactive LiDAR to Camera Calibration

200 papers

In this work we present a novel method to jointly calibrate a sensor suite consisting a 3D-LiDAR, Inertial Measurement Unit (IMU) and Camera under an Extended Kalman Filter (EKF) framework. We exploit pairwise constraints between the 3…

Robotics · Computer Science 2022-05-19 Subodh Mishra , Srikanth Saripalli

Accurate camera calibration is a fundamental task for 3D perception, especially when dealing with real-world, in-the-wild environments where complex optical distortions are common. Existing methods often rely on pre-rectified images or…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Liuyue Xie , Jiancong Guo , Ozan Cakmakci , Andre Araujo , Laszlo A. Jeni , Zhiheng Jia

Motivated by the increasing application of low-resolution LiDAR recently, we target the problem of low-resolution LiDAR-camera calibration in this work. The main challenges are two-fold: sparsity and noise in point clouds. To address the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Zhikang Zhang , Zifan Yu , Suya You , Raghuveer Rao , Sanjeev Agarwal , Fengbo Ren

Visual perception is regularly used by humans and robots for navigation. By either implicitly or explicitly mapping the environment, ego-motion can be determined and a path of actions can be planned. The process of mapping and navigation…

Robotics · Computer Science 2018-10-02 Jacky C. K. Chow , Ivan Detchev , Kathleen Ang , Kristian Morin , Karthik Mahadevan , Nicholas Louie

This paper proposes SemCal: an automatic, targetless, extrinsic calibration algorithm for a LiDAR and camera system using semantic information. We leverage a neural information estimator to estimate the mutual information (MI) of semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Peng Jiang , Philip Osteen , Srikanth Saripalli

We present a novel target-based lidar-camera extrinsic calibration methodology that can be used for non-overlapping field of view (FOV) sensors. Contrary to previous work, our methodology overcomes the non-overlapping FOV challenge using a…

Robotics · Computer Science 2025-03-04 Nicholas Charron , Huaiyuan Weng , Steven L. Waslander , Sriram Narasimhan

The use of infrastructure sensor technology for traffic detection has already been proven several times. However, extrinsic sensor calibration is still a challenge for the operator. While previous approaches are unable to calibrate the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Laurent Kloeker , Christian Kotulla , Lutz Eckstein

This letter presents a novel method to estimate the relative poses between RGB-D cameras with minimal overlapping fields of view in a panoramic RGB-D camera system. This calibration problem is relevant to applications such as indoor 3D…

Image and Video Processing · Electrical Eng. & Systems 2018-09-11 Hang Liu , Hengyu Li , Xiahua Liu , Jun Luo , Shaorong Xie , Yu Sun

The ability to accurately detect and localize objects is recognized as being the most important for the perception of self-driving cars. From 2D to 3D object detection, the most difficult is to determine the distance from the ego-vehicle to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Nguyen Anh Minh Mai , Pierre Duthon , Louahdi Khoudour , Alain Crouzil , Sergio A. Velastin

Camera calibration is a crucial step in robotics and computer vision. Accurate camera parameters are necessary to achieve robust applications. Nowadays, camera calibration process consists of adjusting a set of data to a pin-hole model,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Carlos Ricolfe-Viala , Alicia Esparza

For building a Augmented Reality (AR) pipeline, the most crucial step is the camera calibration as overall quality heavily depends on it. In turn camera calibration itself is influenced most by the choice of camera-to-pattern poses - yet…

Human-Computer Interaction · Computer Science 2019-07-10 Pavel Rojtberg

Camera and radar sensors have significant advantages in cost, reliability, and maintenance compared to LiDAR. Existing fusion methods often fuse the outputs of single modalities at the result-level, called the late fusion strategy. This can…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Youngseok Kim , Sanmin Kim , Jun Won Choi , Dongsuk Kum

Owing to the capability for reliable and all-weather long-range sensing, the fusion of LiDAR and Radar has been widely applied to autonomous vehicles for robust perception. In practical operation, well manually calibrated extrinsic…

Robotics · Computer Science 2025-03-24 Weimin Wang , Yu Du , Ting Yang , Yu Liu

LiDAR (Light Detection And Ranging) is an indispensable sensor for precise long- and wide-range 3D sensing, which directly benefited the recent rapid deployment of autonomous driving (AD). Meanwhile, such a safety-critical application…

Cryptography and Security · Computer Science 2024-02-09 Takami Sato , Yuki Hayakawa , Ryo Suzuki , Yohsuke Shiiki , Kentaro Yoshioka , Qi Alfred Chen

LiDARs are usually more accurate than cameras in distance measuring. Hence, there is strong interest to apply LiDARs in autonomous driving. Different existing approaches process the rich 3D point clouds for object detection, tracking and…

Robotics · Computer Science 2020-10-15 You Li , Clément Le Bihan , Txomin Pourtau , Thomas Ristorcelli

- Both Lidars and Radars are sensors for obstacle detection. While Lidars are very accurate on obstacles positions and less accurate on their velocities, Radars are more precise on obstacles velocities and less precise on their positions.…

Robotics · Computer Science 2019-07-02 Hatem Hajri , Mohamed-Cherif Rahal

Collaborative robotic industrial cells are workspaces where robots collaborate with human operators. In this context, safety is paramount, and for that a complete perception of the space where the collaborative robot is inserted is…

Robotics · Computer Science 2022-10-20 Daniela Rato , Miguel Oliveira , Vítor Santos , Manuel Gomes , Angel Sappa

Fourier ptychography captures intensity images with varying source patterns (illumination angles) in order to computationally reconstruct large space-bandwidth-product images. Accurate knowledge of the illumination angles is necessary for…

Signal Processing · Electrical Eng. & Systems 2018-11-01 Regina Eckert , Zachary F. Phillips , Laura Waller

Accurate LiDAR-Camera (LC) calibration is challenging but crucial for autonomous systems and robotics. In this paper, we propose two single-shot and target-less algorithms to estimate the calibration parameters between LiDAR and camera…

Robotics · Computer Science 2026-01-05 Yanyu Zhang , Jie Xu , Wei Ren

The integration of data from diverse sensor modalities (e.g., camera and LiDAR) constitutes a prevalent methodology within the ambit of autonomous driving scenarios. Recent advancements in efficient point cloud transformers have underscored…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yutao Zhu , Xiaosong Jia , Xinyu Yang , Junchi Yan