English
Related papers

Related papers: Calibrating LiDAR and Camera using Semantic Mutual…

200 papers

We present a real-time, non-learning depth estimation method that fuses Light Detection and Ranging (LiDAR) data with stereo camera input. Our approach comprises three key techniques: Semi-Global Matching (SGM) stereo with Discrete…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yasuhiro Yao , Ryoichi Ishikawa , Takeshi Oishi

The fusion of multi-modal sensors has become increasingly popular in autonomous driving and intelligent robots since it can provide richer information than any single sensor, enhance reliability in complex environments. Multi-sensor…

Robotics · Computer Science 2024-10-28 Taimeng Fu , Huai Yu , Wen Yang , Yaoyu Hu , Sebastian Scherer

Most current single image camera calibration methods rely on specific image features or user input, and cannot be applied to natural images captured in uncontrolled settings. We propose directly inferring camera calibration parameters from…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Yannick Hold-Geoffroy , Kalyan Sunkavalli , Jonathan Eisenmann , Matt Fisher , Emiliano Gambaretto , Sunil Hadap , Jean-François Lalonde

Accurate LiDAR-camera extrinsic calibration is a precondition for many multi-sensor systems in mobile robots. Most calibration methods rely on laborious manual operations and calibration targets. While working online, the calibration…

Robotics · Computer Science 2022-03-18 Xin Jing , Xiaqing Ding , Rong Xiong , Huanjun Deng , Yue Wang

Depth estimation is one of the key technologies in some fields such as autonomous driving and robot navigation. However, the traditional method of using a single sensor is inevitably limited by the performance of the sensor. Therefore, a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Guangyao Xu , Junfeng Fan , En Li , Xiaoyu Long , Rui Guo

Perception is a key element for enabling intelligent autonomous navigation. Understanding the semantics of the surrounding environment and accurate vehicle pose estimation are essential capabilities for autonomous vehicles, including…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Mohamed Afifi , Mohamed ElHelw

Accurate and reliable sensor calibration is critical for fusing LiDAR and inertial measurements in autonomous driving. This paper proposes a novel three-stage extrinsic calibration method between LiDAR and GNSS/INS for autonomous driving.…

Robotics · Computer Science 2023-03-01 Guohang Yan , Jiahao Pi , Chengjie Wang , Xinyu Cai , Yikang Li

Despite the increasing interest in enhancing perception systems for autonomous vehicles, the online calibration between event cameras and LiDAR - two sensors pivotal in capturing comprehensive environmental information - remains unexplored.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Mathieu Cocheteux , Julien Moreau , Franck Davoine

Semantic segmentation is one of the basic, yet essential scene understanding tasks for an autonomous agent. The recent developments in supervised machine learning and neural networks have enjoyed great success in enhancing the performance…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 S. Ehsan Mirsadeghi , Ali Royat , Hamid Rezatofighi

Mutual information (MI) is a promising candidate measure for the assessment and optimization of localization systems, as it captures nonlinear dependencies between random variables. However, the high cost of computing MI, especially for…

Signal Processing · Electrical Eng. & Systems 2025-11-04 Sven Hinderer , Manuel Buchfink , Bin Yang

Multi-modal depth estimation is one of the key challenges for endowing autonomous machines with robust robotic perception capabilities. There have been outstanding advances in the development of uni-modal depth estimation techniques based…

Robotics · Computer Science 2023-07-21 Johan S. Obando-Ceron , Victor Romero-Cano , Sildomar Monteiro

Large-scale semantic mapping is crucial for outdoor autonomous agents to fulfill high-level tasks such as planning and navigation. This paper proposes a novel method for large-scale 3D semantic reconstruction through implicit…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Jianyuan Zhang , Zhiliu Yang , Meng Zhang

Owing to the capability for reliable and all-weather long-range sensing, the fusion of LiDAR and Radar has been widely applied to autonomous vehicles for robust perception. In practical operation, well manually calibrated extrinsic…

Robotics · Computer Science 2025-03-24 Weimin Wang , Yu Du , Ting Yang , Yu Liu

This paper presents a framework for the targetless extrinsic calibration of stereo cameras and Light Detection and Ranging (LiDAR) sensors with a non-overlapping Field of View (FOV). In order to solve the extrinsic calibrations problem…

Robotics · Computer Science 2019-03-07 Jinyong Jeong , Lucas Y. Cho , Ayoung Kim

In this paper, we address extrinsic calibration for camera, lidar, and 4D radar sensors. Accurate extrinsic calibration of radar remains a challenge due to the sparsity of its data. We propose CLRNet, a novel, multi-modal end-to-end deep…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Marcell Kegl , Andras Palffy , Csaba Benedek , Dariu M. Gavrila

LiDAR and camera are two essential sensors for 3D object detection in autonomous driving. LiDAR provides accurate and reliable 3D geometry information while the camera provides rich texture with color. Despite the increasing popularity of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Qi Jiang , Hao Sun , Xi Zhang

This work presents a novel target-free extrinsic calibration algorithm for a 3D Lidar and an IMU pair using an Extended Kalman Filter (EKF) which exploits the \textit{motion based calibration constraint} for state update. The steps include,…

Robotics · Computer Science 2021-09-30 Subodh Mishra , Gaurav Pandey , Srikanth Saripalli

Calibration of multi-camera systems, i.e. determining the relative poses between the cameras, is a prerequisite for many tasks in computer vision and robotics. Camera calibration is typically achieved using offline methods that use…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Bastian Pätzold , Simon Bultmann , Sven Behnke

Autonomous vehicles (AVs) fuse data from multiple sensors and sensing modalities to impart a measure of robustness when operating in adverse conditions. Radars and cameras are popular choices for use in sensor fusion; although radar…

Robotics · Computer Science 2023-12-12 Emmett Wise , Qilong Cheng , Jonathan Kelly

Localization has been a challenging task for autonomous navigation. A loop detection algorithm must overcome environmental changes for the place recognition and re-localization of robots. Therefore, deep learning has been extensively…

Robotics · Computer Science 2023-04-19 Alex Junho Lee , Seungwon Song , Hyungtae Lim , Woojoo Lee , Hyun Myung