English
Related papers

Related papers: Calibrating LiDAR and Camera using Semantic Mutual…

200 papers

Precise LiDAR-camera calibration is crucial for integrating these two sensors into robotic systems to achieve robust perception. In applications like autonomous driving, online targetless calibration enables a prompt sensor misalignment…

Robotics · Computer Science 2025-08-12 Shu Han , Xubo Zhu , Ji Wu , Ximeng Cai , Wen Yang , Huai Yu , Gui-Song Xia

Sensor fusion has become a popular topic in robotics. However, conventional fusion methods encounter many difficulties, such as data representation differences, sensor variations, and extrinsic calibration. For example, the calibration…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Shuyi Zhou , Shuxiang Xie , Ryoichi Ishikawa , Ken Sakurada , Masaki Onishi , Takeshi Oishi

Current traditional methods for LiDAR-camera extrinsics estimation depend on offline targets and human efforts, while learning-based approaches resort to iterative refinement for calibration results, posing constraints on their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shuang Xu , Sifan Zhou , Zhi Tian , Jizhou Ma , Qiong Nie , Xiangxiang Chu

In view of contemporary panoramic camera-laser scanner system, the traditional calibration method is not suitable for panoramic cameras whose imaging model is extremely nonlinear. The method based on statistical optimization has the…

Computer Vision and Pattern Recognition · Computer Science 2017-09-14 Mingwei Cao , Ming Yang , Chunxiang Wang , Yeqiang Qian , Bing Wang

Sensor fusion is essential for autonomous driving and autonomous robots, and radar-camera fusion systems have gained popularity due to their complementary sensing capabilities. However, accurate calibration between these two sensors is…

Robotics · Computer Science 2024-01-26 Lei Cheng , Siyang Cao

LiDAR has become a standard sensor for autonomous driving applications as they provide highly precise 3D point clouds. LiDAR is also robust for low-light scenarios at night-time or due to shadows where the performance of cameras is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Khaled El Madawy , Hazem Rashed , Ahmad El Sallab , Omar Nasr , Hanan Kamel , Senthil Yogamani

Multi-agent systems, e.g., automobiles and UAVs (Unmanned Ariel Vehicles), rely on the precision of onboard sensors to accurately perceive their environment, which in turn depends on the precision of onboard sensors and reliable in-field…

Signal Processing · Electrical Eng. & Systems 2026-04-23 Bichi Zhang , Holger Caesar , Raj Thilak Rajan

Calibrating the extrinsic parameters of sensory devices is crucial for fusing multi-modal data. Recently, event cameras have emerged as a promising type of neuromorphic sensors, with many potential applications in fields such as mobile…

Robotics · Computer Science 2023-05-09 Wanli Xing , Shijie Lin , Lei Yang , Jia Pan

LiDARs and cameras are the two main sensors that are planned to be included in many announced autonomous vehicles prototypes. Each of the two provides a unique form of data from a different perspective to the surrounding environment. In…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Amr S. Mohamed , Ali Abdelkader , Mohamed Anany , Omar El-Behady , Muhammad Faisal , Asser Hangal , Hesham M. Eraqi , Mohamed N. Moustafa

Semantic segmentation of LiDAR data presents considerable challenges, particularly when dealing with diverse sensor types and configurations. However, incorporating semantic information can significantly enhance the accuracy and robustness…

Robotics · Computer Science 2025-09-26 Sven Ochs , Philip Schörner , Marc René Zofka , J. Marius Zöllner

Advances in autonomous driving are inseparable from sensor fusion. Heterogeneous sensors are widely used for sensor fusion due to their complementary properties, with radar and camera being the most equipped sensors. Intrinsic and extrinsic…

Robotics · Computer Science 2023-07-31 Lei Cheng , Arindam Sengupta , Siyang Cao

This paper presents a compact and accurate representation of 3D scenes that are observed by a LiDAR sensor and a monocular camera. The proposed method is based on the well-established Stixel model originally developed for stereo vision…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Florian Piewak , Peter Pinggera , Markus Enzweiler , David Pfeiffer , Marius Zöllner

This work presents an extrinsic parameter estimation algorithm between a 3D LIDAR and a Projective Camera using a marker-less planar target, by exploiting Planar Surface Point to Plane and Planar Edge Point to back-projected Plane geometric…

Robotics · Computer Science 2020-05-20 Subodh Mishra , Gaurav Pandey , Srikanth Saripalli

In this work we present a novel method to jointly calibrate a sensor suite consisting a 3D-LiDAR, Inertial Measurement Unit (IMU) and Camera under an Extended Kalman Filter (EKF) framework. We exploit pairwise constraints between the 3…

Robotics · Computer Science 2022-05-19 Subodh Mishra , Srikanth Saripalli

Reliable deep learning models require not only accurate predictions but also well-calibrated confidence estimates to ensure dependable uncertainty estimation. This is crucial in safety-critical applications like autonomous driving, which…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Hanieh Shojaei Miandashti , Qianqian Zou , Claus Brenner

For autonomous vehicles, an accurate calibration for LiDAR and camera is a prerequisite for multi-sensor perception systems. However, existing calibration techniques require either a complicated setting with various calibration targets, or…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Tao Ma , Zhizheng Liu , Guohang Yan , Yikang Li

Sensor calibration, which can be intrinsic or extrinsic, is an essential step to achieve the measurement accuracy required for modern perception and navigation systems deployed on autonomous robots. To date, intrinsic calibration models for…

Robotics · Computer Science 2021-07-29 Jiunn-Kai Huang , Chenxi Feng , Madhav Achar , Maani Ghaffari , Jessy W. Grizzle

In complex environments, autonomous robot navigation and environmental perception pose higher requirements for SLAM technology. This paper presents a novel method for semantically enhancing 3D point cloud maps with thermal information. By…

Robotics · Computer Science 2026-01-15 Jiajun Sun , Yangyi Ou , Haoyuan Zheng , Chao yang , Yue Ma

In this paper we introduce a novel way to predict semantic information from sparse, single-shot LiDAR measurements in the context of autonomous driving. In particular, we fuse learned features from complementary representations. The…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Frank Bieder , Maximilian Link , Simon Romanski , Haohao Hu , Christoph Stiller

In self-driving, standalone GPS is generally considered to have insufficient positioning accuracy to stay in lane. Instead, many turn to LIDAR localization, but this comes at the expense of building LIDAR maps that can be costly to…

Robotics · Computer Science 2021-07-02 Wei-Kang Tseng , Angela P. Schoellig , Timothy D. Barfoot