English
Related papers

Related papers: SemCal: Semantic LiDAR-Camera Calibration using Ne…

200 papers

Autonomous vehicles need to have a semantic understanding of the three-dimensional world around them in order to reason about their environment. State of the art methods use deep neural networks to predict semantic classes for each point in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Larissa T. Triess , David Peter , Christoph B. Rist , J. Marius Zöllner

Calibration is an essential prerequisite for the accurate data fusion of LiDAR and camera sensors. Traditional calibration techniques often require specific targets or suitable scenes to obtain reliable 2D-3D correspondences. To tackle the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Shujuan Huang , Chunyu Lin , Yao Zhao

Accurate camera calibration is crucial for various computer vision applications. However, measuring calibration accuracy in the real world is challenging due to the lack of datasets with ground truth to evaluate them. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Lala Shakti Swarup Ray , Bo Zhou , Lars Krupp , Sungho Suh , Paul Lukowicz

Semantic segmentation on LiDAR imaging is increasingly gaining attention, as it can provide useful knowledge for perception systems and potential for autonomous driving. However, collecting and labeling real LiDAR data is an expensive and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Javier Montalvo , Pablo Carballeira , Álvaro García-Martín

In multimodal perception systems, achieving precise extrinsic calibration between LiDAR and camera is of critical importance. Previous calibration methods often required specific targets or manual adjustments, making them both…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Xingchen Li , Yifan Duan , Beibei Wang , Haojie Ren , Guoliang You , Yu Sheng , Jianmin Ji , Yanyong Zhang

In the field of SLAM (Simultaneous Localization And Mapping) for robot navigation, mapping the environment is an important task. In this regard the Lidar sensor can produce near accurate 3D map of the environment in the format of point…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Aritra Mukherjee , Sourya Dipta Das , Jasorsi Ghosh , Ananda S. Chowdhury , Sanjoy Kumar Saha

3D panoptic segmentation is a challenging perception task that requires both semantic segmentation and instance segmentation. In this task, we notice that images could provide rich texture, color, and discriminative information, which can…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Zhiwei Zhang , Zhizhong Zhang , Qian Yu , Ran Yi , Yuan Xie , Lizhuang Ma

Semantic 3D mapping is one of the most important fields in robotics, and has been used in many applications, such as robot navigation, surveillance, and virtual reality. In general, semantic 3D mapping is mainly composed of 3D…

Robotics · Computer Science 2018-03-01 Jongmin Jeong , Tae Sung Yoon , Jin Bae Park

In this paper, we present TEScalib, a novel extrinsic self-calibration approach of LiDAR and stereo camera using the geometric and photometric information of surrounding environments without any calibration targets for automated driving…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Haohao Hu , Fengze Han , Frank Bieder , Jan-Hendrik Pauls , Christoph Stiller

For an autonomous vehicle, the ability to sense its surroundings and to build an overall representation of the environment by fusing different sensor data streams is fundamental. To this end, the poses of all sensors need to be accurately…

Robotics · Computer Science 2022-11-07 Brahayam Ponton , Magda Ferri , Lars Koenig , Marcus Bartels

With the advent of autonomous vehicles, LiDAR and cameras have become an indispensable combination of sensors. They both provide rich and complementary data which can be used by various algorithms and machine learning to sense and make…

Robotics · Computer Science 2017-05-30 Ankit Dhall , Kunal Chelani , Vishnu Radhakrishnan , K. M. Krishna

Recently, the rapid development of Solid-State LiDAR (SSL) enables low-cost and efficient obtainment of 3D point clouds from the environment, which has inspired a large quantity of studies and applications. However, the non-uniformity of…

Computer Vision and Pattern Recognition · Computer Science 2020-11-18 Jiahe Cui , Jianwei Niu , Zhenchao Ouyang , Yunxiang He , Dian Liu

In this paper, we propose a method of targetless and automatic Camera-LiDAR calibration. Our approach is an extension of hand-eye calibration framework to 2D-3D calibration. By using the sensor fusion odometry method, the scaled camera…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Ryoichi Ishikawa , Takeshi Oishi , Katsushi Ikeuchi

The combination of LiDARs and cameras enables a mobile robot to perceive environments with multi-modal data, becoming a key factor in achieving robust perception. Traditional frame cameras are sensitive to changing illumination conditions,…

Robotics · Computer Science 2023-03-20 Jianhao Jiao , Feiyi Chen , Hexiang Wei , Jin Wu , Ming Liu

Accurate spatiotemporal calibration is a prerequisite for multisensor fusion. However, sensors are typically asynchronous, and there is no overlap between the fields of view of cameras and LiDARs, posing challenges for intrinsic and…

Robotics · Computer Science 2025-01-07 Yuezhang Lv , Yunzhou Zhang , Chao Lu , Jiajun Zhu , Song Wu

LiDAR-camera extrinsic calibration is essential for multi-modal data fusion in robotic perception systems. However, existing approaches typically rely on handcrafted calibration targets (e.g., checkerboards) or specific, static scene types,…

Robotics · Computer Science 2026-01-06 Zhiwei Huang , Yanwei Fu , Yi Zhou , Xieyuanli Chen , Qijun Chen , Rui Fan

We present a self-supervised learning approach for the semantic segmentation of lidar frames. Our method is used to train a deep point cloud segmentation architecture without any human annotation. The annotation process is automated with…

Robotics · Computer Science 2020-12-11 Hugues Thomas , Ben Agro , Mona Gridseth , Jian Zhang , Timothy D. Barfoot

In this paper we perform an experimental comparison of three different target based 3D-LIDAR camera calibration algorithms. We briefly elucidate the mathematical background behind each method and provide insights into practical aspects like…

Robotics · Computer Science 2020-07-07 Subodh Mishra , Philip R. Osteen , Gaurav Pandey , Srikanth Saripalli

Autonomous vehicles are equipped with a multi-modal sensor setup to enable the car to drive safely. The initial calibration of such perception sensors is a highly matured topic and is routinely done in an automated factory environment.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Arya Rachman , Jürgen Seiler , André Kaup

Multi-camera systems are an important sensor platform for intelligent systems such as self-driving cars. Pattern-based calibration techniques can be used to calibrate the intrinsics of the cameras individually. However, extrinsic…

Computer Vision and Pattern Recognition · Computer Science 2020-09-17 Yukai Lin , Viktor Larsson , Marcel Geppert , Zuzana Kukelova , Marc Pollefeys , Torsten Sattler