English
Related papers

Related papers: Indoor Layout Estimation by 2D LiDAR and Camera Fu…

200 papers

Multi-sensor fusion of multi-modal measurements from commodity inertial, visual and LiDAR sensors to provide robust and accurate 6DOF pose estimation holds great potential in robotics and beyond. In this paper, building upon our prior work…

Robotics · Computer Science 2020-08-18 Xingxing Zuo , Yulin Yang , Patrick Geneva , Jiajun Lv , Yong Liu , Guoquan Huang , Marc Pollefeys

Current traditional methods for LiDAR-camera extrinsics estimation depend on offline targets and human efforts, while learning-based approaches resort to iterative refinement for calibration results, posing constraints on their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shuang Xu , Sifan Zhou , Zhi Tian , Jizhou Ma , Qiong Nie , Xiangxiang Chu

As technology advances in autonomous mobile robots, mobile service robots have been actively used more and more for various purposes. Especially, serving robots have been not surprising products anymore since the COVID-19 pandemic. One of…

Robotics · Computer Science 2023-07-26 Jieun Lee , Hakjun Lee , Jiyong Oh

Calibration is an essential prerequisite for the accurate data fusion of LiDAR and camera sensors. Traditional calibration techniques often require specific targets or suitable scenes to obtain reliable 2D-3D correspondences. To tackle the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Shujuan Huang , Chunyu Lin , Yao Zhao

Ego-motion estimation is a fundamental requirement for most mobile robotic applications. By sensor fusion, we can compensate the deficiencies of stand-alone sensors and provide more reliable estimations. We introduce a tightly coupled…

Robotics · Computer Science 2019-08-30 Haoyang Ye , Yuying Chen , Ming Liu

In this paper, we propose an approach to address the problem of 3D reconstruction of scenes from a single image captured by a light-field camera equipped with a rolling shutter sensor. Our method leverages the 3D information cues present in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Hermes McGriff , Renato Martins , Nicolas Andreff , Cédric Demonceaux

Mobile robots equipped with multiple light detection and ranging (LiDARs) and capable of recognizing their surroundings are increasing due to the minitualization and cost reduction of LiDAR. This paper proposes a target-less extrinsic…

Robotics · Computer Science 2024-09-16 Shun Niijima , Atsushi Suzuki , Ryoichi Tsuzaki , Masaya Kinoshita

LiDAR and camera are two important sensors for 3D object detection in autonomous driving. Despite the increasing popularity of sensor fusion in this field, the robustness against inferior image conditions, e.g., bad illumination and sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xuyang Bai , Zeyu Hu , Xinge Zhu , Qingqiu Huang , Yilun Chen , Hongbo Fu , Chiew-Lan Tai

Advances in autonomous driving are inseparable from sensor fusion. Heterogeneous sensors are widely used for sensor fusion due to their complementary properties, with radar and camera being the most equipped sensors. Intrinsic and extrinsic…

Robotics · Computer Science 2023-07-31 Lei Cheng , Arindam Sengupta , Siyang Cao

We propose an algorithm for automatic, targetless, extrinsic calibration of a LiDAR and camera system using semantic information. We achieve this goal by maximizing mutual information (MI) of semantic information between sensors, leveraging…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Peng Jiang , Philip Osteen , Srikanth Saripalli

As mobile robot capabilities improve and deployment times increase, tools to analyze the growing volume of data are becoming necessary. Current state-of-the-art logging, playback, and exploration systems are insufficient for practitioners…

Robotics · Computer Science 2020-08-03 Samer B. Nashed

Camera motion estimation is a key technique for 3D scene reconstruction and Simultaneous localization and mapping (SLAM). To make it be feasibly achieved, previous works usually assume slow camera motions, which limits its usage in many…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Zunjie Zhu , Feng Xu

3D panoptic segmentation is a challenging perception task that requires both semantic segmentation and instance segmentation. In this task, we notice that images could provide rich texture, color, and discriminative information, which can…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Zhiwei Zhang , Zhizhong Zhang , Qian Yu , Ran Yi , Yuan Xie , Lizhuang Ma

In this paper, we present a new algorithm for fast, online 3D reconstruction of dynamic scenes using times of arrival of photons recorded by single-photon detector arrays. One of the main challenges in 3D imaging using single-photon lidar…

Image and Video Processing · Electrical Eng. & Systems 2021-02-03 Quentin Legros , Julian Tachella , Rachael Tobin , Aongus McCarthy , Sylvain Meignen , Gerald S. Buller , Yoann Altmann , Stephen McLaughlin , Michael E. Davies

In this paper we perform an experimental comparison of three different target based 3D-LIDAR camera calibration algorithms. We briefly elucidate the mathematical background behind each method and provide insights into practical aspects like…

Robotics · Computer Science 2020-07-07 Subodh Mishra , Philip R. Osteen , Gaurav Pandey , Srikanth Saripalli

The use of infrastructure sensor technology for traffic detection has already been proven several times. However, extrinsic sensor calibration is still a challenge for the operator. While previous approaches are unable to calibrate the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Laurent Kloeker , Christian Kotulla , Lutz Eckstein

Recent progress in the automated driving system (ADS) and advanced driver assistant system (ADAS) has shown that the combined use of 3D light detection and ranging (LiDAR) and the camera is essential for an intelligent vehicle to perceive…

Image and Video Processing · Electrical Eng. & Systems 2019-12-24 Yecheng Lyu , Lin Bai , Mahdi Elhousni , Xinming Huang

We propose a multi-sensor fusion method for capturing challenging 3D human motions with accurate consecutive local poses and global trajectories in large-scale scenarios, only using single LiDAR and 4 IMUs, which are set up conveniently and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Yiming Ren , Chengfeng Zhao , Yannan He , Peishan Cong , Han Liang , Jingyi Yu , Lan Xu , Yuexin Ma

Combining multiple LiDARs enables a robot to maximize its perceptual awareness of environments and obtain sufficient measurements, which is promising for simultaneous localization and mapping (SLAM). This paper proposes a system to achieve…

Robotics · Computer Science 2021-05-06 Jianhao Jiao , Haoyang Ye , Yilong Zhu , Ming Liu

For an autonomous vehicle, the ability to sense its surroundings and to build an overall representation of the environment by fusing different sensor data streams is fundamental. To this end, the poses of all sensors need to be accurately…

Robotics · Computer Science 2022-11-07 Brahayam Ponton , Magda Ferri , Lars Koenig , Marcus Bartels