English
Related papers

Related papers: CalibFormer: A Transformer-based Automatic LiDAR-C…

200 papers

Albeit revealing impressive predictive performance for several computer vision tasks, deep neural networks (DNNs) are prone to making overconfident predictions. This limits the adoption and wider utilization of DNNs in many safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Muhammad Akhtar Munir , Salman Khan , Muhammad Haris Khan , Mohsen Ali , Fahad Shahbaz Khan

Achieving safe and reliable autonomous driving relies greatly on the ability to achieve an accurate and robust perception system; however, this cannot be fully realized without precisely calibrated sensors. Environmental and operational…

This paper presents Camera-LiDAR Fusion Transformer (CLFT) models for traffic object segmentation, which leverage the fusion of camera and LiDAR data using vision transformers. Building on the methodology of visual transformers that exploit…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Toomas Tahves , Junyi Gu , Mauro Bellone , Raivo Sell

Depth estimation is one of the key technologies in some fields such as autonomous driving and robot navigation. However, the traditional method of using a single sensor is inevitably limited by the performance of the sensor. Therefore, a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Guangyao Xu , Junfeng Fan , En Li , Xiaoyu Long , Rui Guo

The state of the art in 3D object detection using sensor fusion heavily relies on calibration quality, which is difficult to maintain in large scale deployment outside a lab environment. We present the first calibration-free approach for 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Michael Fürst , Rahul Jakkamsetty , René Schuster , Didier Stricker

In this paper, we study the problem of jointly estimating the optical flow and scene flow from synchronized 2D and 3D data. Previous methods either employ a complex pipeline that splits the joint task into independent stages, or fuse 2D and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Haisong Liu , Tao Lu , Yihui Xu , Jia Liu , Wenjie Li , Lijun Chen

Accurate sensor calibration is crucial for autonomous systems, yet its uncertainty quantification remains underexplored. We present the first approach to integrate uncertainty awareness into online extrinsic calibration, combining Monte…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Mathieu Cocheteux , Julien Moreau , Franck Davoine

Rigorous testing of autonomous robots, such as self-driving vehicles, is essential to ensure their safety in real-world deployments. This requires building high-fidelity simulators to test scenarios beyond those that can be safely or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Haithem Turki , Qi Wu , Xin Kang , Janick Martinez Esturo , Shengyu Huang , Ruilong Li , Zan Gojcic , Riccardo de Lutio

This work proposes a novel motion guided method for target-less self-calibration of a LiDAR and camera and use the re-projection of LiDAR points onto the image reference frame for real-time depth upsampling. The calibration parameters are…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Juan Castorena , Gint Puskorius , Gaurav Pandey

Accurate spatiotemporal calibration is a prerequisite for multisensor fusion. However, sensors are typically asynchronous, and there is no overlap between the fields of view of cameras and LiDARs, posing challenges for intrinsic and…

Robotics · Computer Science 2025-01-07 Yuezhang Lv , Yunzhou Zhang , Chao Lu , Jiajun Zhu , Song Wu

Referring image segmentation aims to segment an object referred to by natural language expression from an image. The primary challenge lies in the efficient propagation of fine-grained semantic information from textual features to visual…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Yichen Yan , Xingjian He , Sihan Chen , Jing Liu

Quantitative inversion algorithms allow for the reconstruction of electrical properties (such as permittivity, and conductivity) for every point in a scene. However, they are challenging to use on measured datasets due to the need to know…

Signal Processing · Electrical Eng. & Systems 2025-05-15 Zacharie Idriss , Raghu Raj

In recent years, the fusion of camera data with LiDAR measurements has emerged as a powerful approach to enhance spatial understanding. This study introduces a novel, hardware-agnostic methodology that generates colourised point clouds from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Pasindu Ranasinghe , Dibyayan Patra , Bikram Banerjee , Simit Raval

With the development of autonomous driving technology, sensor calibration has become a key technology to achieve accurate perception fusion and localization. Accurate calibration of the sensors ensures that each sensor can function properly…

Robotics · Computer Science 2023-05-29 Jixiang Li , Jiahao Pi , Guohang Yan , Yikang Li

Robotic calibration allows for the fusion of data from multiple sensors such as odometers, cameras, etc., by providing appropriate transformational relationships between the corresponding reference frames. For wheeled robots equipped with…

Robotics · Computer Science 2020-01-07 Mohan Krishna Nutalapati , Lavish Arora , Anway Bose , Ketan Rajawat , Rajesh M Hegde

Camera-LiDAR extrinsic calibration is a critical task for multi-sensor fusion in autonomous systems, such as self-driving vehicles and mobile robots. Traditional techniques often require manual intervention or specific environments, making…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Mathieu Cocheteux , Julien Moreau , Franck Davoine

With the recent advances in autonomous driving and the decreasing cost of LiDARs, the use of multimodal sensor systems is on the rise. However, in order to make use of the information provided by a variety of complimentary sensors, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Quentin Herau , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou , Cyrille Migniot , Pascal Vasseur , Cédric Demonceaux

Light Detection and Ranging (LiDAR) sensors have become a de-facto sensor for many robot state estimation tasks, spurring development of many LiDAR Odometry (LO) methods in recent years. While some smoothing-based LO methods have been…

Robotics · Computer Science 2025-10-14 Easton R. Potokar , Taylor Pool , Daniel McGann , Michael Kaess

LiDAR-camera extrinsic calibration (LCEC) is crucial for data fusion in intelligent vehicles. Offline, target-based approaches have long been the preferred choice in this field. However, they often demonstrate poor adaptability to…

Robotics · Computer Science 2024-06-21 Zhiwei Huang , Yikang Zhang , Qijun Chen , Rui Fan

Lidars and cameras are critical sensors that provide complementary information for 3D detection in autonomous driving. While prevalent multi-modal methods simply decorate raw lidar point clouds with camera features and feed them directly to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Yingwei Li , Adams Wei Yu , Tianjian Meng , Ben Caine , Jiquan Ngiam , Daiyi Peng , Junyang Shen , Bo Wu , Yifeng Lu , Denny Zhou , Quoc V. Le , Alan Yuille , Mingxing Tan