English
Related papers

Related papers: MOISST: Multimodal Optimization of Implicit Scene …

200 papers

Autonomous robots that assist humans in day to day living tasks are becoming increasingly popular. Autonomous mobile robots operate by sensing and perceiving their surrounding environment to make accurate driving decisions. A combination of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Varuna De Silva , Jamie Roche , Ahmet Kondoz

This paper presents a compact and accurate representation of 3D scenes that are observed by a LiDAR sensor and a monocular camera. The proposed method is based on the well-established Stixel model originally developed for stereo vision…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Florian Piewak , Peter Pinggera , Markus Enzweiler , David Pfeiffer , Marius Zöllner

This article presents an innovative study in exploring, evaluating, and implementing deep learning architectures for the calibration of multi-modal sensor systems. The focus behind this is to leverage the use of sensor fusion to achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Venkat Karramreddy , Liam Mitchell

Multi-modality spatio-temporal (MoST) data extends spatio-temporal (ST) data by incorporating multiple modalities, which is prevalent in monitoring systems, encompassing diverse traffic demands and air quality assessments. Despite…

Machine Learning · Computer Science 2024-05-07 Jiewen Deng , Renhe Jiang , Jiaqi Zhang , Xuan Song

The growing demand for robust scene understanding in mobile robotics and autonomous driving has highlighted the importance of integrating multiple sensing modalities. By combining data from diverse sensors like cameras and LIDARs, fusion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Depanshu Sani , Saket Anand

Multiple lidars are prevalently used on mobile vehicles for rendering a broad view to enhance the performance of localization and perception systems. However, precise calibration of multiple lidars is challenging since the feature…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Jianhao Jiao , Qinghai Liao , Yilong Zhu , Tianyu Liu , Yang Yu , Rui Fan , Lujia Wang , Ming Liu

Realizing high-throughput aberration-corrected Scanning Transmission Electron Microscopy (STEM) exploration of atomic structures requires rapid tuning of multipole probe correctors while compensating for the inevitable drift of the optical…

Machine Learning · Computer Science 2026-01-28 Utkarsh Pratiush , Austin Houston , Richard Liu , Gerd Duscher , Sergei Kalinin

In autonomous systems, sensor calibration is essential for safe and efficient navigation in dynamic environments. Accurate calibration is a prerequisite for reliable perception and planning tasks such as object detection and obstacle…

Robotics · Computer Science 2026-02-02 Ilir Tahiraj , Markus Edinger , Dominik Kulmer , Markus Lienkamp

The goal of extrinsic calibration is the alignment of sensor data to ensure an accurate representation of the surroundings and enable sensor fusion applications. From a safety perspective, sensor calibration is a key enabler of autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Ilir Tahiraj , Jeremialie Swadiryus , Felix Fent , Markus Lienkamp

We present a novel multi-modal extrinsic calibration framework designed to simultaneously estimate the relative poses between event cameras, LiDARs, and RGB cameras, with particular focus on the challenging event camera calibration. Core of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Andrea Bertogalli , Giacomo Boracchi , Luca Magri

Exploiting multiple modalities for semantic scene parsing has been shown to improve accuracy over the singlemodality scenario. However multimodal datasets often suffer from problems such as data misalignment and label inconsistencies, where…

Computer Vision and Pattern Recognition · Computer Science 2017-09-29 Sarah Taghavi Namin , Mohammad Najafi , Mathieu Salzmann , Lars Petersson

Accurate and reliable sensor calibration is essential to fuse LiDAR and inertial measurements, which are usually available in robotic applications. In this paper, we propose a novel LiDAR-IMU calibration method within the continuous-time…

Robotics · Computer Science 2022-05-09 Jiajun Lv , Xingxing Zuo , Kewei Hu , Jinhong Xu , Guoquan Huang , Yong Liu

Calibration of sensors is fundamental to robust performance for intelligent vehicles. In natural environments, disturbances can easily challenge calibration. One possibility is to use natural objects of known shape to recalibrate sensors.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Yunhai Han , Yuhan Liu , David Paz , Henrik Christensen

Aided inertial navigation system (INS), typically consisting of an inertial measurement unit (IMU) and an exteroceptive sensor, has been widely accepted as a feasible solution for navigation. Compared with vision-aided and LiDAR-aided INS,…

Robotics · Computer Science 2024-11-01 Shuolong Chen , Xingxing Li , Shengyu Li , Yuxuan Zhou , Shiwen Wang

The fusion of multi-modal sensors has become increasingly popular in autonomous driving and intelligent robots since it can provide richer information than any single sensor, enhance reliability in complex environments. Multi-sensor…

Robotics · Computer Science 2024-10-28 Taimeng Fu , Huai Yu , Wen Yang , Yaoyu Hu , Sebastian Scherer

Semantic Scene Completion (SSC) is pivotal in autonomous driving perception, frequently confronted with the complexities of weather and illumination changes. The long-term strategy involves fusing multi-modal information to bolster the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Yukai Ma , Jianbiao Mei , Xuemeng Yang , Licheng Wen , Weihua Xu , Jiangning Zhang , Botian Shi , Yong Liu , Xingxing Zuo

Beyond novel view synthesis, Neural Radiance Fields are useful for applications that interact with the real world. In this paper, we use them as an implicit map of a given scene and propose a camera relocalization algorithm tailored for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Arthur Moreau , Nathan Piasco , Moussab Bennehar , Dzmitry Tsishkou , Bogdan Stanciulescu , Arnaud de La Fortelle

Current traditional methods for LiDAR-camera extrinsics estimation depend on offline targets and human efforts, while learning-based approaches resort to iterative refinement for calibration results, posing constraints on their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shuang Xu , Sifan Zhou , Zhi Tian , Jizhou Ma , Qiong Nie , Xiangxiang Chu

Purely MLP-based neural radiance fields (NeRF-based methods) often suffer from underfitting with blurred renderings on large-scale scenes due to limited model capacity. Recent approaches propose to geographically divide the scene and adopt…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Linning Xu , Yuanbo Xiangli , Sida Peng , Xingang Pan , Nanxuan Zhao , Christian Theobalt , Bo Dai , Dahua Lin

Perception is one of the key abilities of autonomous mobile robotic systems, which often relies on fusion of heterogeneous sensors. Although this heterogeneity presents a challenge for sensor calibration, it is also the main prospect for…

Robotics · Computer Science 2019-04-09 Juraj Peršić , Luka Petrović , Ivan Marković , Ivan Petrović