English
Related papers

Related papers: CalibDNN: Multimodal Sensor Calibration for Percep…

200 papers

Calibrating deep neural models plays an important role in building reliable, robust AI systems in safety-critical applications. Recent work has shown that modern neural networks that possess high predictive capability are poorly calibrated…

Machine Learning · Computer Science 2025-09-16 Cheng Wang

Sensor fusion has become a popular topic in robotics. However, conventional fusion methods encounter many difficulties, such as data representation differences, sensor variations, and extrinsic calibration. For example, the calibration…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Shuyi Zhou , Shuxiang Xie , Ryoichi Ishikawa , Ken Sakurada , Masaki Onishi , Takeshi Oishi

We present a novel multi-modal extrinsic calibration framework designed to simultaneously estimate the relative poses between event cameras, LiDARs, and RGB cameras, with particular focus on the challenging event camera calibration. Core of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Andrea Bertogalli , Giacomo Boracchi , Luca Magri

In this paper we perform an experimental comparison of three different target based 3D-LIDAR camera calibration algorithms. We briefly elucidate the mathematical background behind each method and provide insights into practical aspects like…

Robotics · Computer Science 2020-07-07 Subodh Mishra , Philip R. Osteen , Gaurav Pandey , Srikanth Saripalli

Chemical multisensor devices need calibration algorithms to estimate gas concentrations. Their possible adoption as indicative air quality measurements devices poses new challenges due to the need to operate in continuous monitoring modes…

Artificial Intelligence · Computer Science 2020-02-14 S. De Vito , E. Esposito , M. Salvato , O. Popoola , F. Formisano , R. Jones , G. Di Francia

Sensor setups consisting of a combination of 3D range scanner lasers and stereo vision systems are becoming a popular choice for on-board perception systems in vehicles; however, the combined use of both sources of information implies a…

Computer Vision and Pattern Recognition · Computer Science 2017-07-28 Carlos Guindel , Jorge Beltrán , David Martín , Fernando García

Accurate LiDAR-camera calibration is crucial for multi-sensor systems. However, traditional methods often rely on physical targets, which are impractical for real-world deployment. Moreover, even carefully calibrated extrinsics can degrade…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Haebeom Jung , Namtae Kim , Jungwoo Kim , Jaesik Park

Cameras and 2D laser scanners, in combination, are able to provide low-cost, light-weight and accurate solutions, which make their fusion well-suited for many robot navigation tasks. However, correct data fusion depends on precise…

Robotics · Computer Science 2019-08-02 Michelle Valente , Cyril Joly , Arnaud de La Fortelle

Multimodal sensor fusion methods for 3D object detection have been revolutionizing the autonomous driving research field. Nevertheless, most of these methods heavily rely on dense LiDAR data and accurately calibrated sensors which is often…

Robotics · Computer Science 2023-06-14 Maciej K. Wozniak , Viktor Karefjards , Marko Thiel , Patric Jensfelt

Robust semantic perception for autonomous vehicles relies on effectively combining multiple sensors with complementary strengths and weaknesses. State-of-the-art sensor fusion approaches to semantic perception often treat sensor data…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Tim Broedermannn , Christos Sakaridis , Luigi Piccinelli , Wim Abbeloos , Luc Van Gool

Deep neural network (DNN) classifiers are often overconfident, producing miscalibrated class probabilities. In high-risk applications like healthcare, practitioners require $\textit{fully calibrated}$ probability predictions for…

Machine Learning · Statistics 2022-12-09 Zhen Lin , Shubhendu Trivedi , Jimeng Sun

Sensor fusion is essential for autonomous driving and autonomous robots, and radar-camera fusion systems have gained popularity due to their complementary sensing capabilities. However, accurate calibration between these two sensors is…

Robotics · Computer Science 2024-01-26 Lei Cheng , Siyang Cao

With the recent advances in autonomous driving and the decreasing cost of LiDARs, the use of multimodal sensor systems is on the rise. However, in order to make use of the information provided by a variety of complimentary sensors, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Quentin Herau , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou , Cyrille Migniot , Pascal Vasseur , Cédric Demonceaux

The unique cost, flexibility, speed, and efficiency of modern UAVs make them an attractive choice in many applications in contemporary society. This, however, causes an ever-increasing number of reported malicious or accidental incidents,…

Artificial Intelligence · Computer Science 2024-10-22 Nikos Sakellariou , Antonios Lalas , Konstantinos Votis , Dimitrios Tzovaras

Functional near-infrared spectroscopy (fNIRS) is a valuable non-invasive tool for monitoring brain activity. The classification of fNIRS data in relation to conscious activity holds significance for advancing our understanding of the brain…

Machine Learning · Computer Science 2024-11-25 Zhihao Cao , Zizhou Luo

This paper presents a novel deep neural network (DNN) for multimodal fusion of audio, video and text modalities for emotion recognition. The proposed DNN architecture has independent and shared layers which aim to learn the representation…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Juan D. S. Ortega , Mohammed Senoussaoui , Eric Granger , Marco Pedersoli , Patrick Cardinal , Alessandro L. Koerich

Convolutional neural networks (CNNs) have become increasingly popular for solving a variety of computer vision tasks, ranging from image classification to image segmentation. Recently, autonomous vehicles have created a demand for depth…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Paden Tomasello , Sammy Sidhu , Anting Shen , Matthew W. Moskewicz , Nobie Redmon , Gayatri Joshi , Romi Phadte , Paras Jain , Forrest Iandola

In the typical urban intersection scenario, both vehicles and infrastructures are equipped with visual and LiDAR sensors. By successfully integrating the data from vehicle-side and road monitoring devices, a more comprehensive and accurate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Xinyu Zhang , Yijin Xiong , Qianxin Qu , Renjie Wang , Xin Gao , Jing Liu , Shichun Guo , Jun Li

Reliable uncertainty estimation is crucial for perception systems in safe autonomous driving. Recently, many methods have been proposed to model uncertainties in deep learning based object detectors. However, the estimated probabilities are…

Robotics · Computer Science 2019-09-30 Di Feng , Lars Rosenbaum , Claudius Glaeser , Fabian Timm , Klaus Dietmayer

Current traditional methods for LiDAR-camera extrinsics estimation depend on offline targets and human efforts, while learning-based approaches resort to iterative refinement for calibration results, posing constraints on their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shuang Xu , Sifan Zhou , Zhi Tian , Jizhou Ma , Qiong Nie , Xiangxiang Chu