English
Related papers

Related papers: What Really Matters for Learning-based LiDAR-Camer…

200 papers

Miscalibration - a mismatch between a model's confidence and its correctness - of Deep Neural Networks (DNNs) makes their predictions hard to rely on. Ideally, we want networks to be accurate, calibrated and confident. We show that, as…

Machine Learning · Computer Science 2020-10-27 Jishnu Mukhoti , Viveka Kulharia , Amartya Sanyal , Stuart Golodetz , Philip H. S. Torr , Puneet K. Dokania

LiDAR semantic segmentation provides 3D semantic information about the environment, an essential cue for intelligent systems during their decision making processes. Deep neural networks are achieving state-of-the-art results on large public…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Inigo Alonso , Luis Riazuelo , Luis Montesano , Ana C. Murillo

Response calibration is the process of inferring how much the measured data depend on the signal one is interested in. It is essential for any quantitative signal estimation on the basis of the data. Here, we investigate self-calibration…

Instrumentation and Methods for Astrophysics · Physics 2015-06-18 Torsten A. Enßlin , Henrik Junklewitz , Lars Winderling , Maksim Greiner , Marco Selig

Depth perception is considered an invaluable source of information in the context of 3D mapping and various robotics applications. However, point cloud maps acquired using consumer-level light detection and ranging sensors (lidars) still…

Robotics · Computer Science 2024-05-24 Ruslan Agishev , Tomáš Pětříček , Karel Zimmermann

Accurate camera calibration is a fundamental task for 3D perception, especially when dealing with real-world, in-the-wild environments where complex optical distortions are common. Existing methods often rely on pre-rectified images or…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Liuyue Xie , Jiancong Guo , Ozan Cakmakci , Andre Araujo , Laszlo A. Jeni , Zhiheng Jia

Eye-in-hand camera calibration is a fundamental and long-studied problem in robotics. We present a study on using learning-based methods for solving this problem online from a single RGB image, whilst training our models with entirely…

Robotics · Computer Science 2021-11-05 Eugene Valassakis , Kamil Dreczkowski , Edward Johns

With model trustworthiness being crucial for sensitive real-world applications, practitioners are putting more and more focus on improving the uncertainty calibration of deep neural networks. Calibration errors are designed to quantify the…

Machine Learning · Computer Science 2024-03-14 Sebastian G. Gruber , Florian Buettner

Accurate camera calibration is a precondition for many computer vision applications. Calibration errors, such as wrong model assumptions or imprecise parameter estimation, can deteriorate a system's overall performance, making the reliable…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Annika Hagemann , Moritz Knorr , Holger Janssen , Christoph Stiller

Diffusion models (DMs) excel in photo-realistic image synthesis, but their adaptation to LiDAR scene generation poses a substantial hurdle. This is primarily because DMs operating in the point space struggle to preserve the curve-like…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Haoxi Ran , Vitor Guizilini , Yue Wang

The demand for multimodal sensing systems for robotics is growing due to the increase in robustness, reliability and accuracy offered by these systems. These systems also need to be spatially and temporally co-registered to be effective. In…

Robotics · Computer Science 2020-01-20 Chanoh Park , Peyman Moghadam , Soohwan Kim , Sridha Sridharan , Clinton Fookes

An automated vehicle operating in an urban environment must be able to perceive and recognise object/obstacles in a three-dimensional world while navigating in a constantly changing environment. In order to plan and execute accurate…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Julie Stephany Berrio , Mao Shan , Stewart Worrall , Eduardo Nebot

In the context of computer models, calibration is the process of estimating unknown simulator parameters from observational data. Calibration is variously referred to as model fitting, parameter estimation/inference, an inverse problem, and…

Methodology · Statistics 2023-10-16 Richard D. Wilkinson , Christopher W. Lanyon

This paper proposes SemCal: an automatic, targetless, extrinsic calibration algorithm for a LiDAR and camera system using semantic information. We leverage a neural information estimator to estimate the mutual information (MI) of semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Peng Jiang , Philip Osteen , Srikanth Saripalli

This paper presents a novel indoor layout estimation system based on the fusion of 2D LiDAR and intensity camera data. A ground robot explores an indoor space with a single floor and vertical walls, and collects a sequence of intensity…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Jieyu Li , Robert Stevenson

Accurate extrinsic calibration between LiDAR and camera sensors is important for reliable perception in autonomous systems. In this paper, we present a novel multi-objective optimization framework that jointly minimizes the geometric…

Robotics · Computer Science 2025-06-26 Venkat Karramreddy , Rangarajan Ramanujam

Accurate spatiotemporal calibration is a prerequisite for multisensor fusion. However, sensors are typically asynchronous, and there is no overlap between the fields of view of cameras and LiDARs, posing challenges for intrinsic and…

Robotics · Computer Science 2025-01-07 Yuezhang Lv , Yunzhou Zhang , Chao Lu , Jiajun Zhu , Song Wu

The combination of LiDAR and camera modalities is proven to be necessary and typical for 3D object detection according to recent studies. Existing fusion strategies tend to overly rely on the LiDAR modal in essence, which exploits the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Yang Yang , Weijie Ma , Hao Chen , Linlin Ou , Xinyi Yu

Camera calibration is an important prerequisite towards the solution of 3D computer vision problems. Traditional methods rely on static images of a calibration pattern. This raises interesting challenges towards the practical usage of event…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Kun Huang , Yifu Wang , Laurent Kneip

In autonomous systems, sensor calibration is essential for safe and efficient navigation in dynamic environments. Accurate calibration is a prerequisite for reliable perception and planning tasks such as object detection and obstacle…

Robotics · Computer Science 2026-02-02 Ilir Tahiraj , Markus Edinger , Dominik Kulmer , Markus Lienkamp

Reliable uncertainty estimation is crucial for perception systems in safe autonomous driving. Recently, many methods have been proposed to model uncertainties in deep learning based object detectors. However, the estimated probabilities are…

Robotics · Computer Science 2019-09-30 Di Feng , Lars Rosenbaum , Claudius Glaeser , Fabian Timm , Klaus Dietmayer