English
Related papers

Related papers: UniCal: Unified Neural Sensor Calibration

200 papers

This paper introduces a novel self-supervised learning framework for enhancing 3D perception in autonomous driving scenes. Specifically, our approach, namely NCLR, focuses on 2D-3D neural calibration, a novel pretext task that estimates the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Yifan Zhang , Junhui Hou , Siyu Ren , Jinjian Wu , Yixuan Yuan , Guangming Shi

Multi-agent systems, e.g., automobiles and UAVs (Unmanned Ariel Vehicles), rely on the precision of onboard sensors to accurately perceive their environment, which in turn depends on the precision of onboard sensors and reliable in-field…

Signal Processing · Electrical Eng. & Systems 2026-04-23 Bichi Zhang , Holger Caesar , Raj Thilak Rajan

Multi-modal depth estimation is one of the key challenges for endowing autonomous machines with robust robotic perception capabilities. There have been outstanding advances in the development of uni-modal depth estimation techniques based…

Robotics · Computer Science 2023-07-21 Johan S. Obando-Ceron , Victor Romero-Cano , Sildomar Monteiro

Autonomous systems often employ multiple LiDARs to leverage the integrated advantages, enhancing perception and robustness. The most critical prerequisite under this setting is the estimating the extrinsic between each LiDAR, i.e.,…

The demand for multimodal sensing systems for robotics is growing due to the increase in robustness, reliability and accuracy offered by these systems. These systems also need to be spatially and temporally co-registered to be effective. In…

Robotics · Computer Science 2020-01-20 Chanoh Park , Peyman Moghadam , Soohwan Kim , Sridha Sridharan , Clinton Fookes

In view of contemporary panoramic camera-laser scanner system, the traditional calibration method is not suitable for panoramic cameras whose imaging model is extremely nonlinear. The method based on statistical optimization has the…

Computer Vision and Pattern Recognition · Computer Science 2017-09-14 Mingwei Cao , Ming Yang , Chunxiang Wang , Yeqiang Qian , Bing Wang

Self-assembly enables multi-robot systems to merge diverse capabilities and accomplish tasks beyond the reach of individual robots. Incorporating varied docking mechanisms layouts (DMLs) can enhance robot versatility or reduce costs.…

Robotics · Computer Science 2024-01-30 Lianxin Zhang , Yang Jiao , Yihan Huang , Ziyou Wang , Huihuan Qian

Sensor setups consisting of a combination of 3D range scanner lasers and stereo vision systems are becoming a popular choice for on-board perception systems in vehicles; however, the combined use of both sources of information implies a…

Computer Vision and Pattern Recognition · Computer Science 2017-07-28 Carlos Guindel , Jorge Beltrán , David Martín , Fernando García

The rapid development of 3D object detection systems for self-driving cars has significantly improved accuracy. However, these systems struggle to generalize across diverse driving environments, which can lead to safety-critical failures in…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Travis Zhang , Katie Luo , Cheng Perng Phoo , Yurong You , Wei-Lun Chao , Bharath Hariharan , Mark Campbell , Kilian Q. Weinberger

The combination of LiDARs and cameras enables a mobile robot to perceive environments with multi-modal data, becoming a key factor in achieving robust perception. Traditional frame cameras are sensitive to changing illumination conditions,…

Robotics · Computer Science 2023-03-20 Jianhao Jiao , Feiyi Chen , Hexiang Wei , Jin Wu , Ming Liu

LiDAR and camera are two critical sensors for multi-modal 3D semantic segmentation and are supposed to be fused efficiently and robustly to promise safety in various real-world scenarios. However, existing multi-modal methods face two key…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Feng Jiang , Chaoping Tu , Gang Zhang , Jun Li , Hanqing Huang , Junyu Lin , Di Feng , Jian Pu

Robotic calibration allows for the fusion of data from multiple sensors such as odometers, cameras, etc., by providing appropriate transformational relationships between the corresponding reference frames. For wheeled robots equipped with…

Robotics · Computer Science 2020-01-07 Mohan Krishna Nutalapati , Lavish Arora , Anway Bose , Ketan Rajawat , Rajesh M Hegde

Deep neural network (DNN) classifiers are often overconfident, producing miscalibrated class probabilities. In high-risk applications like healthcare, practitioners require $\textit{fully calibrated}$ probability predictions for…

Machine Learning · Statistics 2022-12-09 Zhen Lin , Shubhendu Trivedi , Jimeng Sun

Sensor-based environmental perception is a crucial part of the autonomous driving system. In order to get an excellent perception of the surrounding environment, an intelligent system would configure multiple LiDARs (3D Light Detection and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Pengjin Wei , Guohang Yan , Yikang Li , Kun Fang , Xinyu Cai , Jie Yang , Wei Liu

Accurate 3D object detection is critical for autonomous driving, necessitating reliable, cost-effective sensors capable of operating in adverse weather conditions. Camera and millimeter-wave radar fusion has emerged as a promising solution;…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Bingyi Liu , Chuanhui Zhu , Hongfei Xue , Jian Teng , Jipeng Liu , Enshu Wang , Penglin Dai , Pu Wang

Autonomous Vehicles (AVs) need an accurate and up-to-date representation of the environment for safe navigation. Traditional methods, which often rely on detailed environmental representations constructed offline, struggle in dynamically…

Spatial scene-understanding, including dense depth and ego-motion estimation, is an important problem in computer vision for autonomous vehicles and advanced driver assistance systems. Thus, it is beneficial to design perception modules…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Hemang Chawla , Matti Jukola , Shabbir Marzban , Elahe Arani , Bahram Zonooz

Automated driving systems use multi-modal sensor suites to ensure the reliable, redundant and robust perception of the operating domain, for example camera and LiDAR. An accurate extrinsic calibration is required to fuse the camera and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Jack Borer , Jeremy Tschirner , Florian Ölsner , Stefan Milz

Place recognition is one of the most crucial modules for autonomous vehicles to identify places that were previously visited in GPS-invalid environments. Sensor fusion is considered an effective method to overcome the weaknesses of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zijie Zhou , Jingyi Xu , Guangming Xiong , Junyi Ma

In this paper, a complete framework for Autonomous Self Driving is implemented. LIDAR, Camera and IMU sensors are used together. The entire data communication is managed using Robot Operating System which provides a robust platform for…

Robotics · Computer Science 2022-12-15 Rahul M K , Sumukh B , Praveen L Uppunda , Vinayaka Raju , C Gururaj