English
Related papers

Related papers: Multi-modal Sensor Registration for Vehicle Percep…

200 papers

Modern autonomous driving perception systems utilize complementary multi-modal sensors, such as LiDAR and cameras. Although sensor fusion architectures enhance performance in challenging environments, they still suffer significant…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Konyul Park , Yecheol Kim , Daehun Kim , Jun Won Choi

Efficient data utilization is crucial for advancing 3D scene understanding in autonomous driving, where reliance on heavily human-annotated LiDAR point clouds challenges fully supervised methods. Addressing this, our study extends into…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Lingdong Kong , Xiang Xu , Jiawei Ren , Wenwei Zhang , Liang Pan , Kai Chen , Wei Tsang Ooi , Ziwei Liu

LiDAR and camera are two important sensors for 3D object detection in autonomous driving. Despite the increasing popularity of sensor fusion in this field, the robustness against inferior image conditions, e.g., bad illumination and sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xuyang Bai , Zeyu Hu , Xinge Zhu , Qingqiu Huang , Yilun Chen , Hongbo Fu , Chiew-Lan Tai

Perception sensors, particularly camera and Lidar, are key elements of Autonomous Driving Systems (ADS) that enable them to comprehend their surroundings to informed driving and control decisions. Therefore, developing realistic simulation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Hamed Haghighi , Xiaomeng Wang , Hao Jing , Mehrdad Dianati

Accurate 3D object detection for autonomous driving requires complementary sensors. Cameras provide dense semantics but unreliable depth, while millimeter-wave radar offers precise range and velocity measurements with sparse geometry. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Mayank Mayank , Bharanidhar Duraisamy , Florian Geiß , Abhinav Valada

In recent years, Deep Learning has been successfully applied to multimodal learning problems, with the aim of learning useful joint representations in data fusion applications. When the available modalities consist of time series data such…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Xitong Yang , Palghat Ramesh , Radha Chitta , Sriganesh Madhvanath , Edgar A. Bernal , Jiebo Luo

Optical sensors have played a pivotal role in acquiring real world data for critical applications. This data, when integrated with advanced machine learning algorithms provides meaningful information thus enhancing human vision. This paper…

Neural and Evolutionary Computing · Computer Science 2023-07-26 Muhammad Ali Farooq , Waseem Shariff , Mehdi Sefidgar Dilmaghani , Wang Yao , Moazam Soomro , Peter Corcoran

We propose a method for automated synchronization of vehicle sensors useful for the study of multi-modal driver behavior and for the design of advanced driver assistance systems. Multi-sensor decision fusion relies on synchronized data…

Robotics · Computer Science 2016-03-02 Lex Fridman , Daniel E Brown , William Angell , Irman Abdić , Bryan Reimer , Hae Young Noh

Many, if not most, systems of interest in science are naturally described as nonlinear dynamical systems. Empirically, we commonly access these systems through time series measurements. Often such time series may consist of discrete random…

Machine Learning · Computer Science 2024-06-10 Manuel Brenner , Florian Hess , Georgia Koppe , Daniel Durstewitz

Accurate positioning is known to be a fundamental requirement for the deployment of Connected Automated Vehicles (CAVs). To meet this need, a new emerging trend is represented by cooperative methods where vehicles fuse information coming…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Luca Barbieri , Bernardo Camajori Tedeschini , Mattia Brambilla , Monica Nicoli

Soft robots are typically approximated as low-dimensional systems, especially when learning-based methods are used. This leads to models that are limited in their capability to predict the large number of deformation modes and interactions…

Robotics · Computer Science 2022-05-10 Thomas George Thuruthel , Fumiya Iida

High-resolution radar sensors are able to resolve multiple detections per object and therefore provide valuable information for vehicle environment perception. For instance, multiple detections allow to infer the size of an object or to…

Signal Processing · Electrical Eng. & Systems 2019-10-29 Alexander Scheel , Klaus Dietmayer

Rigid registration aims to determine the translations and rotations necessary to align features in a pair of images. While recent machine learning methods have become state-of-the-art for linear and deformable registration across subjects,…

Image and Video Processing · Electrical Eng. & Systems 2025-12-08 Jingru Fu , Adrian V. Dalca , Bruce Fischl , Rodrigo Moreno , Malte Hoffmann

Autonomous driving is challenging in adverse road and weather conditions in which there might not be lane lines, the road might be covered in snow and the visibility might be poor. We extend the previous work on end-to-end learning for…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Jyri Maanpää , Josef Taher , Petri Manninen , Leo Pakola , Iaroslav Melekhov , Juha Hyyppä

LiDAR and camera are two critical sensors for multi-modal 3D semantic segmentation and are supposed to be fused efficiently and robustly to promise safety in various real-world scenarios. However, existing multi-modal methods face two key…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Feng Jiang , Chaoping Tu , Gang Zhang , Jun Li , Hanqing Huang , Junyu Lin , Di Feng , Jian Pu

Modeling dynamical systems is important in many disciplines, e.g., control, robotics, or neurotechnology. Commonly the state of these systems is not directly observed, but only available through noisy and potentially high-dimensional…

Machine Learning · Statistics 2014-10-29 Niklas Wahlström , Thomas B. Schön , Marc Peter Deisenroth

Deep learning-based intelligent vehicle perception has been developing prominently in recent years to provide a reliable source for motion planning and decision making in autonomous driving. A large number of powerful deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Xinyu Liu , Jinlong Li , Jin Ma , Huiming Sun , Zhigang Xu , Tianyun Zhang , Hongkai Yu

Today's autonomous vehicles rely extensively on high-definition 3D maps to navigate the environment. While this approach works well when these maps are completely up-to-date, safe autonomous vehicles must be able to corroborate the map's…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Ari Seff , Jianxiong Xiao

The success of re-localisation has crucial implications for the practical deployment of robots operating within a prior map or relative to one another in real-world scenarios. Using single-modality, place recognition and localisation can be…

Robotics · Computer Science 2023-07-27 Milad Ramezani , Ethan Griffiths , Maryam Haghighat , Alex Pitt , Peyman Moghadam

Building a multi-modality multi-task neural network toward accurate and robust performance is a de-facto standard in perception task of autonomous driving. However, leveraging such data from multiple sensors to jointly optimize the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Tengju Ye , Wei Jing , Chunyong Hu , Shikun Huang , Lingping Gao , Fangzhen Li , Jingke Wang , Ke Guo , Wencong Xiao , Weibo Mao , Hang Zheng , Kun Li , Junbo Chen , Kaicheng Yu