English
Related papers

Related papers: Robust sensor fusion against on-vehicle sensor sta…

200 papers

Environmental perception with the multi-modal fusion of radar and camera is crucial in autonomous driving to increase accuracy, completeness, and robustness. This paper focuses on utilizing millimeter-wave (MMW) radar and camera sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Taohua Zhou , Yining Shi , Junjie Chen , Kun Jiang , Mengmeng Yang , Diange Yang

Data scarcity is a bottleneck to machine learning-based perception modules, usually tackled by augmenting real data with synthetic data from simulators. Realistic models of the vehicle perception sensors are hard to formulate in closed…

Image and Video Processing · Electrical Eng. & Systems 2019-12-03 Ahmad El Sallab , Ibrahim Sobh , Mohamed Zahran , Mohamed Shawky

Camera and 3D LiDAR sensors have become indispensable devices in modern autonomous driving vehicles, where the camera provides the fine-grained texture, color information in 2D space and LiDAR captures more precise and farther-away distance…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Lin Zhao , Hui Zhou , Xinge Zhu , Xiao Song , Hongsheng Li , Wenbing Tao

Multi-sensor fusion is crucial for accurate 3D object detection in autonomous driving, with cameras and LiDAR being the most commonly used sensors. However, existing methods perform sensor fusion in a single view by projecting features from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Rohit Mohan , Daniele Cattaneo , Florian Drews , Abhinav Valada

Besides standard cameras, autonomous vehicles typically include multiple additional sensors, such as lidars and radars, which help acquire richer information for perceiving the content of the driving scene. While several recent works focus…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Tim Broedermann , Christos Sakaridis , Dengxin Dai , Luc Van Gool

Most sensor setups for onboard autonomous perception are composed of LiDARs and vision systems, as they provide complementary information that improves the reliability of the different algorithms necessary to obtain a robust scene…

Robotics · Computer Science 2022-03-16 Jorge Beltrán , Carlos Guindel , Arturo de la Escalera , Fernando García

Recent advancements in 3D object detection have benefited from multi-modal information from the multi-view cameras and LiDAR sensors. However, the inherent disparities between the modalities pose substantial challenges. We observe that…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Juhan Cha , Minseok Joo , Jihwan Park , Sanghyeok Lee , Injae Kim , Hyunwoo J. Kim

In recent years, LiDAR-camera fusion models have markedly advanced 3D object detection tasks in autonomous driving. However, their robustness against common weather corruption such as fog, rain, snow, and sunlight in the intricate physical…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Yihao Huang , Kaiyuan Yu , Qing Guo , Felix Juefei-Xu , Xiaojun Jia , Tianlin Li , Geguang Pu , Yang Liu

The perception of autonomous vehicles has to be efficient, robust, and cost-effective. However, cameras are not robust against severe weather conditions, lidar sensors are expensive, and the performance of radar-based perception is still…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Felix Fent , Andras Palffy , Holger Caesar

To navigate through urban roads, an automated vehicle must be able to perceive and recognize objects in a three-dimensional environment. A high-level contextual understanding of the surroundings is necessary to plan and execute accurate…

Robotics · Computer Science 2020-03-05 Julie Stephany Berrio , Mao Shan , Stewart Worrall , James Ward , Eduardo Nebot

Simultaneous localisation and mapping (SLAM) is the problem of autonomous robots to construct or update a map of an undetermined unstructured environment while simultaneously estimate the pose in it. The current trend towards self-driving…

Robotics · Computer Science 2023-02-14 B. Udugama

Realistic vehicle sensor simulation is an important element in developing autonomous driving. As physics-based implementations of visual sensors like LiDAR are complex in practice, data-based approaches promise solutions. Using pairs of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Richard Marcus , Felix Gabel , Niklas Knoop , Marc Stamminger

Recent advancements in perception for autonomous driving are driven by deep learning. In order to achieve robust and accurate scene understanding, autonomous vehicles are usually equipped with different sensors (e.g. cameras, LiDARs,…

The core task of any autonomous driving system is to transform sensory inputs into driving commands. In end-to-end driving, this is achieved via a neural network, with one or multiple cameras as the most commonly used input and low-level…

Artificial Intelligence · Computer Science 2022-07-01 Ardi Tampuu , Romet Aidla , Jan Are van Gent , Tambet Matiisen

Most autonomous vehicles are equipped with LiDAR sensors and stereo cameras. The former is very accurate but generates sparse data, whereas the latter is dense, has rich texture and color information but difficult to extract robust 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Farzin Negahbani , Onur Berk Töre , Fatma Güney , Baris Akgun

We present a system for the boresighting of sensors using inertial measurement devices as the basis for developing a range of dynamic real-time sensor fusion applications. The proof of concept utilizes a COTS FPGA platform for sensor fusion…

Hardware Architecture · Computer Science 2011-11-09 Steve Chappell , Alistair Macarthur , Dan Preston , Dave Olmstead , Bob Flint , Chris Sullivan

In the autonomous driving domain, data collection and annotation from real vehicles are expensive and sometimes unsafe. Simulators are often used for data augmentation, which requires realistic sensor models that are hard to formulate and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Ahmad El Sallab , Ibrahim Sobh , Mohamed Zahran , Nader Essam

Accurate perception of dynamic obstacles is essential for autonomous robot navigation in indoor environments. Although sophisticated 3D object detection and tracking methods have been investigated and developed thoroughly in the fields of…

Robotics · Computer Science 2025-03-03 Zhefan Xu , Haoyu Shen , Xinming Han , Hanyu Jin , Kanlong Ye , Kenji Shimada

Accurate 3D object detection is critical for autonomous driving, necessitating reliable, cost-effective sensors capable of operating in adverse weather conditions. Camera and millimeter-wave radar fusion has emerged as a promising solution;…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Bingyi Liu , Chuanhui Zhu , Hongfei Xue , Jian Teng , Jipeng Liu , Enshu Wang , Penglin Dai , Pu Wang

Event cameras, inspired by biological vision, are asynchronous sensors that detect changes in brightness, offering notable advantages in environments characterized by high-speed motion, low lighting, or wide dynamic range. These distinctive…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Jiaqiang Zhang , Xianjia Yu , Ha Sier , Haizhou Zhang , Tomi Westerlund