English
Related papers

Related papers: Decisive Data using Multi-Modality Optical Sensors…

200 papers

Autonomous driving sensors generate an enormous amount of data. In this paper, we explore learned multimodal compression for autonomous driving, specifically targeted at 3D object detection. We focus on camera and LiDAR modalities and…

Image and Video Processing · Electrical Eng. & Systems 2024-08-16 Hadi Hadizadeh , Ivan V. Bajić

World models for autonomous driving have the potential to dramatically improve the reasoning capabilities of today's systems. However, most works focus on camera data, with only a few that leverage lidar data or combine both to better…

Machine Learning · Computer Science 2025-08-21 Daniel Bogdoll , Yitian Yang , Tim Joseph , Melih Yazgan , J. Marius Zöllner

In the typical urban intersection scenario, both vehicles and infrastructures are equipped with visual and LiDAR sensors. By successfully integrating the data from vehicle-side and road monitoring devices, a more comprehensive and accurate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Xinyu Zhang , Yijin Xiong , Qianxin Qu , Renjie Wang , Xin Gao , Jing Liu , Shichun Guo , Jun Li

Sensor fusion is crucial for an accurate and robust perception system on autonomous vehicles. Most existing datasets and perception solutions focus on fusing cameras and LiDAR. However, the collaboration between camera and radar is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Yizhou Wang , Jen-Hao Cheng , Jui-Te Huang , Sheng-Yao Kuan , Qiqian Fu , Chiming Ni , Shengyu Hao , Gaoang Wang , Guanbin Xing , Hui Liu , Jenq-Neng Hwang

We present a review of 3D point cloud processing and learning for autonomous driving. As one of the most important sensors in autonomous vehicles, light detection and ranging (LiDAR) sensors collect 3D point clouds that precisely record the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Siheng Chen , Baoan Liu , Chen Feng , Carlos Vallespi-Gonzalez , Carl Wellington

In this paper, we present a dataset capturing diverse visual data formats that target varying luminance conditions. While RGB cameras provide nourishing and intuitive information, changes in lighting conditions potentially result in…

Robotics · Computer Science 2022-04-15 Alex Junho Lee , Younggun Cho , Young-sik Shin , Ayoung Kim , Hyun Myung

Deep learning-based detection networks have made remarkable progress in autonomous driving systems (ADS). ADS should have reliable performance across a variety of ambient lighting and adverse weather conditions. However, luminance…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Shruthi Gowda , Bahram Zonooz , Elahe Arani

Visible images have been widely used for motion estimation. Thermal images, in contrast, are more challenging to be used in motion estimation since they typically have lower resolution, less texture, and more noise. In this paper, a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Weichen Dai , Yu Zhang , Shenzhou Chen , Donglei Sun , Da Kong

LiDAR (laser based radar) systems are a major part of many new real-world interactive systems, one of the most notable being autonomous cars. The current market LiDAR systems are limited by detector sensitivity: when output power is at…

Signal Processing · Electrical Eng. & Systems 2018-02-27 Yoni Sher , Lior Cohen , Daniel Istrati , Hagai S. Eisenberg

Radars, due to their robustness to adverse weather conditions and ability to measure object motions, have served in autonomous driving and intelligent agents for years. However, Radar-based perception suffers from its unintuitive sensing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Liu Liu , Shuaifeng Zhi , Zhenhua Du , Li Liu , Xinyu Zhang , Kai Huo , Weidong Jiang

Autonomous robots that assist humans in day to day living tasks are becoming increasingly popular. Autonomous mobile robots operate by sensing and perceiving their surrounding environment to make accurate driving decisions. A combination of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Varuna De Silva , Jamie Roche , Ahmet Kondoz

Traffic incidents involving vulnerable road users (VRUs) constitute a significant proportion of global road accidents. Advances in traffic communication ecosystems, coupled with sophisticated signal processing and machine learning…

Reliable perception remains a key challenge for Connected Automated Vehicles (CAVs) in complex real-world environments, where varying lighting conditions and adverse weather degrade sensing performance. While existing multi-sensor solutions…

In-vehicle sensing technology has gained tremendous attention due to its ability to support major technological developments, such as connected vehicles and self-driving cars. In-vehicle sensing data are invaluable and important data…

There are two critical sensors for 3D perception in autonomous driving, the camera and the LiDAR. The camera provides rich semantic information such as color, texture, and the LiDAR reflects the 3D shape and locations of surrounding…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Kaicheng Yu , Tang Tao , Hongwei Xie , Zhiwei Lin , Zhongwei Wu , Zhongyu Xia , Tingting Liang , Haiyang Sun , Jiong Deng , Dayang Hao , Yongtao Wang , Xiaodan Liang , Bing Wang

In recent years, multi-modal fusion has attracted a lot of research interest, both in academia, and in industry. Multimodal fusion entails the combination of information from a set of different types of sensors. Exploiting complementary…

Machine Learning · Computer Science 2020-08-27 Siddharth Roheda , Hamid Krim , Benjamin S. Riggan

This paper describes how advanced deep learning based computer vision algorithms are applied to enable real-time on-board sensor processing for small UAVs. Four use cases are considered: target detection, classification and localization,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Alessandro Palmas , Pietro Andronico

Object detection plays a critical role in autonomous driving, where accurately and efficiently detecting objects in fast-moving scenes is crucial. Traditional frame-based cameras face challenges in balancing latency and bandwidth,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Bingquan Zhou , Jie Jiang

For vehicle autonomy, driver assistance and situational awareness, it is necessary to operate at day and night, and in all weather conditions. In particular, long wave infrared (LWIR) sensors that receive predominantly emitted radiation…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Marcel Sheeny , Andrew Wallace , Mehryar Emambakhsh , Sen Wang , Barry Connor

Vehicle odometry is an essential component of an automated driving system as it computes the vehicle's position and orientation. The odometry module has a higher demand and impact in urban areas where the global navigation satellite system…

Robotics · Computer Science 2021-09-14 Nikhil Jonnavithula , Yecheng Lyu , Ziming Zhang