English
Related papers

Related papers: MIPD: A Multi-sensory Interactive Perception Datas…

200 papers

Autonomous systems have advanced significantly, but challenges persist in accident-prone environments where robust decision-making is crucial. A single vehicle's limited sensor range and obstructed views increase the likelihood of…

Artificial Intelligence · Computer Science 2025-09-24 Rui Liu , Zikang Wang , Peng Gao , Yu Shen , Pratap Tokekar , Ming Lin

Vision-language models enable the understanding and reasoning of complex traffic scenarios through multi-source information fusion, establishing it as a core technology for autonomous driving. However, existing vision-language models are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Minghui Hou , Wei-Hsing Huang , Shaofeng Liang , Daizong Liu , Tai-Hao Wen , Gang Wang , Runwei Guan , Weiping Ding

While several datasets for autonomous navigation have become available in recent years, they tend to focus on structured driving environments. This usually corresponds to well-delineated infrastructure such as lanes, a small number of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Girish Varma , Anbumani Subramanian , Anoop Namboodiri , Manmohan Chandraker , C V Jawahar

Navigating dense and dynamic environments poses a significant challenge for autonomous driving systems, owing to the intricate nature of multimodal interaction, wherein the actions of various traffic participants and the autonomous vehicle…

Robotics · Computer Science 2024-08-29 Tong Li , Lu Zhang , Sikang Liu , Shaojie Shen

Robust perception is critical for autonomous driving, especially under adverse weather and lighting conditions that commonly occur in real-world environments. In this paper, we introduce the Stereo Image Dataset (SID), a large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zaid A. El-Shair , Abdalmalek Abu-raddaha , Aaron Cofield , Hisham Alawneh , Mohamed Aladem , Yazan Hamzeh , Samir A. Rawashdeh

Building a multi-modality multi-task neural network toward accurate and robust performance is a de-facto standard in perception task of autonomous driving. However, leveraging such data from multiple sensors to jointly optimize the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Tengju Ye , Wei Jing , Chunyong Hu , Shikun Huang , Lingping Gao , Fangzhen Li , Jingke Wang , Ke Guo , Wencong Xiao , Weibo Mao , Hang Zheng , Kun Li , Junbo Chen , Kaicheng Yu

Inner-city intersections are among the most critical traffic areas for injury and fatal accidents. Automated vehicles struggle with the complex and hectic everyday life within those areas. Sensor-equipped smart infrastructures, which can…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Manuel Hetzel , Hannes Reichert , Günther Reitberger , Erich Fuchs , Konrad Doll , Bernhard Sick

The accelerating development of autonomous driving technology has placed greater demands on obtaining large amounts of high-quality data. Representative, labeled, real world data serves as the fuel for training deep learning networks,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Pengchuan Xiao , Zhenlei Shao , Steven Hao , Zishuo Zhang , Xiaolin Chai , Judy Jiao , Zesong Li , Jian Wu , Kai Sun , Kun Jiang , Yunlong Wang , Diange Yang

Autonomous driving has now made great strides thanks to artificial intelligence, and numerous advanced methods have been proposed for vehicle end target detection, including single sensor or multi sensor detection methods. However, the…

Robotics · Computer Science 2023-06-13 Xiuyu Yang , Zhuangyan Zhang , Haikuo Du , Sui Yang , Fengping Sun , Yanbo Liu , Ling Pei , Wenchao Xu , Weiqi Sun , Zhengyu Li

Inspired by the fact that humans use diverse sensory organs to perceive the world, sensors with different modalities are deployed in end-to-end driving to obtain the global context of the 3D scene. In previous works, camera and LiDAR inputs…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Qingwen Zhang , Mingkai Tang , Ruoyu Geng , Feiyi Chen , Ren Xin , Lujia Wang

Due to the high complexity and occlusion, insufficient perception in the crowded urban intersection can be a serious safety risk for both human drivers and autonomous algorithms, whereas CVIS (Cooperative Vehicle Infrastructure System) is a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Huanan Wang , Xinyu Zhang , Jun Li , Zhiwei Li , Lei Yang , Shuyue Pan , Yongqiang Deng

Autonomous driving and assistance systems rely on annotated data from traffic and road scenarios to model and learn the various object relations in complex real-world scenarios. Preparation and training of deploy-able deep learning…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Shubham Dokania , A. H. Abdul Hafez , Anbumani Subramanian , Manmohan Chandraker , C. V. Jawahar

Multi-modal fusion is a basic task of autonomous driving system perception, which has attracted many scholars' interest in recent years. The current multi-modal fusion methods mainly focus on camera data and LiDAR data, but pay little…

Robotics · Computer Science 2022-11-14 Yan Gong , Jianli Lu , Jiayi Wu , Wenzhuo Liu

The perception module of self-driving vehicles relies on a multi-sensor system to understand its environment. Recent advancements in deep learning have led to the rapid development of approaches that integrate multi-sensory measurements to…

Robotics · Computer Science 2023-07-14 Xi Zhu , Likang Wang , Caifa Zhou , Xiya Cao , Yue Gong , Lei Chen

Robust semantic perception for autonomous vehicles relies on effectively combining multiple sensors with complementary strengths and weaknesses. State-of-the-art sensor fusion approaches to semantic perception often treat sensor data…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Tim Broedermannn , Christos Sakaridis , Luigi Piccinelli , Wim Abbeloos , Luc Van Gool

A smart vehicle should be able to monitor the actions and behaviors of the human driver to provide critical warnings or intervene when necessary. Recent advancements in deep learning and computer vision have shown great promise in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Sumit Jha , Mohamed F. Marzban , Tiancheng Hu , Mohamed H. Mahmoud , Naofal Al-Dhahir , Carlos Busso

Large-scale deployment of autonomous vehicles has been continually delayed due to safety concerns. On the one hand, comprehensive scene understanding is indispensable, a lack of which would result in vulnerability to rare but complex…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Hao Shao , Letian Wang , RuoBing Chen , Hongsheng Li , Yu Liu

Autonomous driving technology has advanced significantly, yet detecting driving anomalies remains a major challenge due to the long-tailed distribution of driving events. Existing methods primarily rely on single-modal road condition video…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Long Zhouxiang , Ovanes Petrosian

Ensuring traffic safety and mitigating accidents in modern driving is of paramount importance, and computer vision technologies have the potential to significantly contribute to this goal. This paper presents a multi-modal Vision…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yunsheng Ma , Ziran Wang

Existing datasets for autonomous driving (AD) often lack diversity and long-range capabilities, focusing instead on 360{\deg} perception and temporal reasoning. To address this gap, we introduce Zenseact Open Dataset (ZOD), a large-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Mina Alibeigi , William Ljungbergh , Adam Tonderski , Georg Hess , Adam Lilja , Carl Lindstrom , Daria Motorniuk , Junsheng Fu , Jenny Widahl , Christoffer Petersson