English
Related papers

Related papers: Where, What, Why: Towards Explainable Driver Atten…

200 papers

Autonomous driving (AD) systems are becoming increasingly capable of handling complex tasks, mainly due to recent advances in deep learning and AI. As interactions between autonomous systems and humans increase, the interpretability of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Mukilan Karuppasamy , Shankar Gangisetty , Shyam Nandan Rai , Carlo Masone , C V Jawahar

Deep learning (DL) based computer vision (CV) models are generally considered as black boxes due to poor interpretability. This limitation impedes efficient diagnoses or predictions of system failure, thereby precluding the widespread…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Sikai Chen , Jiqian Dong , Runjia Du , Yujie Li , Samuel Labi

Robustly predicting attention regions of interest for self-driving systems is crucial for driving safety but presents significant challenges due to the labor-intensive nature of obtaining large-scale attention labels and the domain gap…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Mengshi Qi , Xiaoyang Bi , Pengfei Zhu , Huadong Ma

Deep neural perception and control networks are likely to be a key component of self-driving vehicles. These models need to be explainable - they should provide easy-to-interpret rationales for their behavior - so that passengers, insurance…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Jinkyu Kim , John Canny

Driver distraction a significant risk to driving safety. Apart from spatial domain, research on temporal inattention is also necessary. This paper aims to figure out the pattern of drivers' temporal attention allocation. In this paper, we…

Machine Learning · Computer Science 2020-06-09 Xingbo Fu , Feng Gao , Jiang Wu

Despite the advent of autonomous cars, it's likely - at least in the near future - that human attention will still maintain a central role as a guarantee in terms of legal responsibility during the driving task. In this paper we study the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Andrea Palazzi , Francesco Solera , Simone Calderara , Stefano Alletto , Rita Cucchiara

Accurately forecasting the future movements of surrounding vehicles is essential for safe and efficient operations of autonomous driving cars. This task is difficult because a vehicle's moving trajectory is greatly determined by its…

Machine Learning · Computer Science 2021-01-15 Jiacheng Pan , Hongyi Sun , Kecheng Xu , Yifei Jiang , Xiangquan Xiao , Jiangtao Hu , Jinghao Miao

The rapid progress of multimodal large language models (MLLM) has paved the way for Vision-Language-Action (VLA) paradigms, which integrate visual perception, natural language understanding, and control within a single policy. Researchers…

Large vision-language models (VLMs) have garnered increasing interest in autonomous driving areas, due to their advanced capabilities in complex reasoning tasks essential for highly autonomous vehicle behavior. Despite their potential,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ming Nie , Renyuan Peng , Chunwei Wang , Xinyue Cai , Jianhua Han , Hang Xu , Li Zhang

Vision-Language-Action (VLA) models have recently attracted growing attention in end-to-end autonomous driving for their strong reasoning capabilities and rich world knowledge. However, existing VLAs often suffer from limited numerical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhaohui Wang , Tengbo Yu , Hao Tang

Driving is a routine activity for many, but it is far from simple. Drivers deal with multiple concurrent tasks, such as keeping the vehicle in the lane, observing and anticipating the actions of other road users, reacting to hazards, and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Iuliia Kotseruba , John K. Tsotsos

To ensure safe driving in dynamic environments, autonomous vehicles should possess the capability to accurately predict lane change intentions of surrounding vehicles in advance and forecast their future trajectories. Existing motion…

Artificial Intelligence · Computer Science 2026-01-19 Mingxing Peng , Xusen Guo , Xianda Chen , Meixin Zhu , Kehua Chen

Predicting driver attention is a critical problem for developing explainable autonomous driving systems and understanding driver behavior in mixed human-autonomous vehicle traffic scenarios. Although significant progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Shreedhar Govil , Didier Stricker , Jason Rambach

Autonomous driving is a multi-task problem requiring a deep understanding of the visual environment. End-to-end autonomous systems have attracted increasing interest as a method of learning to drive without exhaustively programming…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Alexander Makrigiorgos , Ali Shafti , Alex Harston , Julien Gerard , A. Aldo Faisal

A self-driving vehicle must understand its environment to determine the appropriate action. Traditional autonomy systems rely on object detection to find the agents in the scene. However, object detection assumes a discrete set of objects…

Robotics · Computer Science 2024-04-03 Sourav Biswas , Sergio Casas , Quinlan Sykora , Ben Agro , Abbas Sadat , Raquel Urtasun

Although attention mechanisms have achieved considerable progress in Transformer-based architectures across various Artificial Intelligence (AI) domains, their inner workings remain to be explored. Existing explainable methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Hongbo Zhu , Theodor Wulff , Rahul Singh Maharjan , Jinpei Han , Angelo Cangelosi

Vehicle crashes involve complex interactions between road users, split-second decisions, and challenging environmental conditions. Among these, two-vehicle crashes are the most prevalent, accounting for approximately 70% of roadway crashes…

Artificial Intelligence · Computer Science 2025-10-16 Boyou Chen , Gerui Xu , Zifei Wang , Huizhong Guo , Ananna Ahmed , Zhaonan Sun , Zhen Hu , Kaihan Zhang , Shan Bao

Perception systems in autonomous driving rely on sensors such as LiDAR and cameras to perceive the 3D environment. However, due to occlusions and data sparsity, these sensors often fail to capture complete information. Semantic Occupancy…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Helin Cao , Rafael Materla , Sven Behnke

Perception-driven approach and end-to-end system are two major vision-based frameworks for self-driving cars. However, it is difficult to introduce attention and historical information of autonomous driving process, which are the essential…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Shitao Chen , Songyi Zhang , Jinghao Shang , Badong Chen , Nanning Zheng

Traffic accident prediction in driving videos aims to provide an early warning of the accident occurrence, and supports the decision making of safe driving systems. Previous works usually concentrate on the spatial-temporal correlation of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Jianwu Fang , Lei-Lei Li , Kuan Yang , Zhedong Zheng , Jianru Xue , Tat-Seng Chua