English
Related papers

Related papers: Where, What, Why: Towards Explainable Driver Atten…

200 papers

Trajectory prediction models in autonomous driving are vulnerable to perturbations from non-causal agents whose actions should not affect the ego-agent's behavior. Such perturbations can lead to incorrect predictions of other agents'…

Robotics · Computer Science 2026-05-19 Ehsan Ahmadi , Ray Mercurius , Soheil Alizadeh , Kasra Rezaee , Amir Rasouli

In this paper, we propose an end-to-end self-driving network featuring a sparse attention module that learns to automatically attend to important regions of the input. The attention module specifically targets motion planning, whereas prior…

Robotics · Computer Science 2021-03-29 Bob Wei , Mengye Ren , Wenyuan Zeng , Ming Liang , Bin Yang , Raquel Urtasun

Countless traffic accidents often occur because of the inattention of the drivers. Many factors can contribute to distractions while driving, since objects or events to physiological conditions, as drowsiness and fatigue, do not allow the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Luiz G. Véras , Anna K. F. Gomes , Guilherme A. R. Dominguez , Alexandre T. Oliveira

Recent Vision-Language-Action (VLA) models for autonomous driving explore inference-time reasoning as a way to improve driving performance and safety in challenging scenarios. Most prior work uses natural language to express…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Shuhan Tan , Kashyap Chitta , Yuxiao Chen , Ran Tian , Yurong You , Yan Wang , Wenjie Luo , Yulong Cao , Philipp Krahenbuhl , Marco Pavone , Boris Ivanovic

Large language models have been widely applied to knowledge-driven decision-making for automated vehicles due to their strong generalization and reasoning capabilities. However, the safety of the resulting decisions cannot be ensured due to…

Robotics · Computer Science 2025-10-09 Yuanfei Lin , Sebastian Illing , Matthias Althoff

Anticipating the motion of neighboring vehicles is crucial for autonomous driving, especially on congested highways where even slight motion variations can result in catastrophic collisions. An accurate prediction of a future trajectory…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Fuad Hasan , Hailong Huang

In commentary driving, drivers verbalise their observations, assessments and intentions. By speaking out their thoughts, both learning and expert drivers are able to create a better understanding and awareness of their surroundings. In the…

Artificial Intelligence · Computer Science 2022-10-24 Daniel Omeiza , Sule Anjomshoae , Helena Webb , Marina Jirotka , Lars Kunze

Spatial reasoning poses a particular challenge for intelligent agents and is at the same time a prerequisite for their successful interaction and communication in the physical world. One such reasoning task is to describe the position of a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Kyra Ahrens , Matthias Kerzel , Jae Hee Lee , Cornelius Weber , Stefan Wermter

Autonomous Driving (AD) encounters significant safety hurdles in long-tail unforeseen driving scenarios, largely stemming from the non-interpretability and poor generalization of the deep neural networks within the AD system, particularly…

Artificial Intelligence · Computer Science 2024-03-25 Yixuan Wang , Ruochen Jiao , Sinong Simon Zhan , Chengtian Lang , Chao Huang , Zhaoran Wang , Zhuoran Yang , Qi Zhu

Perception and prediction modules are critical components of autonomous driving systems, enabling vehicles to navigate safely through complex environments. The perception module is responsible for perceiving the environment, including…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Lucas Dal'Col , Miguel Oliveira , Vítor Santos

Monocular depth estimation is a central problem in computer vision with applications in robotics, AR, and autonomous driving, yet the self-attention mechanisms that drive modern Transformer architectures remain opaque. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Vasileios Arampatzakis , George Pavlidis , Nikolaos Mitianoudis , Nikos Papamarkos

Autonomous driving systems face significant challenges in achieving human-like adaptability, robustness, and interpretability in complex, open-world environments. These challenges stem from fragmented architectures, limited generalization…

Robotics · Computer Science 2025-08-01 Yi Zhang , Erik Leo Haß , Kuo-Yi Chao , Nenad Petrovic , Yinglei Song , Chengdong Wu , Alois Knoll

Accurate prediction of drivers' gaze is an important component of vision-based driver monitoring and assistive systems. Of particular interest are safety-critical episodes, such as performing maneuvers or crossing intersections. In such…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Iuliia Kotseruba , John K. Tsotsos

Data-driven approaches for autonomous driving (AD) have been widely adopted in the past decade but are confronted with dataset bias and uninterpretability. Inspired by the knowledge-driven nature of human driving, recent approaches explore…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Zhijian Huang , Tao Tang , Shaoxiang Chen , Sihao Lin , Zequn Jie , Lin Ma , Guangrun Wang , Xiaodan Liang

Trustworthy AI is mandatory for the broad deployment of autonomous vehicles. Although end-to-end approaches derive control commands directly from raw data, interpreting these decisions remains challenging, especially in complex urban…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Mona Mirzaie , Bodo Rosenhahn

Accurate accident anticipation remains challenging when driver cognition and dynamic road conditions are underrepresented in predictive models. In this paper, we propose CAMERA (Context-Aware Multi-modal Enhanced Risk Anticipation), a…

Computational Engineering, Finance, and Science · Computer Science 2025-07-17 Jiaxun Zhang , Haicheng Liao , Yumu Xie , Chengyue Wang , Yanchen Guan , Bin Rao , Zhenning Li

The feasibility of collecting a large amount of expert demonstrations has inspired growing research interests in learning-to-drive settings, where models learn by imitating the driving behaviour from experts. However, exclusively relying on…

Robotics · Computer Science 2022-12-20 Jonathan Francis , Bingqing Chen , Weiran Yao , Eric Nyberg , Jean Oh

Lane-changing (LC) behavior, a critical yet complex driving maneuver, significantly influences driving safety and traffic dynamics. Traditional analytical LC decision (LCD) models, while effective in specific environments, often…

Artificial Intelligence · Computer Science 2025-05-13 Linxuan Huang , Dong-Fan Xie , Li Li , Zhengbing He

A new paradigm is proposed for autonomous driving. The new paradigm lies between the end-to-end and pipelined approaches, and is inspired by how humans solve the problem. While it relies on scene understanding, the latter only considers…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Yiran Xu , Xiaoyin Yang , Lihang Gong , Hsuan-Chu Lin , Tz-Ying Wu , Yunsheng Li , Nuno Vasconcelos

Traffic prediction has gradually attracted the attention of researchers because of the increase in traffic big data. Therefore, how to mine the complex spatio-temporal correlations in traffic data to predict traffic conditions more…

Machine Learning · Computer Science 2021-12-07 Yuchen Fang , Yanjun Qin , Haiyong Luo , Fang Zhao , Chenxing Wang