English
Related papers

Related papers: Where, What, Why: Towards Explainable Driver Atten…

200 papers

Modern driving involves interactive technologies that can divert attention, increasing the risk of accidents. This paper presents a computational cognitive model that simulates human multitasking while driving. Based on optimal supervisory…

Human-Computer Interaction · Computer Science 2025-03-25 Jussi Jokinen , Patrick Ebel , Tuomo Kujala

In this paper, we address the "black-box" problem in predictive process analytics by building interpretable models that are capable to inform both what and why is a prediction. Predictive process analytics is a newly emerged discipline…

Machine Learning · Computer Science 2022-04-26 Bemali Wickramanayake , Zhipeng He , Chun Ouyang , Catarina Moreira , Yue Xu , Renuka Sindhgatta

Machine comprehension is a representative task of natural language understanding. Typically, we are given context paragraph and the objective is to answer a question that depends on the context. Such a problem requires to model the complex…

Computation and Language · Computer Science 2018-03-28 Zia Hasan , Sebastian Fischer

Trajectory prediction is crucial for autonomous vehicles. The planning system not only needs to know the current state of the surrounding objects but also their possible states in the future. As for vehicles, their trajectories are…

Robotics · Computer Science 2020-07-07 Chenxu Luo , Lin Sun , Dariush Dabiri , Alan Yuille

Autonomous driving technology, a catalyst for revolutionizing transportation and urban mobility, has the tend to transition from rule-based systems to data-driven strategies. Traditional module-based systems are constrained by cumulative…

Artificial Intelligence · Computer Science 2024-08-13 Zhenjie Yang , Xiaosong Jia , Hongyang Li , Junchi Yan

While autonomous driving technology has made remarkable strides, data-driven approaches still struggle with complex scenarios due to their limited reasoning capabilities. Meanwhile, knowledge-driven autonomous driving systems have evolved…

Artificial Intelligence · Computer Science 2025-01-15 Yukai Ma , Tiantian Wei , Naiting Zhong , Jianbiao Mei , Tao Hu , Licheng Wen , Xuemeng Yang , Botian Shi , Yong Liu

End-to-end autonomous driving has emerged as a promising approach to unify perception, prediction, and planning within a single framework, reducing information loss and improving adaptability. However, existing methods often rely on fixed…

Robotics · Computer Science 2025-07-18 Yuhang Lu , Jiadong Tu , Yuexin Ma , Xinge Zhu

In this paper, we propose GTA-VLA(Guide, Think, Act), an interactive Vision-Language-Action (VLA) framework that enables spatially steerable embodied reasoning by allowing users to guide robot policies with explicit visual cues. Existing…

Robotics · Computer Science 2026-05-14 Yiran Ling , Qing Lian , Jinghang Li , Qing Jiang , Tianming Zhang , Xiaoke Jiang , Chuanxiu Liu , Jie Liu , Lei Zhang

Despite the continual advances in Advanced Driver Assistance Systems (ADAS) and the development of high-level autonomous vehicles (AV), there is a general consensus that for the short to medium term, there is a requirement for a human…

Robotics · Computer Science 2023-10-19 Santiago Gerling Konrad , Julie Stephany Berrio , Mao Shan , Favio Masson , Stewart Worrall

Autonomous driving in multi-agent dynamic traffic scenarios is challenging: the behaviors of road users are uncertain and are hard to model explicitly, and the ego-vehicle should apply complicated negotiation skills with them, such as…

Robotics · Computer Science 2022-06-22 Peide Cai , Hengli Wang , Yuxiang Sun , Ming Liu

A key component in autonomous driving is the ability of the self-driving car to understand, track and predict the dynamics of the surrounding environment. Although there is significant work in the area of object detection, tracking and…

Robotics · Computer Science 2021-07-20 Cosmin Ginerica , Mihai Zaha , Florin Gogianu , Lucian Busoniu , Bogdan Trasnea , Sorin Grigorescu

Although neural networks have seen tremendous success as predictive models in a variety of domains, they can be overly confident in their predictions on out-of-distribution (OOD) data. To be viable for safety-critical applications, like…

Robotics · Computer Science 2022-11-17 Masha Itkina , Mykel J. Kochenderfer

We present a reward-predictive, model-based deep learning method featuring trajectory-constrained visual attention for local planning in visual navigation tasks. Our method learns to place visual attention at locations in latent image space…

Robotics · Computer Science 2022-05-27 Stefan Wapnick , Travis Manderson , David Meger , Gregory Dudek

Multi-task learning (MTL) can advance assistive driving by exploring inter-task correlations through shared representations. However, existing methods face two critical limitations: single-modality constraints limiting comprehensive scene…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Wenzhuo Liu , Yicheng Qiao , Zhen Wang , Qiannan Guo , Zilong Chen , Meihua Zhou , Xinran Li , Letian Wang , Zhiwei Li , Huaping Liu , Wenshuo Wang

Advanced driver assistance systems require a comprehensive understanding of the driver's mental/physical state and traffic context but existing works often neglect the potential benefits of joint learning between these tasks. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Wenzhuo Liu , Wenshuo Wang , Yicheng Qiao , Qiannan Guo , Jiayin Zhu , Pengfei Li , Zilong Chen , Huiming Yang , Zhiwei Li , Lening Wang , Tiao Tan , Huaping Liu

Urban autonomous driving is an open and challenging problem to solve as the decision-making system has to account for several dynamic factors like multi-agent interactions, diverse scene perceptions, complex road geometries, and other…

Artificial Intelligence · Computer Science 2021-08-30 Arjit Sharma , Sahil Sharma

Safe L2/L3 driving automation requires anticipating human-in-the-loop reactions during shared-control transitions. While most driving world models forecast the external environment, in-cabin intelligence remains strictly…

Robotics · Computer Science 2026-05-07 Haozhuang Chi , Daosheng Qiu , Hao Su , Haochen Liu , Zirui Li , Haoruo Zhang , Chen Lv

Without relevant human priors, neural networks may learn uninterpretable features. We propose Dynamics of Attention for Focus Transition (DAFT) as a human prior for machine reasoning. DAFT is a novel method that regularizes attention-based…

Machine Learning · Statistics 2019-12-24 Wonjae Kim , Yoonho Lee

With the level of automation increases in vehicles, such as conditional and highly automated vehicles (AVs), drivers are becoming increasingly out of the control loop, especially in unexpected driving scenarios. Although it might be not…

Human-Computer Interaction · Computer Science 2022-07-18 Lilit Avetisyan , Jackie Ayoub , Feng Zhou

With increasing automation, drivers' roles transition from active operators to passive system supervisors, affecting their behaviour and cognitive processes. This study addresses the attentional resource allocation and subjective cognitive…

Human-Computer Interaction · Computer Science 2023-11-13 Nikol Figalová , Hans-Joachim Bieg , Julian Elias Reiser , Yuan-Cheng Liu , Martin Baumann , Lewis Chuang , Olga Pollatos