English
Related papers

Related papers: SCOUT+: Towards Practical Task-Driven Drivers' Gaz…

200 papers

In recent years, predicting driver's focus of attention has been a very active area of research in the autonomous driving community. Unfortunately, existing state-of-the-art techniques achieve this by relying only on human gaze information,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Anwesan Pal , Sayan Mondal , Henrik I. Christensen

Driver cognitive distraction is a major cause of road collisions and remains difficult to detect. Unlike manual or visual distraction, cognitive distraction is diverted by thoughts unrelated to driving, even when the driver appears visually…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Lang Zhang , JinYi Yoon , Matthew Corbett , Abhijit Sarkar , Bo Ji

Autonomous driving is a multi-task problem requiring a deep understanding of the visual environment. End-to-end autonomous systems have attracted increasing interest as a method of learning to drive without exhaustively programming…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Alexander Makrigiorgos , Ali Shafti , Alex Harston , Julien Gerard , A. Aldo Faisal

Assessing scenario coverage is crucial for evaluating the robustness of autonomous agents, yet existing methods rely on expensive human annotations or computationally intensive Large Vision-Language Models (LVLMs). These approaches are…

Robotics · Computer Science 2025-10-30 Anil Yildiz , Sarah M. Thornton , Carl Hildebrandt , Sreeja Roy-Singh , Mykel J. Kochenderfer

Vision Transformers (ViT) have advanced computer vision, yet their efficacy in complex tasks like driving remains less explored. This study enhances ViT by integrating human eye gaze, captured via eye-tracking, to increase prediction…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Sharath Koorathota , Nikolas Papadopoulos , Jia Li Ma , Shruti Kumar , Xiaoxiao Sun , Arunesh Mittal , Patrick Adelman , Paul Sajda

This paper digs deeper into factors that influence egocentric gaze. Instead of training deep models for this purpose in a blind manner, we propose to inspect factors that contribute to gaze guidance during daily tasks. Bottom-up saliency…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Hamed R. Tavakoli , Esa Rahtu , Juho Kannala , Ali Borji

The task of driver attention prediction has drawn considerable interest among researchers in robotics and the autonomous vehicle industry. Driver attention prediction can play an instrumental role in mitigating and preventing high-risk…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Yuan Shen , Niviru Wijayaratne , Pranav Sriram , Aamir Hasan , Peter Du , Katie Driggs-Campbell

Automated estimation of the allocation of a driver's visual attention may be a critical component of future Advanced Driver Assistance Systems. In theory, vision-based tracking of the eye can provide a good estimate of gaze location. In…

Computer Vision and Pattern Recognition · Computer Science 2016-03-02 Lex Fridman , Philipp Langhans , Joonbum Lee , Bryan Reimer

The advent of autonomous driving systems promises to transform transportation by enhancing safety, efficiency, and comfort. As these technologies evolve toward higher levels of autonomy, the need for integrated systems that seamlessly…

Robotics · Computer Science 2025-08-19 Yousra Shleibik , Jordan Sinclair , Kerstin Haring

Driver attention prediction is becoming an essential research problem in human-like driving systems. This work makes an attempt to predict the driver attention in driving accident scenarios (DADA). However, challenges tread on the heels of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Jianwu Fang , Dingxin Yan , Jiahuan Qiao , Jianru Xue , Hongkai Yu

Predicting driver attention is a critical problem for developing explainable autonomous driving systems and understanding driver behavior in mixed human-autonomous vehicle traffic scenarios. Although significant progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Shreedhar Govil , Didier Stricker , Jason Rambach

Driver visual attention prediction is a critical task in autonomous driving and human-computer interaction (HCI) research. Most prior studies focus on estimating attention allocation at a single moment in time, typically using static RGB…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Kaiser Hamid , Khandakar Ashrafi Akbar , Nade Liang

Driver gaze has been shown to be an excellent surrogate for driver attention in intelligent vehicles. With the recent surge of highly autonomous vehicles, driver gaze can be useful for determining the handoff time to a human driver. While…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Sourabh Vora , Akshay Rangesh , Mohan M. Trivedi

Advanced multimodal AI agents can now collaborate with users to solve challenges in the world. Yet, these emerging contextual AI systems rely on explicit communication channels between the user and system. We hypothesize that implicit…

In order to increase road safety, among the visual and manual distractions, modern intelligent vehicles need also to detect cognitive distracted driving (i.e., the drivers mind wandering). In this study, the influence of cognitive processes…

Human-Computer Interaction · Computer Science 2021-06-17 Antonyo Musabini , Mounsif Chetitah

Vehicles with a safety function for anticipating crashes in advance can enhance drivers' ability to avoid crashes. As dashboard cameras have become a low-cost sensor device accessible to almost every vehicle, deep neural networks for crash…

Human-Computer Interaction · Computer Science 2022-11-11 Yu Li , Muhammad Monjurul Karim , Ruwen Qin

Eye-tracking technology is an integral component of new display devices such as virtual and augmented reality headsets. Applications of gaze information range from new interaction techniques exploiting eye patterns to gaze-contingent…

Human-Computer Interaction · Computer Science 2022-05-05 Elena Arabadzhiyska , Cara Tursun , Hans-Peter Seidel , Piotr Didyk

Road traffic accidents remain a significant global concern, with the majority attributed to human factors such as driver distraction and fatigue. This study proposes a camera-based approach to derive useful indicators to assess driver…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Carmelo Scribano , Giovanni Cappelletti , Elia Giacobazzi , Giorgia Franchini , Paolo Burgio , Marko Bertogna

This paper addresses the problem of on-road object importance estimation, which utilizes video sequences captured from the driver's perspective as the input. Although this problem is significant for safer and smarter driving systems, the…

Robotics · Computer Science 2024-11-27 Zhixiong Nan , Yilong Chen , Tianfei Zhou , Tao Xiang

Despite the advent of autonomous cars, it's likely - at least in the near future - that human attention will still maintain a central role as a guarantee in terms of legal responsibility during the driving task. In this paper we study the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Andrea Palazzi , Francesco Solera , Simone Calderara , Stefano Alletto , Rita Cucchiara