English
Related papers

Related papers: SCOUT+: Towards Practical Task-Driven Drivers' Gaz…

200 papers

Understanding not only where drivers look but also why their attention shifts is essential for interpretable human-AI collaboration in autonomous driving. Driver attention is not purely perceptual but semantically structured. Thus,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Kaiser Hamid , Can Cui , Khandakar Ashrafi Akbar , Ziran Wang , Nade Liang

We propose a computational model to estimate a person's attended awareness of their environment. We define attended awareness to be those parts of a potentially dynamic scene which a person has attended to in recent history and which they…

Human-Computer Interaction · Computer Science 2021-10-19 Deepak Gopinath , Guy Rosman , Simon Stent , Katsuya Terahata , Luke Fletcher , Brenna Argall , John Leonard

With increasing automation in passenger vehicles, the study of safe and smooth occupant-vehicle interaction and control transitions is key. In this study, we focus on the development of contextual, semantically meaningful representations of…

Robotics · Computer Science 2021-07-26 Akshay Rangesh , Nachiket Deo , Ross Greer , Pujitha Gunaratne , Mohan M. Trivedi

For the optimum design of a driver-automation shared control system, an understanding of driver behavior based on measurements and modeling is crucial early in the development process. This paper presents a driver model through a weighting…

Human-Computer Interaction · Computer Science 2020-10-08 Zheng Wang , Rencheng Zheng , Edric John Cruz Nacpil , Kimihiko Nakano

We present a new computational model for gaze prediction in egocentric videos by exploring patterns in temporal shift of gaze fixations (attention transition) that are dependent on egocentric manipulation tasks. Our assumption is that the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Yifei Huang , Minjie Cai , Zhenqiang Li , Yoichi Sato

Accurately and promptly predicting accidents among surrounding traffic agents from camera footage is crucial for the safety of autonomous vehicles (AVs). This task presents substantial challenges stemming from the unpredictable nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Haicheng Liao , Haoyu Sun , Huanming Shen , Chengyue Wang , Kahou Tam , Chunlin Tian , Li Li , Chengzhong Xu , Zhenning Li

Semi-autonomous driving, as it is already available today and will eventually become even more accessible, implies the need for driver and automation system to reliably work together in order to ensure safe driving. A particular challenge…

Artificial Intelligence · Computer Science 2023-08-31 Jakob Suchan , Jan-Patrick Osterloh

Research studies have shown that a large proportion of hazards remain unrecognized, which expose construction workers to unanticipated safety risks. Recent studies have also found that a strong correlation exists between viewing patterns of…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Idris Jeelani , Khashayar Asadi , Hariharan Ramshankar , Kevin Han , Alex Albert

This article presents a family of Stochastic Cartographic Occupancy Prediction Engines (SCOPEs) that enable mobile robots to predict the future states of complex dynamic environments. They do this by accounting for the motion of the robot…

Robotics · Computer Science 2025-09-08 Zhanteng Xie , Philip Dames

Gaze reflects how humans process visual scenes and is therefore increasingly used in computer vision systems. Previous works demonstrated the potential of gaze for object-centric tasks, such as object localization and recognition, but it…

Computer Vision and Pattern Recognition · Computer Science 2016-08-19 Yusuke Sugano , Andreas Bulling

Advances in vision-based sensors and computer vision algorithms have significantly improved the analysis and understanding of traffic scenarios. To facilitate the use of these improvements for road safety, this survey systematically…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yaoqi Huang , Julie Stephany Berrio , Mao Shan , Stewart Worrall

When automated driving systems encounter complex situations beyond their operational capabilities, they issue takeover requests, prompting drivers to resume vehicle control and return to the driving loop as a critical safety backup.…

Human-Computer Interaction · Computer Science 2025-08-01 Kexin Liang , Jan Luca Kästle , Bani Anvari , Simeon C. Calvert , J. W. C. van Lint

Driver's gaze information can be crucial in driving research because of its relation to driver attention. Particularly, the inclusion of gaze data in driving simulators broadens the scope of research studies as they can relate drivers' gaze…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 David González-Ortega , Francisco Javier Díaz-Perna , Mario Martínez-Zarzuela , Míriam Antón-Rodríguez

Maintaining situational awareness in complex driving scenarios is challenging. It requires continuously prioritizing attention among extensive scene entities and understanding how prominent hazards might affect the ego vehicle. While…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yaoqi Huang , Julie Stephany Berrio , Mao Shan , Stewart Worrall

A smart vehicle should be able to understand human behavior and predict their actions to avoid hazardous situations. Specific traits in human behavior can be automatically predicted, which can help the vehicle make decisions, increasing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Sumit Jha , Carlos Busso

In real-world scene perception human observers generate sequences of fixations to move image patches into the high-acuity center of the visual field. Models of visual attention developed over the last 25 years aim to predict two-dimensional…

Neurons and Cognition · Quantitative Biology 2022-08-15 Lisa Schwetlick , Daniel Backhaus , Ralf Engbert

Driving is a routine activity for many, but it is far from simple. Drivers deal with multiple concurrent tasks, such as keeping the vehicle in the lane, observing and anticipating the actions of other road users, reacting to hazards, and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Iuliia Kotseruba , John K. Tsotsos

The thesis presents contributions made to the evaluation and design of a haptic guidance system on improving driving performance in cases of normal and degraded visual information, which are based on behavior experiments, modeling and…

Robotics · Computer Science 2021-04-26 Zheng Wang

Visual perception is the most critical input for driving decisions. In this study, our aim is to understand relationship between saliency and driving decisions. We present a novel attention-based saliency map prediction model for making…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Ekrem Aksoy , Ahmet Yazıcı , Mahmut Kasap

Traffic accident anticipation aims to accurately and promptly predict the occurrence of a future accident from dashcam videos, which is vital for a safety-guaranteed self-driving system. To encourage an early and accurate decision, existing…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Wentao Bao , Qi Yu , Yu Kong