English
Related papers

Related papers: DriverGaze360: OmniDirectional Driver Attention wi…

200 papers

Gaze estimation is instrumental in modern virtual reality (VR) systems. Despite significant progress in remote-camera gaze estimation, VR gaze research remains constrained by data scarcity, particularly the lack of large-scale, accurately…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Gil Shapira , Ishay Goldin , Evgeny Artyomov , Donghoon Kim , Yosi Keller , Niv Zehngut

It is well known that human gaze carries significant information about visual attention. However, there are three main difficulties in incorporating the gaze data in an attention mechanism of deep neural networks: 1) the gaze fixation…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Kyle Min , Jason J. Corso

Visual Saliency refers to the innate human mechanism of focusing on and extracting important features from the observed environment. Recently, there has been a notable surge of interest in the field of automotive research regarding the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Francesco Rundo , Michael Sebastian Rundo , Concetto Spampinato

Understanding not only where drivers look but also why their attention shifts is essential for interpretable human-AI collaboration in autonomous driving. Driver attention is not purely perceptual but semantically structured. Thus,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Kaiser Hamid , Can Cui , Khandakar Ashrafi Akbar , Ziran Wang , Nade Liang

A smart vehicle should be able to monitor the actions and behaviors of the human driver to provide critical warnings or intervene when necessary. Recent advancements in deep learning and computer vision have shown great promise in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Sumit Jha , Mohamed F. Marzban , Tiancheng Hu , Mohamed H. Mahmoud , Naofal Al-Dhahir , Carlos Busso

This paper addresses the gaze target detection problem in single images captured from the third-person perspective. We present a multimodal deep architecture to infer where a person in a scene is looking. This spatial model is trained on…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Francesco Tonini , Cigdem Beyan , Elisa Ricci

This paper investigates how end-to-end driving models can be improved to drive more accurately and human-like. To tackle the first issue we exploit semantic and visual maps from HERE Technologies and augment the existing Drive360 dataset…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Simon Hecker , Dengxin Dai , Alexander Liniger , Luc Van Gool

Despite the continual advances in Advanced Driver Assistance Systems (ADAS) and the development of high-level autonomous vehicles (AV), there is a general consensus that for the short to medium term, there is a requirement for a human…

Robotics · Computer Science 2023-10-19 Santiago Gerling Konrad , Julie Stephany Berrio , Mao Shan , Favio Masson , Stewart Worrall

As the proportion of road accidents increases each year, driver distraction continues to be an important risk component in road traffic injuries and deaths. The distractions caused by the increasing use of mobile phones and other wireless…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Ashlesha Kumar , Kuldip Singh Sangwan , Dhiraj

Following the gaze of other people and analyzing the target they are looking at can help us understand what they are thinking, and doing, and predict the actions that may follow. Existing methods for gaze following struggle to perform well…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Feiyang Liu , Dan Guo , Jingyuan Xu , Zihao He , Shengeng Tang , Kun Li , Meng Wang

Discrepancies in decision-making between Autonomous Driving Systems (ADS) and human drivers underscore the need for intuitive human gaze predictors to bridge this gap, thereby improving user trust and experience. Existing gaze datasets,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Linfeng Liang , Yao Deng , Yang Zhang , Jianchao Lu , Chen Wang , Quanzheng Sheng , Xi Zheng

Human gaze provides valuable information on human focus and intentions, making it a crucial area of research. Recently, deep learning has revolutionized appearance-based gaze estimation. However, due to the unique features of gaze…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Yihua Cheng , Haofei Wang , Yiwei Bao , Feng Lu

In order to increase road safety, among the visual and manual distractions, modern intelligent vehicles need also to detect cognitive distracted driving (i.e., the drivers mind wandering). In this study, the influence of cognitive processes…

Human-Computer Interaction · Computer Science 2021-06-17 Antonyo Musabini , Mounsif Chetitah

Most state-of-the-art works in trajectory forecasting for automotive target predicting the pose and orientation of the agents in the scene. This represents a particularly useful problem, for instance in autonomous driving, but it does not…

Robotics · Computer Science 2024-10-28 Luca Paparusso , Stefano Melzi , Francesco Braghin

Driver attention prediction is becoming an essential research problem in human-like driving systems. This work makes an attempt to predict the driver attention in driving accident scenarios (DADA). However, challenges tread on the heels of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Jianwu Fang , Dingxin Yan , Jiahuan Qiao , Jianru Xue , Hongkai Yu

Driving is a visuomotor task, i.e., there is a connection between what drivers see and what they do. While some models of drivers' gaze account for top-down effects of drivers' actions, the majority learn only bottom-up correlations between…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Iuliia Kotseruba , John K. Tsotsos

We address the challenge of unsupervised mistake detection in egocentric video of skilled human activities through the analysis of gaze signals. While traditional methods rely on manually labeled mistakes, our approach does not require…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Michele Mazzamuto , Antonino Furnari , Yoichi Sato , Giovanni Maria Farinella

Understanding drivers' decision-making is crucial for road safety. Although predicting the ego-vehicle's path is valuable for driver-assistance systems, existing methods mainly focus on external factors like other vehicles' motions, often…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 M. Eren Akbiyik , Nedko Savov , Danda Pani Paudel , Nikola Popovic , Christian Vater , Otmar Hilliges , Luc Van Gool , Xi Wang

Perceiving and reconstructing 3D scene geometry from visual inputs is crucial for autonomous driving. However, there still lacks a driving-targeted dense geometry perception model that can adapt to different scenarios and camera…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Sicheng Zuo , Zixun Xie , Wenzhao Zheng , Shaoqing Xu , Fang Li , Shengyin Jiang , Long Chen , Zhi-Xin Yang , Jiwen Lu

360 video captures the complete surrounding scenes with the ultra-large field of view of 360X180. This makes 360 scene understanding tasks, eg, segmentation and tracking, crucial for appications, such as autonomous driving, robotics. With…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Weiming Zhang , Dingwen Xiao , Aobotao Dai , Yexin Liu , Tianbo Pan , Shiqi Wen , Lei Chen , Lin Wang