English
Related papers

Related papers: Gaze2AOI: Open Source Deep-learning Based System f…

200 papers

In recent years, artificial intelligence (AI) based on deep learning (DL) has sparked tremendous global interest. DL is widely used today and has expanded into various interesting areas. It is becoming more popular in cross-subject…

Computer Vision and Pattern Recognition · Computer Science 2019-11-13 Ahmed Ali Hammam , Mona Soliman , Aboul Ella Hassanien

Due to the foveated nature of the human vision system, people can focus their visual attention on a small region of their visual field at a time, which usually contains only a single object. Estimating this object of attention in…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Zehua Zhang , Chen Yu , David Crandall

Eye tracking (ET) can help to understand visual attention and cognitive processes in interactive environments. This study presents a comprehensive eye-tracking analysis framework of the Inhibitory Control Game, named the ReStroop game,…

Human-Computer Interaction · Computer Science 2025-09-11 Abdul Rehman , Ilona Heldal , Diana Stilwell , Paula Costa Ferreira , Jerry Chun-Wei Lin

Eye-tracking technology is widely used in various application areas such as psychology, neuroscience, marketing, and human-computer interaction, as it is a valuable tool for understanding how people process information and interact with…

Human-Computer Interaction · Computer Science 2024-04-25 Enkelejda Kasneci , Hong Gao , Suleyman Ozdel , Virmarie Maquiling , Enkeleda Thaqi , Carrie Lau , Yao Rong , Gjergji Kasneci , Efe Bozkir

Vision Language Models (VLMs) have demonstrated strong capabilities in understanding visual content, yet their ability to predict where humans look on user interfaces remains unexplored. We present UIGaze, a study investigating how closely…

Human-Computer Interaction · Computer Science 2026-04-30 Min Song , Yoonseong Lee , Yeonhu Seo

Eye movements have long been studied as a window into the attentional mechanisms of the human brain and made accessible as novelty style human-machine interfaces. However, not everything that we gaze upon, is something we want to interact…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Paul Festor , Ali Shafti , Alex Harston , Michey Li , Pavel Orlov , A. Aldo Faisal

Efficient and accurate annotation of datasets remains a significant challenge for deploying object detection models such as You Only Look Once (YOLO) in real-world applications, particularly in agriculture where rapid decision-making is…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Mohamed Abdallah Salem , Ahmed Harb Rabia

Gaze is a valuable means of communication for impaired people with extremely limited motor capabilities. However, robust gaze-based intent recognition in multi-object environments is challenging due to gaze noise, micro-saccades, viewpoint…

Robotics · Computer Science 2026-03-09 Yuzhi Lai , Shenghai Yuan , Peizheng Li , Andreas Zell

Academic integrity continues to face the persistent challenge of examination cheating. Traditional invigilation relies on human observation, which is inefficient, costly, and prone to errors at scale. Although some existing AI-powered…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Van-Truong Le , Le-Khanh Nguyen , Trong-Doanh Nguyen

The existing approaches to identify personalized salience zones of a Web page do not consider the dynamic behavior in time of the Web user's gaze or the alterations of its content. For this reason, this paper proposes the concept of visit…

Human-Computer Interaction · Computer Science 2022-11-18 F. Diaz-Guerra , A. Jimenez-Molina

Machine learning models deployed in open-world scenarios often encounter unfamiliar conditions and perform poorly in unanticipated situations. As AI systems advance and find application in safety-critical domains, effectively handling…

Machine Learning · Computer Science 2025-04-22 Tian Xie , Jifan Zhang , Haoyue Bai , Robert Nowak

For computer systems to effectively interact with humans using spoken language, they need to understand how the words being generated affect the users' moment-by-moment attention. Our study focuses on the incremental prediction of attention…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Sounak Mondal , Seoyoung Ahn , Zhibo Yang , Niranjan Balasubramanian , Dimitris Samaras , Gregory Zelinsky , Minh Hoai

Comparing mobile eye tracking data from multiple participants without information about areas of interest (AOIs) is challenging because of individual timing and coordinate systems. We present a technique, the gaze spiral, that visualizes…

Human-Computer Interaction · Computer Science 2022-04-29 Maurice Koch , Daniel Weiskopf , Kuno Kurzhals

Autonomous driving is a multi-task problem requiring a deep understanding of the visual environment. End-to-end autonomous systems have attracted increasing interest as a method of learning to drive without exhaustively programming…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Alexander Makrigiorgos , Ali Shafti , Alex Harston , Julien Gerard , A. Aldo Faisal

This paper describes a system developed to help University students get more from their online lectures, tutorials, laboratory and other live sessions. We do this by logging their attention levels on their laptops during live Zoom sessions…

Multimedia · Computer Science 2021-01-19 Hyowon Lee , Mingming Liu , Hamza Riaz , Navaneethan Rajasekaren , Michael Scriney , Alan F. Smeaton

Interactive segmentation aims to accurately segment target objects with minimal user interactions. However, current methods often fail to accurately separate target objects from the background, due to a limited understanding of order, the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Bin Wang , Anwesa Choudhuri , Meng Zheng , Zhongpai Gao , Benjamin Planche , Andong Deng , Qin Liu , Terrence Chen , Ulas Bagci , Ziyan Wu

Following the gaze of other people and analyzing the target they are looking at can help us understand what they are thinking, and doing, and predict the actions that may follow. Existing methods for gaze following struggle to perform well…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Feiyang Liu , Dan Guo , Jingyuan Xu , Zihao He , Shengeng Tang , Kun Li , Meng Wang

This paper addresses the challenging problem of estimating the general visual attention of people in images. Our proposed method is designed to work across multiple naturalistic social scenarios and provides a full picture of the subject's…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Eunji Chong , Nataniel Ruiz , Yongxin Wang , Yun Zhang , Agata Rozga , James Rehg

Deep learning algorithms have pushed the boundaries of computer vision research and have depicted commendable performance in a variety of applications. However, training a robust deep neural network necessitates a large amount of labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Debanjan Goswami , Shayok Chakraborty

Annotating object ground truth in videos is vital for several downstream tasks in robot perception and machine learning, such as for evaluating the performance of an object tracker or training an image-based object detector. The accuracy of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Eric Price , Aamir Ahmad