English
Related papers

Related papers: Continuous Gaze Tracking With Implicit Saliency-Aw…

200 papers

Task-aware navigation continues to be a challenging area of research, especially in scenarios involving open vocabulary. Previous studies primarily focus on finding suitable locations for task completion, often overlooking the importance of…

Robotics · Computer Science 2024-09-18 Jun Zhu , Zihao Du , Haotian Xu , Fengbo Lan , Zilong Zheng , Bo Ma , Shengjie Wang , Tao Zhang

News outlets' competition for attention in news interfaces has highlighted the need for demographically-aware saliency prediction models. Despite recent advancements in saliency detection applied to user interfaces (UI), existing datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Matthew Kenely , Dylan Seychell , Carl James Debono , Chris Porter

Gaze estimation is a valuable technology with numerous applications in fields such as human-computer interaction, virtual reality, and medicine. This report presents the implementation of a gaze estimation system using the Sony Spresense…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Thomas Ruegg , Pietro Bonazzi , Andrea Ronco

Nonverbal communication, in particular eye contact, is a critical element of the music classroom, shown to keep students on task, coordinate musical flow, and communicate improvisational ideas. Unfortunately, this nonverbal aspect to…

Human-Computer Interaction · Computer Science 2021-05-24 Ross Greer , Shlomo Dubnov

Successful learning depends on learners' ability to sustain attention, which is particularly challenging in online education due to limited teacher interaction. A potential indicator for attention is gaze synchrony, demonstrating predictive…

Human-Computer Interaction · Computer Science 2024-04-02 Babette Bühler , Efe Bozkir , Hannah Deininger , Peter Gerjets , Ulrich Trautwein , Enkelejda Kasneci

Driver gaze plays an important role in different gaze-based applications such as driver attentiveness detection, visual distraction detection, gaze behavior understanding, and building driver assistance system. The main objective of this…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Pavan Kumar Sharma , Pranamesh Chakraborty

Online egocentric gaze estimation predicts where a camera wearer is looking from first-person video using only past and current frames, a task essential for augmented reality and assistive technologies. Unlike third-person gaze estimation,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Jia Li , Wenjie Zhao , Shijian Deng , Bolin Lai , Yuheng Wu , RUijia Chen , Jon E. Froehlich , Yuhang Zhao , Yapeng Tian

This work presents a next-generation human-robot interface that can infer and realize the user's manipulation intention via sight only. Specifically, we develop a system that integrates near-eye-tracking and robotic manipulation to enable…

Robotics · Computer Science 2023-05-16 Shaochen Wang , Wei Zhang , Zhangli Zhou , Jiaxi Cao , Ziyang Chen , Kang Chen , Bin Li , Zhen Kan

As eye-tracking becomes increasingly common in modern mobile devices, the potential for hands-free, gaze-based interaction grows, but current gesture sets are largely expert-designed and often misaligned with how users naturally move their…

Human-Computer Interaction · Computer Science 2026-03-25 Yaxiong Lei , Xinya Gong , Shijing He , Yafei Wang , Mohamed Khamis , Juan Ye

The potential of using gaze as an input modality in the mobile context is growing. While users often encumber themselves by carrying objects and using mobile devices while walking, the impact of encumbrance on gaze input performance remains…

Human-Computer Interaction · Computer Science 2025-12-19 Omar Namnakani , Yasmeen Abdrabou , John H. Williamson , Mohamed Khamis

Advanced multimodal AI agents can now collaborate with users to solve challenges in the world. Yet, these emerging contextual AI systems rely on explicit communication channels between the user and system. We hypothesize that implicit…

Technical progress in hardware and software enables us to record gaze data in everyday situations and over long time spans. Among a multitude of research opportunities, this technology enables visualization researchers to catch a glimpse…

Human-Computer Interaction · Computer Science 2023-12-05 Maurice Koch , Kuno Kurzhals , Michael Burch , Daniel Weiskopf

The human gaze is an important cue to signal intention, attention, distraction, and the regions of interest in the immediate surroundings. Gaze tracking can transform how robots perceive, understand, and react to people, enabling new modes…

Robotics · Computer Science 2024-06-11 Tim Schreiter , Andrey Rudenko , Martin Magnusson , Achim J. Lilienthal

We propose a novel method to estimate a driver's points-of-gaze using a pair of ordinary cameras mounted on the windshield and dashboard of a car. This is a challenging problem due to the dynamics of traffic environments with 3D scenes of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Dat Viet Thanh Nguyen , Anh Tran , Hoai Nam Vu , Cuong Pham , Minh Hoai

Foveated rendering significantly reduces computational demands in virtual reality applications by concentrating rendering quality where users focus their gaze. Current approaches require expensive hardware-based eye tracking systems,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Farhaan Ebadulla , Chiraag Mudlapur , Gaurav BV

Gaze estimation has become a subject of growing interest in recent research. Most of the current methods rely on single-view facial images as input. Yet, it is hard for these approaches to handle large head angles, leading to potential…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Ruicong Liu , Feng Lu

Vision based text entry systems aim to help disabled people achieve text communication using eye movement. Most previous methods have employed an existing eye tracker to predict gaze direction and design an input method based upon that.…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Chi Zhang , Rui Yao , Jinpeng Cai

Predicting human gaze is important in Human-Computer Interaction (HCI). However, to practically serve HCI applications, gaze prediction models must be scalable, fast, and accurate in their spatial and temporal gaze predictions. Recent…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Sounak Mondal , Zhibo Yang , Seoyoung Ahn , Dimitris Samaras , Gregory Zelinsky , Minh Hoai

Gaze estimation methods commonly use facial appearances to predict the direction of a person gaze. However, previous studies show three major challenges with convolutional neural network (CNN)-based, transformer-based, and contrastive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Xinyuan Zhao , Yihang Wu , Ahmad Chaddad , Sarah A. Alkhodair , Reem Kateb

The segmentation of a gaze trace into its constituent eye movements has been actively researched since the early days of eye tracking. As we move towards more naturalistic viewing conditions, the segmentation becomes even more challenging…

Multimedia · Computer Science 2019-12-11 Ioannis Agtzidis , Mikhail Startsev , Michael Dorr