English
Related papers

Related papers: Real-Time Gaze Tracking with Event-Driven Eye Segm…

200 papers

Traditional eye tracking requires specialized hardware, which means collecting gaze data from many observers is expensive, tedious and slow. Therefore, existing saliency prediction datasets are order-of-magnitudes smaller than typical…

Computer Vision and Pattern Recognition · Computer Science 2015-05-21 Pingmei Xu , Krista A Ehinger , Yinda Zhang , Adam Finkelstein , Sanjeev R. Kulkarni , Jianxiong Xiao

Gaze following aims to interpret human-scene interactions by predicting the person's focal point of gaze. Prevailing approaches often adopt a two-stage framework, whereby multi-modality information is extracted in the initial stage for gaze…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Yuehao Song , Xinggang Wang , Jingfeng Yao , Wenyu Liu , Jinglin Zhang , Xiangmin Xu

Event-based vision sensors, such as the Dynamic Vision Sensor (DVS), are ideally suited for real-time motion analysis. The unique properties encompassed in the readings of such sensors provide high temporal resolution, superior sensitivity…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Anton Mitrokhin , Cornelia Fermuller , Chethan Parameshwara , Yiannis Aloimonos

We introduce EyeTheia, a lightweight and open deep learning pipeline for webcam-based gaze estimation, designed for browser-based experimental platforms and real-world cognitive and clinical research. EyeTheia enables real-time gaze…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Stevenson Pather , Niels Martignène , Arnaud Bugnet , Fouad Boutaleb , Fabien D'Hondt , Deise Santana Maia

This study proposes a novel self-calibration method for eye tracking in a virtual reality (VR) headset. The proposed method is based on the assumptions that the user's viewpoint can freely move and that the points of regard (PoRs) from…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ryusei Uramune , Sei Ikeda , Hiroki Ishizuka , Osamu Oshiro

We propose a novel guided interactive segmentation (GIS) algorithm for video objects to improve the segmentation accuracy and reduce the interaction time. First, we design the reliability-based attention module to analyze the reliability of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Yuk Heo , Yeong Jun Koh , Chang-Su Kim

Most existing RGB-based trackers target low frame rate benchmarks of around 30 frames per second. This setting restricts the tracker's functionality in the real world, especially for fast motion. Event-based cameras as bioinspired sensors…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Jiqing Zhang , Yuanchen Wang , Wenxi Liu , Meng Li , Jinpeng Bai , Baocai Yin , Xin Yang

A new high-precision eye-tracking method has been demonstrated recently by tracking the motion of iris features rather than by exploiting pupil edges. While the method provides high precision, it suffers from temporal drift, an inability to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Aayush K. Chaudhary , Jeff B. Pelz

Active Search and Tracking for search and rescue missions or collaborative mobile robotics relies on the actuation of a sensing platform to detect and localize a target. In this paper we focus on visually detecting a radio-emitting target…

Robotics · Computer Science 2021-04-13 L. Varotto , A. Cenedese , A. Cavallaro

In recent years we have witnessed an increasing number of interactive systems on handheld mobile devices which utilise gaze as a single or complementary interaction modality. This trend is driven by the enhanced computational power of these…

Human-Computer Interaction · Computer Science 2023-07-04 Yaxiong Lei , Shijing He , Mohamed Khamis , Juan Ye

With developments in computer graphics, hardware technology, perception engineering, and human-computer interaction, virtual reality and virtual environments are becoming more integrated into our daily lives. Head-mounted displays, however,…

Human-Computer Interaction · Computer Science 2022-03-30 Efe Bozkir

Eye-tracking plays a crucial role in the development of virtual reality devices, neuroscience research, and psychology. Despite its significance in numerous applications, achieving an accurate, robust, and fast eye-tracking solution remains…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Jiazhang Wang , Tianfu Wang , Bingjie Xu , Oliver Cossairt , Florian Willomitzer

Mobile eye tracking plays a vital role in capturing human visual attention across both real-world and extended reality (XR) environments, making it an essential tool for applications ranging from behavioural research to human-computer…

Human-Computer Interaction · Computer Science 2025-11-05 Chuhan Jiao , Zhiming Hu , Andreas Bulling

Eye-tracking technologies have been widely used in applications like psychological studies and human computer interactions (HCI). However, most current eye trackers focus on 2D point of gaze (PoG) estimation and cannot provide accurate gaze…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Jinglin Sun , Zhipeng Wu , Han Wang , Peiguang Jing , Yu Liu

Technical progress in hardware and software enables us to record gaze data in everyday situations and over long time spans. Among a multitude of research opportunities, this technology enables visualization researchers to catch a glimpse…

Human-Computer Interaction · Computer Science 2023-12-05 Maurice Koch , Kuno Kurzhals , Michael Burch , Daniel Weiskopf

Augmented Reality (AR) systems, while enhancing task performance through real-time guidance, pose risks of inducing cognitive tunneling-a hyperfocus on virtual content that compromises situational awareness (SA) in safety-critical…

Machine Learning · Computer Science 2025-09-03 Zhehan Qu , Tianyi Hu , Christian Fronk , Maria Gorlatova

Despite a revolution in the pervasiveness of video cameras in our daily lives, one of the most meaningful forms of nonverbal affective communication, interpersonal eye gaze, i.e. eye gaze relative to a conversation partner, is not available…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Minh Tran , Taylan Sen , Kurtis Haut , Mohammad Rafayet Ali , Mohammed Ehsan Hoque

Accurate and efficient eye gaze estimation is important for emerging consumer electronic systems such as driver monitoring systems and novel user interfaces. Such systems are required to operate reliably in difficult, unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2018-06-29 Joseph Lemley , Anuradha Kar , Alexandru Drimbarean , Peter Corcoran

After the introduction of smartphones and smartwatches, AR glasses are considered the next breakthrough in the field of wearables. While the transition from smartphones to smartwatches was based mainly on established display technologies,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Johannes Meyer

Event cameras capture per-pixel brightness changes with microsecond resolution, offering continuous motion information lost between RGB frames. However, existing event-based motion estimators depend on large-scale synthetic data that often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jini Yang , Eunbeen Hong , Soowon Son , Hyunkoo Lee , Sunghwan Hong , Sunok Kim , Seungryong Kim