English
Related papers

Related papers: FlatTrack: Eye-tracking with ultra-thin lensless c…

200 papers

Existing tracking algorithms typically rely on low-frame-rate RGB cameras coupled with computationally intensive deep neural network architectures to achieve effective tracking. However, such frame-based methods inherently face challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shiao Wang , Xiao Wang , Liye Jin , Bo Jiang , Lin Zhu , Lan Chen , Yonghong Tian , Bin Luo

Gaze tracking is increasingly becoming an essential component in Augmented and Virtual Reality. Modern gaze tracking al gorithms are heavyweight; they operate at most 5 Hz on mobile processors despite that near-eye cameras comfortably…

Human-Computer Interaction · Computer Science 2022-01-20 Yu Feng , Nathan Goulding-Hotta , Asif Khan , Hans Reyserhove , Yuhao Zhu

Eye tracking is a key technology for human-computer interaction, particularly crucial in augmented reality (AR) and virtual reality (VR) systems. We propose a novel eye-tracking approach based on incorporating passive eye-tracking modules…

This study presents a novel framework for 3D gaze tracking tailored for mixed-reality settings, aimed at enhancing joint attention and collaborative efforts in team-based scenarios. Conventional gaze tracking, often limited by monocular…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Eduardo Davalos , Yike Zhang , Ashwin T. S. , Joyce H. Fonteles , Umesh Timalsina , Guatam Biswas

Event-based cameras are becoming a popular solution for efficient, low-power eye tracking. Due to the sparse and asynchronous nature of event data, they require less processing power and offer latencies in the microsecond range. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Andrea Aspesi , Andrea Simpsi , Aaron Tognoli , Simone Mentasti , Luca Merigo , Matteo Matteucci

FlatCam is a thin form-factor lensless camera that consists of a coded mask placed on top of a bare, conventional sensor array. Unlike a traditional, lens-based camera where an image of the scene is directly recorded on the sensor pixels,…

Computer Vision and Pattern Recognition · Computer Science 2016-01-28 M. Salman Asif , Ali Ayremlou , Aswin Sankaranarayanan , Ashok Veeraraghavan , Richard Baraniuk

This work presents a next-generation human-robot interface that can infer and realize the user's manipulation intention via sight only. Specifically, we develop a system that integrates near-eye-tracking and robotic manipulation to enable…

Robotics · Computer Science 2023-05-16 Shaochen Wang , Wei Zhang , Zhangli Zhou , Jiaxi Cao , Ziyang Chen , Kang Chen , Bin Li , Zhen Kan

Augmented reality (AR) technology provides means for embedding visualization in a real-world context. Such techniques allow situated analyses of live data in their spatial domain. However, as existing techniques have to be adapted for this…

Human-Computer Interaction · Computer Science 2022-09-07 Kuno Kurzhals , Michael Becher , Nelusa Pathmanathan , Guido Reina

Traditional eye tracking requires specialized hardware, which means collecting gaze data from many observers is expensive, tedious and slow. Therefore, existing saliency prediction datasets are order-of-magnitudes smaller than typical…

Computer Vision and Pattern Recognition · Computer Science 2015-05-21 Pingmei Xu , Krista A Ehinger , Yinda Zhang , Adam Finkelstein , Sanjeev R. Kulkarni , Jianxiong Xiao

Facial motion tracking in head-mounted displays (HMD) has the potential to enable immersive "face-to-face" interaction in a virtual environment. However, current works on facial tracking are not suitable for unobtrusive augmented reality…

Human-Computer Interaction · Computer Science 2023-08-16 Yinan Xuan , Varun Viswanath , Sunny Chu , Owen Bartolf , Jessica Echterhoff , Edward Wang

Eye tracking is a key technology for gaze-based interactions in Extended Reality (XR), but traditional frame-based systems struggle to meet XR's demands for high accuracy, low latency, and power efficiency. Event cameras offer a promising…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Junyuan Ding , Ziteng Wang , Chang Gao , Min Liu , Qinyu Chen

Estimating eye-gaze from images alone is a challenging task, in large parts due to un-observable person-specific factors. Achieving high accuracy typically requires labeled data from test users which may not be attainable in real…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Seonwook Park , Emre Aksan , Xucong Zhang , Otmar Hilliges

We present two methods for fast and precise eye-tracking in VR headsets. Both methods exploit deflectometric information, i.e., the specular reflection of an extended screen over the eye surface.

Human-Computer Interaction · Computer Science 2023-04-21 Jiazhang Wang , Tianfu Wang , Bingjie Xu , Oliver Cossairt , Florian Willomitzer

In this paper, we present two approaches and algorithms that adapt areas of interest We present a new deep neural network (DNN) that can be used to directly determine gaze position using EEG data. EEG-based eye tracking is a new and…

Signal Processing · Electrical Eng. & Systems 2023-03-13 Wolfgang Fuhl , Susanne Zabel , Theresa Harbig , Julia Astrid Moldt , Teresa Festl Wiete , Anne Herrmann Werner , Kay Nieselt

We present a new and accurate approach for gaze estimation on consumer computing devices. We take advantage of continued strides in the quality of user-facing cameras found in e.g., smartphones, laptops, and desktops - 4K or greater in…

Human-Computer Interaction · Computer Science 2026-03-23 Taejun Kim , Vimal Mollyn , Riku Arakawa , Chris Harrison

We present a novel, automatic eye gaze tracking scheme inspired by smooth pursuit eye motion while playing mobile games or watching virtual reality contents. Our algorithm continuously calibrates an eye tracking system for a head mounted…

Computer Vision and Pattern Recognition · Computer Science 2016-12-22 Subarna Tripathi , Brian Guenter

With advancements in AI, new gaze estimation methods are exceeding state-of-the-art (SOTA) benchmarks, but their real-world application reveals a gap with commercial eye-tracking solutions. Factors like model size, inference time, and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Eduardo Davalos , Yike Zhang , Namrata Srivastava , Yashvitha Thatigotla , Jorge A. Salas , Sara McFadden , Sun-Joo Cho , Amanda Goodwin , Ashwin TS , Gautam Biswas

Eye-gaze tracking research offers significant promise in enhancing various healthcare-related tasks, above all in medical image analysis and interpretation. Eye tracking, a technology that monitors and records the movement of the eyes,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-13 Sahar Moradizeyveh , Mehnaz Tabassum , Sidong Liu , Robert Ahadizad Newport , Amin Beheshti , Antonio Di Ieva

Eyeframe lens tracing is an important process in the optical industry that requires sub-millimeter precision to ensure proper lens fitting and optimal vision correction. Traditional frame tracers rely on mechanical tools that need precise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Manel Guzmán , Antonio Agudo

Gaze tracking is a valuable tool with a broad range of applications in various fields, including medicine, psychology, virtual reality, marketing, and safety. Therefore, it is essential to have gaze tracking software that is cost-efficient…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Galen O'Shea , Majid Komeili