English
Related papers

Related papers: Efficient Eye Typing with 9-direction Gaze Estimat…

200 papers

Although eye-tracking technology is being integrated into more VR and MR headsets, the true potential of eye tracking in enhancing user interactions within XR settings remains relatively untapped. Presently, one of the most prevalent gaze…

Human-Computer Interaction · Computer Science 2024-05-24 Naveen Sendhilnathan , Ajoy S. Fernandes , Michael J. Proulx , Tanya R. Jonker

Despite steady progress, text entry in Extended Reality (XR) often remains slower and more effortful than typing on a physical keyboard or touchscreen. We explore a simple idea: use gaze to swipe through a virtual keyboard for the fast,…

Human-Computer Interaction · Computer Science 2026-04-07 Ziheng "Leo" Li , Xichen He , Mengyuan "Millie" Wu , Zeyi Tong , Haowen Wei , Benjamin Yang , Steven Feiner , Paul Sajda

Eye typing interfaces enable a person to enter text into an interface using only their own eyes. But despite the inherent advantages of touchless operation and intuitive design, such eye-typing interfaces often suffer from slow typing…

Human-Computer Interaction · Computer Science 2023-12-15 Zhe Zeng , Xiao Wang , Felix Wilhelm Siebert , Hailong Liu

While passive surfaces offer numerous benefits for interaction in mixed reality, reliably detecting touch input solely from head-mounted cameras has been a long-standing challenge. Camera specifics, hand self-occlusion, and rapid movements…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Paul Streli , Mark Richardson , Fadi Botros , Shugao Ma , Robert Wang , Christian Holz

Vision-Language Models (VLMs) deliver impressive performance in understanding visual content with language instructions. However, redundancy in vision tokens results in the degenerated inference efficiency of VLMs, which hinders real-time…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Qinyu Chen , Jiawen Qi

We present a novel approach for determining learners' second language proficiency which utilizes behavioral traces of eye movements during reading. Our approach provides stand-alone eyetracking based English proficiency scores which reflect…

Computation and Language · Computer Science 2018-04-25 Yevgeni Berzak , Boris Katz , Roger Levy

Smartphones with large screens provide users with increased display and interaction space but pose challenges in reaching certain areas with the thumb when using the device with one hand. To address this, we introduce GazeSwipe, a…

Human-Computer Interaction · Computer Science 2025-03-28 Zhuojiang Cai , Jingkai Hong , Zhimin Wang , Feng Lu

One of the most important ways to experience communication and interact with the systems is by handling the prediction of the most likely words to happen after typing letters or words. It is helpful for people with disabilities due to…

Neural and Evolutionary Computing · Computer Science 2022-01-27 Hozan K. Hamarashid , Soran A. Saeed , Tarik A. Rashid

Gaze behaviour has been used as a way to gather cognitive information for a number of years. In this paper, we discuss the use of gaze behaviour in solving different tasks in natural language processing (NLP) without having to record it at…

Computation and Language · Computer Science 2022-01-04 Sandeep Mathias , Diptesh Kanojia , Abhijit Mishra , Pushpak Bhattacharyya

Estimating human gaze from natural eye images only is a challenging task. Gaze direction can be defined by the pupil- and the eyeball center where the latter is unobservable in 2D images. Hence, achieving highly accurate gaze estimates is…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Seonwook Park , Adrian Spurr , Otmar Hilliges

Several changes occur in the brain in response to voluntary and involuntary activities performed by a person. The ability to retrieve data from the brain within a time space provides a basis for in-depth analyses that offer insight on what…

Human-Computer Interaction · Computer Science 2020-06-30 Daniel Omeiza , Kayode Sakariyah Adewole , Daniel Nkemelu

Previous studies have illustrated the potential of analysing gaze behaviours in collaborative learning to provide educationally meaningful information for students to reflect on their learning. Over the past decades, machine learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Junyuan Liang , Qi Zhou , Sahan Bulathwela , Mutlu Cukurova

This work presents a next-generation human-robot interface that can infer and realize the user's manipulation intention via sight only. Specifically, we develop a system that integrates near-eye-tracking and robotic manipulation to enable…

Robotics · Computer Science 2023-05-16 Shaochen Wang , Wei Zhang , Zhangli Zhou , Jiaxi Cao , Ziyang Chen , Kang Chen , Bin Li , Zhen Kan

Event-based eye tracking holds significant promise for fine-grained cognitive state inference, offering high temporal resolution and robustness to motion artifacts, critical features for decoding subtle mental states such as attention,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Nuwan Bandara , Thivya Kandappu , Archan Misra

In reading tasks drift can move fixations from one word to another or even another line, invalidating the eye tracking recording. Manual correction is time-consuming and subjective, while automated correction is fast yet limited in…

Human-Computer Interaction · Computer Science 2025-01-14 Naser Al Madi , Brett Torra , Yixin Li , Najam Tariq

Over the past few years, there has been an increasing interest to interpret gaze direction in an unconstrained environment with limited supervision. Owing to data curation and annotation issues, replicating gaze estimation method to other…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Shreya Ghosh , Abhinav Dhall , Jarrod Knibbe , Munawar Hayat

We present See-Through Face Display, an eye-contact display system designed to enhance gaze awareness in both human-to-human and human-to-avatar communication. The system addresses the limitations of existing gaze correction methods by…

Human-Computer Interaction · Computer Science 2024-10-23 Kazuya Izumi , Ryosuke Hyakuta , Ippei Suzuki , Yoichi Ochiai

Visualization literacy assessments typically rely on correctness to classify performance, providing little evidence about how readers arrive at their answers. We argue that gaze can address this gap as an implicit process signal that…

Human-Computer Interaction · Computer Science 2026-03-25 Kathrin Schnizer

One of the main challenges of gaze-based interactions is the ability to distinguish normal eye function from a deliberate interaction with the computer system, commonly referred to as 'Midas touch'. In this paper we propose, EyeTAP (Eye…

Human-Computer Interaction · Computer Science 2021-06-18 Mohsen Parisay , Charalambos Poullis , Marta Kersten

Model-based eye tracking has been a dominant approach for eye gaze tracking because of its ability to generalize to different subjects, without the need of any training data and eye gaze annotations. Model-based eye tracking, however, is…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Qiang Ji , Kang Wang