English
Related papers

Related papers: WigglyEyes: Inferring Eye Movements from Keypress …

200 papers

Tactile sensation is essential for contact-rich manipulation tasks. It provides direct feedback on object geometry, surface properties, and interaction forces, enhancing perception and enabling fine-grained control. An inherent limitation…

Eye movements are known to reflect cognitive processes in reading, and psychological reading research has shown that eye gaze patterns differ between readers with and without dyslexia. In recent years, researchers have attempted to classify…

Computation and Language · Computer Science 2022-12-05 Patrick Haller , Andreas Säuberli , Sarah Elisabeth Kiener , Jinger Pan , Ming Yan , Lena Jäger

This paper presents a new way of getting high-quality saliency maps for video, using a cheaper alternative to eye-tracking data. We designed a mouse-contingent video viewing system which simulates the viewers' peripheral vision based on the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-02 Vitaliy Lyudvichenko , Dmitriy Vatolin

Predicting human motion is critical for assistive robots and AR/VR applications, where the interaction with humans needs to be safe and comfortable. Meanwhile, an accurate prediction depends on understanding both the scene context and human…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Yang Zheng , Yanchao Yang , Kaichun Mo , Jiaman Li , Tao Yu , Yebin Liu , C. Karen Liu , Leonidas J. Guibas

Despite steady progress, text entry in Extended Reality (XR) often remains slower and more effortful than typing on a physical keyboard or touchscreen. We explore a simple idea: use gaze to swipe through a virtual keyboard for the fast,…

Human-Computer Interaction · Computer Science 2026-04-07 Ziheng "Leo" Li , Xichen He , Mengyuan "Millie" Wu , Zeyi Tong , Haowen Wei , Benjamin Yang , Steven Feiner , Paul Sajda

In this paper a number of problems are considered which are related to the modelling of eye guidance under visual attention in a natural setting. From a crude discussion of a variety of available models spelled in probabilistic terms, it…

Computer Vision and Pattern Recognition · Computer Science 2016-09-20 Giuseppe Boccignone

Pose tracking is an important problem that requires identifying unique human pose-instances and matching them temporally across different frames of a video. However, existing pose tracking methods are unable to accurately model temporal…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Michael Snower , Asim Kadav , Farley Lai , Hans Peter Graf

Emotion recognition,as a step toward mind reading,seeks to infer internal states from external cues.Most existing methods rely on explicit signals-such as facial expressions,speech,or gestures-that reflect only bodily responses and overlook…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Mengke Song , Yuge Xie , Qi Cui , Luming Li , Xinyu Liu , Guotao Wang , Chenglizhao Chen , Shanchen Pang

Electroencephalography-based eye tracking (EEG-ET) leverages eye movement artifacts in EEG signals as an alternative to camera-based tracking. While EEG-ET offers advantages such as robustness in low-light conditions and better integration…

Signal Processing · Electrical Eng. & Systems 2025-03-19 Tiago Vasconcelos Afonso , Florian Heinrichs

Eye movements during reading offer insights into both the reader's cognitive processes and the characteristics of the text that is being read. Hence, the analysis of scanpaths in reading have attracted increasing attention across fields,…

Computation and Language · Computer Science 2023-05-19 Shuwen Deng , David R. Reich , Paul Prasse , Patrick Haller , Tobias Scheffer , Lena A. Jäger

Consumers conducting comparison shopping, researchers making sense of competitive space, and developers looking for code snippets online all face the challenge of capturing the information they find for later use without interrupting their…

Human-Computer Interaction · Computer Science 2022-08-02 Michael Xieyang Liu , Andrew Kuznetsov , Yongsung Kim , Joseph Chee Chang , Aniket Kittur , Brad A. Myers

Shared control improves Human-Robot Interaction by reducing the user's workload and increasing the robot's autonomy. It allows robots to perform tasks under the user's supervision. Current eye-tracking-driven approaches face several…

Robotics · Computer Science 2026-01-27 Anke Fischer-Janzen , Thomas M. Wendt , Kristof Van Laerhoven

Accurate emotion recognition is pivotal for nuanced and engaging human-computer interactions, yet remains difficult to achieve, especially in dynamic, conversation-like settings. In this study, we showcase how integrating eye-tracking data,…

Human-Computer Interaction · Computer Science 2025-11-03 Meisam Jamshidi Seikavandi , Jostein Fimland , Maria Barrett , Paolo Burelli

In human-robot interaction (HRI), detecting a human's gaze helps robots interpret user attention and intent. However, most gaze detection approaches rely on specialized eye-tracking hardware, limiting deployment in everyday settings.…

Robotics · Computer Science 2026-03-18 Linlin Cheng , Koen Hindriks , Artem V. Belopolsky

Analyzing the gaze accuracy characteristics of an eye tracker is a critical task as its gaze data is frequently affected by non-ideal operating conditions in various consumer eye tracking applications. In this study, gaze error patterns…

Signal Processing · Electrical Eng. & Systems 2020-05-11 Anuradha Kar

Some visual search tasks require to memorize the location of stimuli that have been previously scanned. Considerations about the eye movements raise the question of how we are able to maintain a coherent memory, despite the frequent…

Neural and Evolutionary Computing · Computer Science 2016-08-16 Jérémy Fix , Julien Vitay , Nicolas Rougier

The latest developments in computer hardware, sensor technologies, and artificial intelligence can make virtual reality (VR) and virtual spaces an important part of human everyday life. Eye tracking offers not only a hands-free way of…

Human-Computer Interaction · Computer Science 2026-01-21 Efe Bozkir , Süleyman Özdel , Mengdi Wang , Brendan David-John , Hong Gao , Kevin Butler , Eakta Jain , Enkelejda Kasneci

This study investigates the capability blessings of the use of eye-monitoring technology to beautify the usability of web sites. With the upward thrust of on-line interactions, website usability has turn out to be increasingly important for…

Other Computer Science · Computer Science 2023-05-23 Niharika Veeravalli

User's mental state is concerned gradually, during the interaction course of human robot. As the measurement and identification method of psychological state, tension, has certain practical significance role. At presents there is no…

Robotics · Computer Science 2014-09-18 Yi Wang

Multimodal large language models (LMMs) excel in world knowledge and problem-solving abilities. Through the use of a world-facing camera and contextual AI, emerging smart accessories aim to provide a seamless interface between humans and…

Human-Computer Interaction · Computer Science 2024-02-01 Robert Konrad , Nitish Padmanaban , J. Gabriel Buckmaster , Kevin C. Boyle , Gordon Wetzstein