English
Related papers

Related papers: VisiTrail: A Cognitive Visualization Tool for Time…

200 papers

Shared control improves Human-Robot Interaction by reducing the user's workload and increasing the robot's autonomy. It allows robots to perform tasks under the user's supervision. Current eye-tracking-driven approaches face several…

Robotics · Computer Science 2026-01-27 Anke Fischer-Janzen , Thomas M. Wendt , Kristof Van Laerhoven

Non-intrusive, real-time analysis of the dynamics of the eye region allows us to monitor humans' visual attention allocation and estimate their mental state during the performance of real-world tasks, which can potentially benefit a wide…

Human-Computer Interaction · Computer Science 2023-06-28 Li Ding , Jack Terwilliger , Aishni Parab , Meng Wang , Lex Fridman , Bruce Mehler , Bryan Reimer

From scientific research to commercial applications, eye tracking is an important tool across many domains. Despite its range of applications, eye tracking has yet to become a pervasive technology. We believe that we can put the power of…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Kyle Krafka , Aditya Khosla , Petr Kellnhofer , Harini Kannan , Suchendra Bhandarkar , Wojciech Matusik , Antonio Torralba

Existing visual tracking methods typically take an image patch as the reference of the target to perform tracking. However, a single image patch cannot provide a complete and precise concept of the target object as images are limited in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Xin Li , Yuqing Huang , Zhenyu He , Yaowei Wang , Huchuan Lu , Ming-Hsuan Yang

Self-attention learns pairwise interactions to model long-range dependencies, yielding great improvements for video action recognition. In this paper, we seek a deeper understanding of self-attention for temporal modeling in videos. We…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Bo He , Xitong Yang , Zuxuan Wu , Hao Chen , Ser-Nam Lim , Abhinav Shrivastava

Event-based eye tracking has become a pivotal technology for augmented reality and human-computer interaction. Yet, existing methods struggle with real-world challenges such as abrupt eye movements and environmental noise. Building on the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Hoang M. Truong , Vinh-Thuan Ly , Huy G. Tran , Thuan-Phat Nguyen , Tram T. Doan

As head-mounted displays (HMDs) with eye-tracking become increasingly accessible, the need for effective gaze-based interfaces in virtual reality (VR) grows. Traditional gaze- or hand-based navigation often limits user precision or impairs…

Human-Computer Interaction · Computer Science 2025-04-03 Mona Zavichi , André Santos , Catarina Moreira , Anderson Maciel , Joaquim Jorge

Over the past few years, there has been an increasing interest to interpret gaze direction in an unconstrained environment with limited supervision. Owing to data curation and annotation issues, replicating gaze estimation method to other…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Shreya Ghosh , Abhinav Dhall , Jarrod Knibbe , Munawar Hayat

This paper proposes an approach to detect information relevance during decision-making from eye movements in order to enable user interface adaptation. This is a challenging task because gaze behavior varies greatly across individual users…

Human-Computer Interaction · Computer Science 2020-07-28 Anna Maria Feit , Lukas Vordemann , Seonwook Park , Caterina Bérubé , Otmar Hilliges

The interaction between the vestibular and ocular system has primarily been studied in controlled environments. Consequently, off-the shelf tools for categorization of gaze events (e.g. fixations, pursuits, saccade) fail when head movements…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Rakshit Kothari , Zhizhuo Yang , Christopher Kanan , Reynold Bailey , Jeff Pelz , Gabriel Diaz

We present the Pascal animal classes Eye Tracking database. Our database comprises eye movement recordings compiled from forty users for the bird, cat, cow, dog, horse and sheep {trainval} sets from the VOC 2012 image set. Different from…

Human-Computer Interaction · Computer Science 2016-04-07 Syed Omer Gilani , Ramanathan Subramanian , Yan Yan , David Melcher , Nicu Sebe , Stefan Winkler

This work presents a next-generation human-robot interface that can infer and realize the user's manipulation intention via sight only. Specifically, we develop a system that integrates near-eye-tracking and robotic manipulation to enable…

Robotics · Computer Science 2023-05-16 Shaochen Wang , Wei Zhang , Zhangli Zhou , Jiaxi Cao , Ziyang Chen , Kang Chen , Bin Li , Zhen Kan

Gaze estimation is pivotal in human scene comprehension tasks, particularly in medical diagnostic analysis. Eye-tracking technology facilitates the recording of physicians' ocular movements during image interpretation, thereby elucidating…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Shaonan Liu , Wenting Chen , Jie Liu , Xiaoling Luo , Linlin Shen

Mobile eye-tracking systems have been available for about a decade now and are becoming increasingly popular in different fields of application, including marketing, sociology, usability studies and linguistics. While the user-friendliness…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Timothy Callemein , Kristof Van Beeck , Geert Brône , Toon Goedemé

Virtual Reality (VR) has been a beneficial training tool in fields such as advanced manufacturing. However, users may experience a high cognitive load due to various factors, such as the use of VR hardware or tasks within the VR…

Human-Computer Interaction · Computer Science 2024-11-21 Mahsa Nasri , Mehmet Kosa , Leanne Chukoskie , Mohsen Moghaddam , Casper Harteveld

Virtual reality (VR) can enrich neuropsychological testing, yet the ergonomic trade-offs of its input modes remain under-examined. Seventy-seven healthy volunteers-young (19-29 y) and middle-aged (35-56 y)-completed a VR Trail-Making Test…

Human-Computer Interaction · Computer Science 2025-06-26 Panagiotis Kourtesis , Evgenia Giatzoglou , Panagiotis Vorias , Katerina Alkisti Gounari , Eleni Orfanidou , Chrysanthi Nega

Purpose: Gaze-following, the task of inferring where individuals are looking, has been widely studied in computer vision, advancing research in visual attention modeling, social scene understanding, and human-robot interaction. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Keqi Chen , Séraphin Baributsa , Lilien Schewski , Vinkle Srivastav , Didier Mutter , Guido Beldi , Sandra Keller , Nicolas Padoy

A user's eyes provide means for Human Computer Interaction (HCI) research as an important modal. The time to time scientific explorations of the eye has already seen an upsurge of the benefits in HCI applications from gaze estimation to the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Atul Sahay , Imon Mukherjee , Kavi Arya

We present a novel approach for determining learners' second language proficiency which utilizes behavioral traces of eye movements during reading. Our approach provides stand-alone eyetracking based English proficiency scores which reflect…

Computation and Language · Computer Science 2018-04-25 Yevgeni Berzak , Boris Katz , Roger Levy

Exploring data relations across multiple views has been a common task in many domains such as bioinformatics, cybersecurity, and healthcare. To support this, various techniques (e.g., visual links and brushing and linking) are used to show…

Human-Computer Interaction · Computer Science 2025-05-30 Abdul Rahman Shaikh , Maoyuan Sun , Xingchen Liu , Hamed Alhoori , Jian Zhao , David Koop