English
Related papers

Related papers: When Eye-Tracking Meets Machine Learning: A System…

200 papers

Eye-tracking data reveals valuable insights into users' cognitive states but is difficult to analyze due to its structured, non-linguistic nature. While large language models (LLMs) excel at reasoning over text, they struggle with temporal…

Human-Computer Interaction · Computer Science 2025-07-25 Dongyang Guo , Yasmeen Abdrabou , Enkeleda Thaqi , Enkelejda Kasneci

This work presents a next-generation human-robot interface that can infer and realize the user's manipulation intention via sight only. Specifically, we develop a system that integrates near-eye-tracking and robotic manipulation to enable…

Robotics · Computer Science 2023-05-16 Shaochen Wang , Wei Zhang , Zhangli Zhou , Jiaxi Cao , Ziyang Chen , Kang Chen , Bin Li , Zhen Kan

From scientific research to commercial applications, eye tracking is an important tool across many domains. Despite its range of applications, eye tracking has yet to become a pervasive technology. We believe that we can put the power of…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Kyle Krafka , Aditya Khosla , Petr Kellnhofer , Harini Kannan , Suchendra Bhandarkar , Wojciech Matusik , Antonio Torralba

There is a growing need to assist radiologists in performing X-ray readings and diagnoses fast, comfortably, and effectively. As radiologists strive to maximize productivity, it is essential to consider the impact of reading rooms in…

Human-Computer Interaction · Computer Science 2022-03-04 Catarina Moreira , Isabel Blanco Nobre , Sandra Costa Sousa , João Madeiras Pereira , Joaquim Jorge

There is a growing trend of applying machine learning methods to medical datasets in order to predict patients' future status. Although some of these methods achieve high performance, challenges still exist in comparing and evaluating…

Medical Physics · Physics 2020-03-25 Yiran Li , Takanori Fujiwara , Yong K. Choi , Katherine K. Kim , Kwan-Liu Ma

Losing track of reading progress during line switching can be frustrating. Eye gaze tracking technology offers a potential solution by highlighting read paragraphs, aiding users in avoiding wrong line switches. However, the gap between gaze…

Human-Computer Interaction · Computer Science 2024-12-16 Sikai Yang , Gang Yan , Wan Du

Virtual reality (VR) is not a new technology but has been in development for decades, driven by advances in computer technology. Currently, VR technology is increasingly being used in applications to enable immersive, yet controlled…

Human-Computer Interaction · Computer Science 2022-11-24 Hong Gao

ADHD is being recognized as a diagnosis which persists into adulthood impacting economic, occupational, and educational outcomes. There is an increased need to accurately diagnose and recommend interventions for this population. One…

Human-Computer Interaction · Computer Science 2019-06-19 Gavindya Jayawardena , Anne Michalek , Sampath Jayarathna

Dyslexia, affecting an estimated 10% to 20% of the global population, significantly impairs learning capabilities, highlighting the need for innovative and accessible diagnostic methods. This paper investigates the effectiveness of…

Machine Learning · Computer Science 2025-06-16 Kevin Cogan , Vuong M. Ngo , Mark Roantree

This study introduced a novel system, called Gaze2Segment, integrating biological and computer vision techniques to support radiologists' reading experience with an automatic image segmentation task. During diagnostic assessment of lung CT…

This paper proposes a novel multimodal DL architecture incorporating medical images and eye-tracking data for abnormality detection in chest x-rays. Our results show that applying eye gaze data directly into DL architectures does not show…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 André Luís , Chihcheng Hsieh , Isabel Blanco Nobre , Sandra Costa Sousa , Anderson Maciel , Catarina Moreira , Joaquim Jorge

Shared control improves Human-Robot Interaction by reducing the user's workload and increasing the robot's autonomy. It allows robots to perform tasks under the user's supervision. Current eye-tracking-driven approaches face several…

Robotics · Computer Science 2026-01-27 Anke Fischer-Janzen , Thomas M. Wendt , Kristof Van Laerhoven

Eye-tracking has potential to provide rich behavioral data about human cognition in ecologically valid environments. However, analyzing this rich data is often challenging. Most automated analyses are specific to simplistic artificial…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Karan Uppal , Jaeah Kim , Shashank Singh

Webcam eye tracking for the collection of gaze data in the context of user studies is convenient - it can be used in remote tests where participants do not need special hardware. The approach has strong limitations, especially regarding the…

Human-Computer Interaction · Computer Science 2022-08-01 Sezen Lim , Tina Walber , Christoph Schaefer , Lena Riehl

Recent advancements in Computer Assisted Diagnosis have shown promising performance in medical imaging tasks, particularly in chest X-ray analysis. However, the interaction between these models and radiologists has been primarily limited to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Yunsoo Kim , Jinge Wu , Yusuf Abdulle , Yue Gao , Honghan Wu

Charts are a crucial visual medium for communicating and representing information. While Large Vision-Language Models (LVLMs) have made progress on chart question answering (CQA), the task remains challenging, particularly when models…

Computation and Language · Computer Science 2025-09-17 Ali Salamatian , Amirhossein Abaskohi , Wan-Cyuan Fan , Mir Rayat Imtiaz Hossain , Leonid Sigal , Giuseppe Carenini

The global need for effective disease diagnosis remains substantial, given the complexities of various disease mechanisms and diverse patient symptoms. To tackle these challenges, researchers, physicians, and patients are turning to machine…

Machine Learning · Computer Science 2023-10-27 S M Atikur Rahman , Sifat Ibtisum , Ehsan Bazgir , Tumpa Barai

Deep learning has bolstered gaze estimation techniques, but real-world deployment has been impeded by inadequate training datasets. This problem is exacerbated by both hardware-induced variations in eye images and inherent biological…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Sean Anthony Byrne , Virmarie Maquiling , Marcus Nyström , Enkelejda Kasneci , Diederick C. Niehorster

The advent of industrial robotics and autonomous systems endow human-robot collaboration in a massive scale. However, current industrial robots are restrained in co-working with human in close proximity due to inability of interpreting…

Robotics · Computer Science 2023-04-24 Zhuangzhuang Dai , Jinha Park , Aleksandra Kaszowska , Chen Li

Eye image segmentation is a critical step in eye tracking that has great influence over the final gaze estimate. Segmentation models trained using supervised machine learning can excel at this task, their effectiveness is determined by the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Viet Dung Nguyen , Reynold Bailey , Gabriel J. Diaz , Chengyi Ma , Alexander Fix , Alexander Ororbia