English
Related papers

Related papers: Eye-Tracking-Driven Control in Daily Task Assistan…

200 papers

In human-robot interaction (HRI), detecting a human's gaze helps robots interpret user attention and intent. However, most gaze detection approaches rely on specialized eye-tracking hardware, limiting deployment in everyday settings.…

Robotics · Computer Science 2026-03-18 Linlin Cheng , Koen Hindriks , Artem V. Belopolsky

The gaze of a person tends to reflect their interest. This work explores what happens when this statement is taken literally and applied to robots. Here we present a robot system that employs a moving robot head with a screen-based eye…

Robotics · Computer Science 2025-11-05 Matti Krüger , Daniel Tanneberg , Chao Wang , Stephan Hasler , Michael Gienger

We present GazeGrasp, a gaze-based manipulation system enabling individuals with motor impairments to control collaborative robots using eye-gaze. The system employs an ESP32 CAM for eye tracking, MediaPipe for gaze detection, and YOLOv8…

As head-mounted displays (HMDs) with eye-tracking become increasingly accessible, the need for effective gaze-based interfaces in virtual reality (VR) grows. Traditional gaze- or hand-based navigation often limits user precision or impairs…

Human-Computer Interaction · Computer Science 2025-04-03 Mona Zavichi , André Santos , Catarina Moreira , Anderson Maciel , Joaquim Jorge

The latest developments in computer hardware, sensor technologies, and artificial intelligence can make virtual reality (VR) and virtual spaces an important part of human everyday life. Eye tracking offers not only a hands-free way of…

Human-Computer Interaction · Computer Science 2026-01-21 Efe Bozkir , Süleyman Özdel , Mengdi Wang , Brendan David-John , Hong Gao , Kevin Butler , Eakta Jain , Enkelejda Kasneci

Understanding human interaction with objects is an important research topic for embodied Artificial Intelligence and identifying the objects that humans are interacting with is a primary problem for interaction understanding. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Yanyan Shao , Qi Ye , Wenhan Luo , Kaihao Zhang , Jiming Chen

Highly constrained manipulation tasks continue to be challenging for autonomous robots as they require high levels of precision, typically less than 1mm, which is often incompatible with what can be achieved by traditional perception…

Robotics · Computer Science 2021-12-20 Andrew S. Morgan , Bowen Wen , Junchi Liang , Abdeslam Boularias , Aaron M. Dollar , Kostas Bekris

This work proposes a biologically inspired approach that focuses on attention systems that are able to inhibit or constrain what is relevant at any one moment. We propose a radically new approach to making progress in human-robot joint…

Robotics · Computer Science 2016-06-09 Nick DePalma , Cynthia Breazeal

Eye tracking is handled as one of the key technologies for applications that assess and evaluate human attention, behavior, and biometrics, especially using gaze, pupillary, and blink behaviors. One of the challenges with regard to the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Efe Bozkir , Ali Burak Ünal , Mete Akgün , Enkelejda Kasneci , Nico Pfeifer

One of the major challenges for evaluating the effectiveness of data visualizations and visual analytics tools arises from the fact that different users may be using these tools for different tasks. In this paper, we present a simple…

Human-Computer Interaction · Computer Science 2020-10-01 Laura Matzen , Kristin Divis , Deborah Cronin , Michael Haass

Interactive evolution has shown the potential to create amazing and complex forms in both 2-D and 3-D settings. However, the algorithm is slow and users quickly become fatigued. We propose that the use of eye tracking for interactive…

Neural and Evolutionary Computing · Computer Science 2013-04-22 Nick Cheney , Jeff Clune , Jason Yosinski , Hod Lipson

Do patterns of eye-hand coordination observed during real-world object interactions apply to digital, screen-based object interactions? We adapted a real-world object interaction task (physically transferring cups in sequence about a…

Human-Computer Interaction · Computer Science 2023-06-07 Jennifer K Bertrand , Craig S Chapman

Gaze-tracking is a novel way of interacting with computers which allows new scenarios, such as enabling people with motor-neuron disabilities to control their computers or doctors to interact with patient information without touching screen…

Artificial Intelligence · Computer Science 2020-10-13 Jatin Sharma , Jon Campbell , Pete Ansell , Jay Beavers , Christopher O'Dowd

Grasping constitutes a critical challenge for visually impaired people. To address this problem, we developed a tactile bracelet that assists in grasping by guiding the user's hand to a target object using vibration commands. Here we…

Human-Computer Interaction · Computer Science 2025-04-24 Marcin Furtak , Florian Pätzold , Tim Kietzmann , Silke M. Kärcher , Peter König

Eye-tracking is a vital technology for human-computer interaction, especially in wearable devices such as AR, VR, and XR. The realization of high-speed and high-precision eye-tracking using frame-based image sensors is constrained by their…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Hongwei Ren , Xiaopeng Lin , Hongxiang Huang , Yue Zhou , Bojun Cheng

An important factor in developing control models for human-robot collaboration is how acceptable they are to their human partners. One such method for creating acceptable control models is to attempt to mimic human-like behaviour in robots…

Robotics · Computer Science 2022-07-12 Rebeka Kropivšek Leskovar , Tadej Petrič

As human eyes serve as conduits of rich information, unveiling emotions, intentions, and even aspects of an individual's health and overall well-being, gaze tracking also enables various human-computer interaction applications, as well as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Sikai Yang , Wan Du

In this study, we develop a simple daily assistive robot that controls its own vision according to linguistic instructions. The robot performs several daily tasks such as recording a user's face, hands, or screen, and remotely capturing…

Robotics · Computer Science 2024-03-19 Kento Kawaharazuka , Naoaki Kanazawa , Yoshiki Obinata , Kei Okada , Masayuki Inaba

Retinal image-based eye tracking is widely used in ophthalmic imaging and vision science, and is a promising path to deliver higher gaze accuracy than the pupil- and cornea-based approaches commonly used in modern AR/VR devices.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Bo Wen , Dillon Lohr , Yatong An , Pushkar Anand , Alexander Fix , Ruobing Qian , Catherine A. Fromm , Yimin Ding , Truong Nguyen , Mohamed El-Haddad , Francesco La Rocca

Recent advancements in eye tracking technology are driving the adoption of gaze-assisted interaction as a rich and accessible human-computer interaction paradigm. Gaze-assisted interaction serves as a contextual, non-invasive, and explicit…

Human-Computer Interaction · Computer Science 2018-03-14 Vijay Rajanna , Tracy Hammond