English
Related papers

Related papers: Gaze-Hand Steering for Travel and Multitasking in …

200 papers

In this work, we explore the integration of discontinuous Orientation Selection into steering interfaces intending to preserve the seamless sensation of real-world movement, while mitigating the risk of inducing cybersickness. Our…

Human-Computer Interaction · Computer Science 2024-06-21 Daniel Zielasko , Maximilian Späth , Matthias Wölwer

Leveraging real-time eye-tracking, foveated rendering optimizes hardware efficiency and enhances visual quality virtual reality (VR). This approach leverages eye-tracking techniques to determine where the user is looking, allowing the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Wenxuan Liu , Monde Duinkharjav , Qi Sun , Sai Qian Zhang

This paper presents GazeRace, a novel system that leverages eye-tracking technology for intuitive drone control. Using the MediaPipe library, the system translates eye movements into precise drone commands, enabling effective remote…

Eye tracking has become increasingly important in virtual and augmented reality applications; however, the current gaze accuracy falls short of meeting the requirements for spatial computing. We designed a gaze collection framework and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Xiaoyin Yang

As social VR applications grow in popularity, blind and low vision users encounter continued accessibility barriers. Yet social VR, which enables multiple people to engage in the same virtual space, presents a unique opportunity to allow…

Human-Computer Interaction · Computer Science 2024-10-30 Jazmin Collins , Crescentia Jung , Yeonju Jang , Danielle Montour , Andrea Stevenson Won , Shiri Azenkot

Hand pointing and eye gaze have been extensively investigated in automotive applications for object selection and referencing. Despite significant advances, existing outside-the-vehicle referencing methods consider these modalities…

Human-Computer Interaction · Computer Science 2021-01-13 Amr Gomaa , Guillermo Reyes , Alexandra Alles , Lydia Rupp , Michael Feld

Teleportation, a widely-used locomotion technique in Virtual Reality (VR), allows instantaneous movement within VR environments. Enhanced hand tracking in modern VR headsets has popularized hands-only teleportation methods, which eliminate…

Human-Computer Interaction · Computer Science 2024-04-23 Siddhanth Raja Sindhupathiraja , A K M Amanat Ullah , William Delamare , Khalad Hasan

In recent years we have witnessed an increasing number of interactive systems on handheld mobile devices which utilise gaze as a single or complementary interaction modality. This trend is driven by the enhanced computational power of these…

Human-Computer Interaction · Computer Science 2023-07-04 Yaxiong Lei , Shijing He , Mohamed Khamis , Juan Ye

This paper presents a VR-based guide dog training system designed to assist novice trainers in understanding guide dog behavior and issuing appropriate training commands. Guide dogs play a vital role in supporting independent mobility for…

Human-Computer Interaction · Computer Science 2025-10-29 Qirong Zhu , Ansheng Wang , Shinji Tanaka , Yasutoshi Makino , Hiroyuki Shinoda

Seated VR locomotion in constrained environments, including homes, offices, and transit settings, calls for hardware that is lightweight and deployable, steering that remains continuous enough for curved motion, and a control channel that…

Human-Computer Interaction · Computer Science 2026-04-14 Bin Hu , Yang Liu , Xizi Liu , Qinggerou Xiao , Xiru Wang , Zhe Yuan , Wen Ku , Xiu Li , Yun Wang

A high-precision manipulation task, such as needle threading, is challenging. Physiological studies have proposed connecting low-resolution peripheral vision and fast movement to transport the hand into the vicinity of an object, and using…

Robotics · Computer Science 2025-05-23 Heecheol Kim , Yoshiyuki Ohmura , Yasuo Kuniyoshi

Navigating peripersonal space requires reaching targets in both horizontal (e.g., desks) and vertical (e.g., shelves) layouts with high precision. We developed a haptic glove to aid peri-personal target navigation and investigated the…

Human-Computer Interaction · Computer Science 2025-10-13 Mahdis Tajdari , Jason Forsyth , Sol Lim

Interaction in virtual reality (VR) environments is essential to achieve a pleasant and immersive experience. Most of the currently existing VR applications, lack of robust object grasping and manipulation, which are the cornerstone of…

Retargeting methods that modify the visual representation of real movements have been widely used to expand the interaction space and create engaging virtual reality experiences. For optimal user experience and performance, it is essential…

Human-Computer Interaction · Computer Science 2024-09-02 Hyunyoung Jang , Jinwook Kim , Jeongmi Lee

Manual (hand-related) activity is a significant source of crash risk while driving. Accordingly, analysis of hand position and hand activity occupation is a useful component to understanding a driver's readiness to take control of a…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Ross Greer , Lulua Rakla , Anish Gopalan , Mohan Trivedi

Window management in virtual reality (VR) remains a challenging task due to the spatial complexity and physical demands of current interaction methods. We introduce Handows, a palm-based interface that enables direct manipulation of spatial…

Human-Computer Interaction · Computer Science 2025-08-14 Jindu Wang , Ke Zhou , Haoyu Ren , Per Ola Kristensson , Xiang Li

This paper explores the estimation of user attention in the setting of a cooperative handheld robot: a robot designed to behave as a handheld tool but that has levels of task knowledge. We use a tool-mounted gaze tracking system, which,…

Robotics · Computer Science 2018-10-16 Janis Stolzenwald , Walterio W. Mayol-Cuevas

Navigating spaces is an embodied experience. Examples can vary from rescue workers trying to save people from natural disasters; a tourist finding their way to the nearest coffee shop, or a gamer solving a maze. Virtual reality allows these…

Human-Computer Interaction · Computer Science 2018-09-24 Aryabrata Basu , Kyle Johnsen

Unconstrained remote gaze estimation remains challenging mostly due to its vulnerability to the large variability in head-pose. Prior solutions struggle to maintain reliable accuracy in unconstrained remote gaze tracking. Among them,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Zhecan Wang , Jian Zhao , Cheng Lu , Han Huang , Fan Yang , Lianji Li , Yandong Guo

Reliably planning fingertip grasps for multi-fingered hands lies as a key challenge for many tasks including tool use, insertion, and dexterous in-hand manipulation. This task becomes even more difficult when the robot lacks an accurate…

Robotics · Computer Science 2022-12-19 Martin Matak , Tucker Hermans