English
Related papers

Related papers: Exploring the Feasibility of Gaze-Based Navigation…

200 papers

Over the past few years, there has been an increasing interest to interpret gaze direction in an unconstrained environment with limited supervision. Owing to data curation and annotation issues, replicating gaze estimation method to other…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Shreya Ghosh , Abhinav Dhall , Jarrod Knibbe , Munawar Hayat

We study the problem of learning a generalizable action policy for an intelligent agent to actively approach an object of interest in an indoor environment solely from its visual inputs. While scene-driven or recognition-driven visual…

Robotics · Computer Science 2019-03-08 Xin Ye , Zhe Lin , Joon-Young Lee , Jianming Zhang , Shibin Zheng , Yezhou Yang

With the rising prevalence of autism diagnoses, it is essential for research to understand how to leverage technology to support the diverse nature of autistic traits. While traditional interventions focused on technology for medical cure…

Human-Computer Interaction · Computer Science 2022-04-05 Katherine Wang , Simon Julier , Youngjun Cho

Recently, Transformer has made significant progress in various vision tasks. To balance computation and efficiency in video tasks, recent works heavily rely on factorized or window-based self-attention. However, these approaches split…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Bohao Xing , Deng Li , Rong Gao , Xin Liu , Heikki Kälviäinen

Eye tracking has become increasingly important in virtual and augmented reality applications; however, the current gaze accuracy falls short of meeting the requirements for spatial computing. We designed a gaze collection framework and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Xiaoyin Yang

This paper investigates multi-selection in XR interfaces based on eye and hand interaction. We propose enabling multi-selection using different variations of techniques that combine gaze with a semi-pinch gesture, allowing users to select…

Human-Computer Interaction · Computer Science 2025-03-13 Jinwook Kim , Sangmin Park , Qiushi Zhou , Mar Gonzalez-Franco , Jeongmi Lee , Ken Pfeuffer

Eye tracking research is important in computer vision because it can help us understand how humans interact with the visual world. Specifically for high-risk applications, such as in medical imaging, eye tracking can help us to comprehend…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Bin Wang , Hongyi Pan , Armstrong Aboah , Zheyuan Zhang , Elif Keles , Drew Torigian , Baris Turkbey , Elizabeth Krupinski , Jayaram Udupa , Ulas Bagci

Non-invasive gaze estimation methods usually regress gaze directions directly from a single face or eye image. However, due to important variabilities in eye shapes and inner eye structures amongst individuals, universal models obtain…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Gang Liu , Yu Yu , Kenneth A. Funes Mora , Jean-Marc Odobez

Uniform and variable environments still remain a challenge for stable visual localization and mapping in mobile robot navigation. One of the possible approaches suitable for such environments is appearance-based teach-and-repeat navigation,…

Robotics · Computer Science 2025-03-18 Václav Truhlařík , Tomáš Pivoňka , Michal Kasarda , Libor Přeučil

Navigation for blind persons represents a challenge for researchers in vision substitution. In this field, one of the used techniques to navigate is guidance. In this study, we develop a new approach for 3D trajectory following in which the…

Human-Computer Interaction · Computer Science 2013-10-17 Abdessalem Chekhchoukh , Malik Goumidi , Nicolas Vuillerme , Yohan Payan , Nicolas Glade

Precise estimation of global orientation and location is critical to ensure a compelling outdoor Augmented Reality (AR) experience. We address the problem of geo-pose estimation by cross-view matching of query ground images to a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Niluthpol Chowdhury Mithun , Kshitij Minhas , Han-Pang Chiu , Taragay Oskiper , Mikhail Sizintsev , Supun Samarasekera , Rakesh Kumar

In this paper, we present an analysis of eye gaze patterns pertaining to visual cues in augmented reality (AR) for head-mounted displays (HMDs). We conducted an experimental study involving a picking and assembly task, which was guided by…

Human-Computer Interaction · Computer Science 2021-11-09 Arne Seeliger , Gerrit Merz , Christian Holz , Stefan Feuerriegel

Gaze estimation is a fundamental task in many applications of computer vision, human computer interaction and robotics. Many state-of-the-art methods are trained and tested on custom datasets, making comparison across methods challenging.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Xucong Zhang , Seonwook Park , Thabo Beeler , Derek Bradley , Siyu Tang , Otmar Hilliges

As an indicator of human attention gaze is a subtle behavioral cue which can be exploited in many applications. However, inferring 3D gaze direction is challenging even for deep neural networks given the lack of large amount of data…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Yu Yu , Gang Liu , Jean-Marc Odobez

Over the past decade, the demand for communication devices has increased among individuals with mobility and speech impairments. Eye-gaze tracking has emerged as a promising solution for hands-free communication; however, traditional…

Human-Computer Interaction · Computer Science 2025-08-26 Yogesh Kumar Meena , Manish Salvi

Extended reality (XR) is touted as the next frontier of the digital future. XR includes all immersive technologies of augmented reality (AR), virtual reality (VR), and mixed reality (MR). XR applications obtain the real-world context of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-12 Jin Heo , Ketan Bhardwaj , Ada Gavrilovska

This paper presents GazeRace, a novel system that leverages eye-tracking technology for intuitive drone control. Using the MediaPipe library, the system translates eye movements into precise drone commands, enabling effective remote…

A user's eyes provide means for Human Computer Interaction (HCI) research as an important modal. The time to time scientific explorations of the eye has already seen an upsurge of the benefits in HCI applications from gaze estimation to the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Atul Sahay , Imon Mukherjee , Kavi Arya

The eyes play an important role in human collaboration. Mutual and shared gaze help communicate visual attention to each other or to a specific object of interest. Shared gaze was typically investigated for pair collaborations in remote…

Blind individuals face persistent challenges in last-mile navigation, including locating entrances, identifying obstacles, and navigating complex or cluttered spaces. Although wearable cameras are increasingly used in assistive systems,…

Human-Computer Interaction · Computer Science 2025-04-29 Apurv Varshney , Lucas Nadolskis , Tobias Höllerer , Michael Beyeler