English
Related papers

Related papers: Accessible Gesture-Driven Augmented Reality Intera…

200 papers

The ability to interpret social cues comes naturally for most people, but for those living with Autism Spectrum Disorder (ASD), some experience a deficiency in this area. This paper presents the development of a multimodal augmented reality…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 James Ren Hou Lee , Alexander Wong

Recent advancements in eye tracking technology are driving the adoption of gaze-assisted interaction as a rich and accessible human-computer interaction paradigm. Gaze-assisted interaction serves as a contextual, non-invasive, and explicit…

Human-Computer Interaction · Computer Science 2018-03-14 Vijay Rajanna , Tracy Hammond

Hand gestures are a natural means of interaction in Augmented Reality and Virtual Reality (AR/VR) applications. Recently, there has been an increased focus on removing the dependence of accurate hand gesture recognition on complex sensor…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Varun Jain , Shivam Aggarwal , Suril Mehta , Ramya Hebbalaguppe

Lightweight augmented reality (AR) glasses are increasingly entering everyday use, extending interaction design beyond short, isolated sessions. However, most existing gesture vocabularies are inherited from VR headsets or early AR goggles.…

Human-Computer Interaction · Computer Science 2026-03-17 Wei Wu , Binyan Xu , Soonhyeon Kweon , Yujie Wang , Leanne Chukoskie , Casper Harteveld

Virtual reality has proved to be useful in applications in several fields ranging from gaming, medicine, and training to development of interfaces that enable human-robot collaboration. It empowers designers to explore applications outside…

Human-Computer Interaction · Computer Science 2023-07-24 Debasmita Mukherjee , Ritwik Singhai , Homayoun Najjaran

Natural user interfaces are on the rise. Manufacturers for Augmented, Virtual, and Mixed Reality head mounted displays are increasingly integrating new sensors into their consumer grade products, allowing gesture recognition without…

Human-Computer Interaction · Computer Science 2022-07-05 Alexander Schäfer , Gerd Reis , Didier Stricker

In order to address the limitations of gestural capabilities in physical robots, researchers in Virtual, Augmented, Mixed Reality Human-Robot Interaction (VAM-HRI) have been using augmented-reality visualizations that increase robot…

Robotics · Computer Science 2022-05-16 Ipek Goktan , Karen Ly , Thomas R. Groechel , Maja J. Mataric

Based on the DeepSORT algorithm, this study explores the application of visual tracking technology in intelligent human-computer interaction, especially in the field of gesture recognition and tracking. With the rapid development of…

Human-Computer Interaction · Computer Science 2025-05-13 Tong Zhang , Fenghua Shao , Runsheng Zhang , Yifan Zhuang , Liuqingqing Yang

This paper introduces an augmented reality (AR) captioning framework designed to support Deaf and Hard of Hearing (DHH) learners in STEM classrooms by integrating non-verbal emotional cues into live transcriptions. Unlike conventional…

Human-Computer Interaction · Computer Science 2025-04-29 Sunday David Ubur

Deaf and hard of hearing (DHH) students often experience communication barriers in higher education, which are particularly acute in experiential learning environments such as laboratories. Traditional accessibility services, such as…

Human-Computer Interaction · Computer Science 2026-04-02 Roshan Mathew , Roshan L. Peiris

In recent years robots have become an important part of our day-to-day lives with various applications. Human-robot interaction creates a positive impact in the field of robotics to interact and communicate with the robots. Gesture…

Robotics · Computer Science 2024-09-11 Sajjad Hussain , Khizer Saeed , Almas Baimagambetov , Shanay Rab , Md Saad

This chapter gives an overview of interaction techniques for mixed reality including augmented and virtual reality (AR/VR). Various modalities for input and output are discussed. Specifically, techniques for tangible and surface-based…

Human-Computer Interaction · Computer Science 2021-03-11 Jens Grubert

Hand gestures form an intuitive means of interaction in Mixed Reality (MR) applications. However, accurate gesture recognition can be achieved only through state-of-the-art deep learning models or with the use of expensive sensors. Despite…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Varun Jain , Gaurav Garg , Ramakrishna Perla , Ramya Hebbalaguppe

Motivated by the growing interest in enhancing intuitive physical Human-Machine Interaction (HRI/HVI), this study aims to propose a robust tactile hand gesture recognition system. We performed a comprehensive evaluation of different hand…

Human-Computer Interaction · Computer Science 2024-05-28 Chiara Fumelli , Anirvan Dutta , Mohsen Kaboli

Interaction in virtual reality (VR) environments is essential to achieve a pleasant and immersive experience. Most of the currently existing VR applications, lack of robust object grasping and manipulation, which are the cornerstone of…

Natural interaction with virtual objects in AR/VR environments makes for a smooth user experience. Gestures are a natural extension from real world to augmented space to achieve these interactions. Finding discriminating spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Tejo Chalasani , Jan Ondrej , Aljosa Smolic

With the development of advanced communication technology, connected vehicles become increasingly popular in our transportation systems, which can conduct cooperative maneuvers with each other as well as road entities through…

Human-Computer Interaction · Computer Science 2020-09-01 Ziran Wang , Kyungtae Han , Prashant Tiwari

During the last years, the emerging field of Augmented and Virtual Reality (AR-VR) has seen tremendous growth. An interface that has also become very popular for the AR systems is the tangible interface or passive-haptic interface.…

Human-Computer Interaction · Computer Science 2021-04-20 Dimitrios Chamzas , Konstantinos Moustakas

Wearable Augmented Reality (AR) is increasingly deployed in on-the-move contexts such as automated driving, cycling, and pedestrian navigation. To date, most systems rely on additive overlays that highlight hazards, intentions, or…

Human-Computer Interaction · Computer Science 2026-03-10 Pascal Jansen

We provide an experimental evaluation of a wearable augmented reality (AR) system we have developed for human-robot teams working on tasks requiring collaboration in shared physical workspace. Recent advances in AR technology have…