English
Related papers

Related papers: Accessible Gesture-Driven Augmented Reality Intera…

200 papers

Augmented Reality (AR) offers powerful visualization capabilities for industrial robot training, yet current interfaces remain predominantly static, failing to account for learners' diverse cognitive profiles. In this paper, we present an…

Robotics · Computer Science 2026-03-16 Nicolas Leins , Jana Gonnermann-Müller , Malte Teichmann , Sebastian Pokutta

Gesture recognition is a perceptual user interface, which is based on CV technology that allows the computer to interpret human motions as commands, allowing users to communicate with a computer without the use of hands, thus making the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Rishabh Naulakha , Shubham Gaur , Dhairya Lodha , Mehek Tulsyan , Utsav Kotecha

We propose a set of communicative gestures and develop a gesture recognition system with the aim of facilitating more intuitive Human-Robot Interaction (HRI) through gestures. First, we propose a set of commands commonly used for…

Robotics · Computer Science 2021-09-22 Jia Chuan A. Tan , Wesley P. Chan , Nicole L. Robinson , Elizabeth A. Croft , Dana Kulic

Robots which interact with the physical world will benefit from a fine-grained tactile understanding of objects and surfaces. Additionally, for certain tasks, robots may need to know the haptic properties of an object before touching it. To…

Robotics · Computer Science 2016-04-13 Yang Gao , Lisa Anne Hendricks , Katherine J. Kuchenbecker , Trevor Darrell

Despite the growing adoption of mixed reality and interactive AI agents, it remains challenging for these systems to generate high quality 2D/3D scenes in unseen environments. The common practice requires deploying an AI agent to collect…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Qiuyuan Huang , Jae Sung Park , Abhinav Gupta , Paul Bennett , Ran Gong , Subhojit Som , Baolin Peng , Owais Khan Mohammed , Chris Pal , Yejin Choi , Jianfeng Gao

Assistive robotic systems endeavour to support those with movement disabilities, enabling them to move again and regain functionality. Main issue with these systems is the complexity of their low-level control, and how to translate this to…

Robotics · Computer Science 2019-03-07 Ali Shafti , Pavel Orlov , A. Aldo Faisal

Interaction design for Augmented Reality (AR) is gaining increasing attention from both academia and industry. This survey discusses 260 articles (68.8% of articles published between 2015 - 2019) to review the field of human interaction in…

Human-Computer Interaction · Computer Science 2021-05-26 Lik Hang Lee , Tristan Braud , Simo Hosio , Pan Hui

Extended Reality (XR), including virtual, augmented, and mixed reality, provides immersive and interactive experiences across diverse applications, from VR-based education to AR-based assistance and MR-based training. However, widespread XR…

Human-Computer Interaction · Computer Science 2026-01-23 Mingyu Zhu , Jiangong Chen , Bin Li

In recent years, there has been a considerable amount of research in the Gesture Recognition domain, mainly owing to the technological advancements in Computer Vision. Various new applications have been conceptualised and developed in this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Kshitij Deshpande , Varad Mashalkar , Kaustubh Mhaisekar , Amaan Naikwadi , Archana Ghotkar

The brain's attention system is a complex and adaptive network of brain regions that enables individuals to interact effectively with their surroundings and perform complex tasks. This system involves the coordination of various brain…

Human-Computer Interaction · Computer Science 2024-05-03 Shiva Ghasemi , Majid Behravan , Sunday Uber , Denis Gracanin

eXtended Reality (XR) autism research, ranging from Augmented Reality to Virtual Reality, focuses on socio-emotional abilities and high-functioning autism. However common autism interventions address the entire spectrum over social, sensory…

Human-Computer Interaction · Computer Science 2022-04-11 Valentin Bauer , Tifanie Bouchara , Patrick Bourdot

This paper explores the challenges faced by assistive robots in effectively cooperating with humans, requiring them to anticipate human behavior, predict their actions' impact, and generate understandable robot actions. The study focuses on…

Robotics · Computer Science 2023-08-22 Chao Wang , Theodoros Stouraitis , Anna Belardinelli , Stephan Hasler , Michael Gienger

Complex robotic tasks require human collaboration to benefit from their high dexterity. Frequent human-robot interaction is mentally demanding and time-consuming. Intuitive and easy-to-use robot control interfaces reduce the negative…

Human-Computer Interaction · Computer Science 2022-11-03 Sautenkov Oleg , Altamirano Cabrera Miguel , Rakhmatulin Viktor , Tsetserukou Dzmitry

Combining conversational AI with refreshable tactile displays (RTDs) offers significant potential for creating accessible data visualization for people who are blind or have low vision (BLV). To support researchers and developers building…

Human-Computer Interaction · Computer Science 2026-02-18 Samuel Reinders , Munazza Zaib , Matthew Butler , Bongshin Lee , Ingrid Zukerman , Lizhen Qu , Kim Marriott

Virtual reality (VR) and interactive 3D visualization systems have enhanced educational experiences and environments, particularly in complicated subjects such as anatomy education. VR-based systems surpass the potential limitations of…

This paper presents a control interface to translate the residual body motions of individuals living with severe disabilities, into control commands for body-machine interaction. A custom, wireless, wearable multi-sensor network is used to…

Artificial Intelligence (AI) is revolutionizing assistive technologies. It offers innovative solutions to enhance the quality of life for individuals with visual impairments. This review examines the development, applications, and impact of…

Human-Computer Interaction · Computer Science 2025-03-21 Prudhvi Naayini , Praveen Kumar Myakala , Chiranjeevi Bura , Anil Kumar Jonnalagadda , Srikanth Kamatala

Gestures are a natural form of communication between humans and can also be leveraged for human-robot interaction. This work presents a gesture-based user interface for object selection using pointing and click gestures. An experiment with…

Robotics · Computer Science 2026-04-08 Bijan Kavousian , Oliver Petrovic , Werner Herfs

Reliable and robust user identification and authentication are important and often necessary requirements for many digital services. It becomes paramount in social virtual reality (VR) to ensure trust, specifically in digital encounters…

Machine Learning · Computer Science 2023-10-27 Christian Schell , Andreas Hotho , Marc Erich Latoschik

In recent years, deep learning algorithms have become increasingly more prominent for their unparalleled ability to automatically learn discriminant features from large amounts of data. However, within the field of electromyography-based…