English
Related papers

Related papers: Enhancing Sign Language Teaching: A Mixed Reality …

200 papers

This study explores integrating sign language into virtual reality (VR) by examining the comprehensibility and user experience of viewing American Sign Language (ASL) videos captured with body-mounted 360-degree cameras. Ten participants…

Human-Computer Interaction · Computer Science 2026-02-27 Gauri Umesh Rajmane , Ziming Li , Tae Oh , Roshan Peiris

This chapter gives an overview of interaction techniques for mixed reality including augmented and virtual reality (AR/VR). Various modalities for input and output are discussed. Specifically, techniques for tangible and surface-based…

Human-Computer Interaction · Computer Science 2021-03-11 Jens Grubert

The rapid evolution of lightweight consumer augmented reality (AR) smart glasses (a.k.a. optical see-through head-mounted displays) offers novel opportunities for learning, particularly through their unique capability to deliver multimodal…

Human-Computer Interaction · Computer Science 2025-07-22 Nuwan Janaka , Shengdong Zhao , Ashwin Ram , Ruoxin Sun , Sherisse Tan Jing Wen , Danae Li , David Hsu

Despite renewed awareness of the importance of articulation, it remains a challenge for instructors to handle the pronunciation needs of language learners. There are relatively scarce pedagogical tools for pronunciation teaching and…

Computer Vision and Pattern Recognition · Computer Science 2020-05-15 M. Hamed Mozaffari , Won-Sook Lee

Children with hearing impairments face ongoing challenges in language and motor development. This study explores how multi-sensory feedback technology based on virtual reality (VR), integrating auditory, visual, and tactile stimuli, can…

Human-Computer Interaction · Computer Science 2025-07-25 Yichen Yu , Qiaoran Wang

Large language models (LLMs) have demonstrated the ability to generate formative feedback and instructional hints in English, making them increasingly relevant for AI-assisted education. However, their ability to provide effective…

Computation and Language · Computer Science 2025-06-06 Junior Cedric Tonga , KV Aditya Srivatsa , Kaushal Kumar Maurya , Fajri Koto , Ekaterina Kochmar

Sign languages are dynamic visual languages that involve hand gestures, in combination with non manual elements such as facial expressions. While video recordings of sign language are commonly used for education and documentation, the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Janna Bruner , Amit Moryossef , Lior Wolf

Mixed Reality (MR) and Artificial Intelligence (AI) are increasingly becoming integral parts of our daily lives. Their applications range in fields from healthcare to education to entertainment. MR has opened a new frontier for such fields…

Human-Computer Interaction · Computer Science 2024-02-14 Ramez Yousri , Zeyad Essam , Yehia Kareem , Youstina Sherief , Sherry Gamil , Soha Safwat

Large text-to-video models hold immense potential for a wide range of downstream applications. However, they struggle to accurately depict dynamic object interactions, often resulting in unrealistic movements and frequent violations of…

Machine Learning · Computer Science 2026-04-21 Hiroki Furuta , Heiga Zen , Dale Schuurmans , Aleksandra Faust , Yutaka Matsuo , Percy Liang , Sherry Yang

Recent advances in imitation learning have shown significant promise for robotic control and embodied intelligence. However, achieving robust generalization across diverse mounted camera observations remains a critical challenge. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Travis Davies , Jiahuan Yan , Xiang Chen , Yu Tian , Yueting Zhuang , Yiqi Huang , Luhui Hu

Augmented Reality (AR) offers powerful visualization capabilities for industrial robot training, yet current interfaces remain predominantly static, failing to account for learners' diverse cognitive profiles. In this paper, we present an…

Robotics · Computer Science 2026-03-16 Nicolas Leins , Jana Gonnermann-Müller , Malte Teichmann , Sebastian Pokutta

Today there is a high variety of haptic devices capable of providing tactile feedback. Although most of existing designs are aimed at realistic simulation of the surface properties, their capabilities are limited in attempts of displaying…

Robotics · Computer Science 2021-04-20 Aleksey Fedoseev , Nikita Chernyadev , Dzmitry Tsetserukou

Mixed Reality (MR) is a powerful interactive technology that yields new types of user experience. We present a semantic based interactive MR framework that exceeds the current geometry level approaches, a step change in generating…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Long Chen , Wen Tang , Nigel John , Tao Ruan Wan , Jian Jun Zhang

Augmented reality (AR) offers immersive interaction but remains inaccessible for users with motor impairments or limited dexterity due to reliance on precise input methods. This study proposes a gesture-based interaction system for AR…

Human-Computer Interaction · Computer Science 2025-06-19 Yikan Wang

Natural and efficient interaction remains a critical challenge for virtual reality and augmented reality (VR/AR) systems. Vision-based gesture recognition suffers from high computational cost, sensitivity to lighting conditions, and privacy…

Human-Computer Interaction · Computer Science 2025-11-11 Xijie Zhang , Fengliang He , Hong-Ning Dai

In the complex manufacturing sector a considerable amount of resources are focused on developing new skills and training workers. In that context, increasing the effectiveness of those processes and reducing the investment required is an…

Human-Computer Interaction · Computer Science 2016-11-17 Mar Gonzalez-Franco , Julio Cermeron , Katie Li , Rodrigo Pizarro , Jacob Thorn , Windo Hutabarat , Ashutosh Tiwari , Pablo Bermell-Garcia

In this project, we have developed a sign language tutor that lets users learn isolated signs by watching recorded videos and by trying the same signs. The system records the user's video and analyses it. If the sign is recognized, both…

Widespread RGB-Depth (RGB-D) sensors and advanced 3D reconstruction technologies facilitate the capture of indoor spaces, improving the fields of augmented reality (AR), virtual reality (VR), and extended reality (XR). Nevertheless, current…

Robotics · Computer Science 2026-04-22 Seok Joon Kim , Dinh Duc Cao , Federica Spinola , Se Jin Lee , Kyu Sung Cho

The study examines the problem of using augmented and virtual reality in the process of blended learning in general secondary education. The study analyzes the meaning of the concept of "blended learning". The conceptual principles of…

Computers and Society · Computer Science 2022-01-19 Valentyna Kovalenko , Maiia Marienko , Alisa Sukhikh

We present a tele-immersive system that enables people to interact with each other in a virtual world using body gestures in addition to verbal communication. Beyond the obvious applications, including general online conversations and…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Xinzhong Lu , Ju Shen , Saverio Perugini , Jianjun Yang