English
Related papers

Related papers: Live Captions in Virtual Reality (VR)

200 papers

Live cultural experiences like concerts generate shared physiological arousal among audience members, a collective resonance that contributes to their emotional power. Recreating such experiences in virtual reality therefore requires not…

Human-Computer Interaction · Computer Science 2026-03-23 Xiaru Meng , Yulan Ju , Yan He , Matthias Hoppe , Kouta Minamizawa , Jiawen Han , Kai Kunze

Eye tracking is routinely being incorporated into virtual reality (VR) systems. Prior research has shown that eye tracking data, if exposed, can be used for re-identification attacks. The state of our knowledge about currently existing…

Human-Computer Interaction · Computer Science 2024-02-22 Ethan Wilson , Azim Ibragimov , Michael J. Proulx , Sai Deep Tetali , Kevin Butler , Eakta Jain

Virtual-reality simulations of curved space are most effective and most fun when presented as a game (for example, curved-space billiards), so the user not only has something to see in the curved space, but also has something fun to do…

Physics Education · Physics 2021-05-06 Jeff Weeks

Achieving a high level of immersion and adaptation in virtual reality (VR) requires precise measurement and representation of user state. While extrinsic physical characteristics such as locomotion and pose can be accurately tracked in…

Human-Computer Interaction · Computer Science 2025-04-14 Sahar Niknam , Saravanakumar Duraisamy , Jean Botev , Luis A. Leiva

3D video avatars can empower virtual communications by providing compression, privacy, entertainment, and a sense of presence in AR/VR. Best 3D photo-realistic AR/VR avatars driven by video, that can minimize uncanny effects, rely on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Lele Chen , Chen Cao , Fernando De la Torre , Jason Saragih , Chenliang Xu , Yaser Sheikh

Watching others play is a key ingredient of digital games and an important aspect of games user research. However, spectatorship is not very popular in virtual reality, as such games strongly rely on one's feelings of presence. In other…

Human-Computer Interaction · Computer Science 2020-08-07 Andrey Krekhov , Daniel Preuß , Sebastian Cmentowski , Jens Krüger

Stereoscopic, head-tracked display systems can show users realistic, world-locked virtual objects and environments. However, discrepancies between the rendering pipeline and physical viewing conditions can lead to perceived instability in…

Graphics · Computer Science 2023-12-13 Phillip Guan , Eric Penner , Joel Hegland , Benjamin Letham , Douglas Lanman

Virtual reality (VR) video provides an immersive 360 viewing experience to a user wearing a head-mounted display: as the user rotates his head, correspondingly different fields-of-view (FoV) of the 360 video are rendered for observation.…

Multimedia · Computer Science 2017-03-28 Gene Cheung , Zhi Liu , Zhiyou Ma , Jack Z. G. Tan

Hand-tracking enables controller-free XR interaction but does not have the tactile feedback controllers provide. Rather than treating this solely as a missing-sensation problem, we explore whether pseudo-haptic cues on an embodied virtual…

Human-Computer Interaction · Computer Science 2026-03-02 Kristian Paolo David , Tyrone Justin Sta Maria , Mikkel Dominic Gamboa , Jordan Aiko Deja

Colour is a fundamental determinant of affective experience in immersive virtual reality (VR), yet the emotional and physiological impact of individual hues remains poorly characterised. This study investigated how fifteen calibrated…

Human-Computer Interaction · Computer Science 2025-11-19 Francesco Febbraio , Simona Collina , Christina Lepida , Panagiotis Kourtesis

Deaf and hard of hearing individuals regularly rely on captioning while watching live TV. Live TV captioning is evaluated by regulatory agencies using various caption evaluation metrics. However, caption evaluation metrics are often not…

Computation and Language · Computer Science 2022-06-27 Akhter Al Amin , Saad Hassan , Cecilia O. Alm , Matt Huenerfauth

This study will investigate the user experience while interacting with highly photorealistic virtual job interviewer avatars in Virtual Reality (VR), Augmented Reality (AR), and on a 2D screen. Having a precise speech recognition mechanism,…

Integrated VR (IVR) systems consist of a head-mounted display (HMD) and body-tracking capabilities. They enable users to translate their physical movements into corresponding avatar movements in real-time, allowing them to perceive their…

Human-Computer Interaction · Computer Science 2026-01-15 Marie Luisa Fiedler , Christian Merz , Jonathan Tschanter , Carolin Wienrich , Marc Erich Latoschik

Vection, the visual illusion of self-motion, provides a strong marker of the VR user experience and plays an important role in both presence and cybersickness. Traditional measurements have been conducted using questionnaires, which exhibit…

Human-Computer Interaction · Computer Science 2024-12-25 Gaël Van der Lee , Anatole Lécuyer , Maxence Naud , Reinhold Scherer , François Cabestaing , Hakim Si-Mohammed

As social virtual reality (VR) grows more popular, addressing accessibility for blind and low vision (BLV) users is increasingly critical. Researchers have proposed an AI "sighted guide" to help users navigate VR and answer their questions,…

Human-Computer Interaction · Computer Science 2026-03-31 Jazmin Collins , Sharon Y Lin , Tianqi Liu , Andrea Stevenson Won , Shiri Azenkot

This paper presents some early work and future plans regarding how the autonomous motions of a telepresence robot affect a person embodied in the robot through a head-mounted display. We consider the preferences, comfort, and the perceived…

Whole-body movements enhance the presence and enjoyment of Virtual Reality (VR) experiences. However, using large gestures is often uncomfortable and impossible in confined spaces (e.g., public transport). We introduce FingerMapper, mapping…

Human-Computer Interaction · Computer Science 2023-02-24 Wen-Jie Tseng , Samuel Huron , Eric Lecolinet , Jan Gugenheimer

Visual Question Answering (VQA) is an extremely stimulating and challenging research area where Computer Vision (CV) and Natural Language Processig (NLP) have recently met. In image captioning and video summarization, the semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Silvio Barra , Carmen Bisogni , Maria De Marsico , Stefano Ricciardi

Presence in virtual reality (VR) is meaningful for remotely connecting with others and facilitating social interactions despite great distance while providing a sense of "being there." This work presents CardsVR, a two-person VR experience…

Human-Computer Interaction · Computer Science 2022-11-01 Andrew Huard , Mengyu Chen , Misha Sra

This work compares three locomotion techniques for an immersive VR environment: two different types of teleporting (with and without animation) and a manual (joystick-based) technique. We tested the effect of these techniques on visual…

Human-Computer Interaction · Computer Science 2023-12-18 Ariel Caputo , Massimo Zancanaro , Andrea Giachetti