English
Related papers

Related papers: MR4MR: Mixed Reality for Melody Reincarnation

200 papers

In mixed reality (MR) environments, understanding space and creating virtual objects is crucial to providing an intuitive and rich user experience. This paper introduces sMoRe (Spatial Mapping and Object Rendering Environment), an MR…

Human-Computer Interaction · Computer Science 2024-11-19 Yunhao Xing , Que Liu , Jingwu Wang , Diego Gomez-Zara

Recent progress in mixed reality (MR) and robotics is enabling increasingly sophisticated forms of human-robot collaboration. Building on these developments, we introduce a novel MR framework that allows multiple quadruped robots to operate…

Human-Computer Interaction · Computer Science 2025-05-29 Tim Engelbracht , Petar Lukovic , Tjark Behrens , Kai Lascheit , René Zurbrügg , Marc Pollefeys , Hermann Blum , Zuria Bauer

Mixed-reality (MR) soundscapes blend real-world sound with virtual audio from hearing devices, presenting intricate auditory information that is hard to discern and differentiate. This is particularly challenging for blind or visually…

Human-Computer Interaction · Computer Science 2024-05-28 Ruei-Che Chang , Chia-Sheng Hung , Bing-Yu Chen , Dhruv Jain , Anhong Guo

Spatial Orchestra demonstrates how easy it is to play musical instruments using basic input like natural locomotion, which is accessible to most. Unlike many musical instruments, our work allows individuals of all skill levels to…

Human-Computer Interaction · Computer Science 2025-10-29 You-Jin Kim , Myungin Lee , Marko Peljhan , JoAnn Kuchera-Morin , Tobias Höllerer

Collaborating across dissimilar, distributed spaces presents numerous challenges for computer-aided spatial communication. Mixed reality (MR) can blend selected surfaces, allowing collaborators to work in blended f-formations (facing…

Human-Computer Interaction · Computer Science 2024-05-13 Emily Wong , Juan Sánchez Esquivel , Jens Emil Grønbæk , Germán Leiva , Eduardo Velloso

Mixed reality (MR) environments provide great value in displaying 3D virtual content. Systems facilitating co-located multiuser MR (Co-MUMR) experiences allow multiple users to co-present in a shared immersive virtual environment with…

Human-Computer Interaction · Computer Science 2025-01-07 Zhongyuan Yu , Daniel Zeidler , Krishnan Chandran , Lars Engeln , Kelsang Mende , Matthew McGinity

Mixed Reality (MR) could assist users' tasks by continuously integrating virtual content with their view of the physical environment. However, where and how to place these content to best support the users has been a challenging problem due…

Human-Computer Interaction · Computer Science 2025-05-01 Feiyu Lu , Mengyu Chen , Hsiang Hsu , Pranav Deshpande , Cheng Yao Wang , Blair MacIntyre

The contributions of this paper are: (1) a taxonomy of the "Realities" (Virtual, Augmented, Mixed, Mediated, etc.), and (2) some new kinds of "reality" that come from nature itself, i.e. that expand our notion beyond synthetic realities to…

Human-Computer Interaction · Computer Science 2018-04-24 Steve Mann , Tom Furness , Yu Yuan , Jay Iorio , Zixin Wang

Interactive audio spatialization technology previously developed for video game authoring and rendering has evolved into an essential component of platforms enabling shared immersive virtual experiences for future co-presence, remote…

Sound · Computer Science 2021-09-28 Jean-Marc Jot , Rémi Audfray , Mark Hertensteiner , Brian Schmidt

The release of Microsoft's HoloLens headset addresses new types of issues that would have been difficult to design without such a hardware. This semi-transparent visor headset allows the user who wears it to view the projection of 3D…

A recently released cutting-edge AR device, Microsoft HoloLens, has attracted considerable attention with its advanced capabilities. In this article, we report the design and execution of a series of experiments to quantitatively evaluate…

Multimedia · Computer Science 2022-12-27 Yang Liu , Haiwei Dong , Longyu Zhang , Abdulmotaleb El Saddik

Mixed Reality (MR) and Artificial Intelligence (AI) are increasingly becoming integral parts of our daily lives. Their applications range in fields from healthcare to education to entertainment. MR has opened a new frontier for such fields…

Human-Computer Interaction · Computer Science 2024-02-14 Ramez Yousri , Zeyad Essam , Yehia Kareem , Youstina Sherief , Sherry Gamil , Soha Safwat

Augmented Reality (AR) based on Head-Mounted Displays (HMDs) has gained significant traction over the recent years. Nevertheless, it remains unclear what AR HMD-based applications have been developed over the years and what their system…

Multimedia · Computer Science 2023-03-15 Pubudu Wijesooriya , Sheikh Muhammad Farjad , Nikolaos Stergiou , Spyridon Mastorakis

Head Mounted Displays (HMDs) allow users to experience virtual reality with a great level of immersion. However, even simple physical tasks like drinking a beverage can be difficult and awkward while in a virtual reality experience. We…

Human-Computer Interaction · Computer Science 2015-02-18 Pulkit Budhiraja , Rajinder Sodhi , Brett Jones , Kevin Karsch , Brian Bailey , David Forsyth

Modern collaborative Mixed Reality (MR) systems continue to break the boundaries of conventional co-located and remote collaboration and communication. They merge physical and virtual worlds and enable natural interaction, opening up a…

Human-Computer Interaction · Computer Science 2024-09-10 Katja Krug , Julián Méndez , Weizhou Luo , Raimund Dachselt

Integrating mixed reality (MR) with artificial intelligence (AI) technologies, including vision, language, audio, reasoning, and planning, enables the AI-powered MR assistant [1] to substantially elevate human efficiency. This enhancement…

Human-Computer Interaction · Computer Science 2024-05-10 Yan-Ming Chiou , Bob Price , Chien-Chung Shen , Syed Ali Asif

Extended reality (XR) enables new music-mixing workflows by moving beyond 2D faders toward embodied, spatial interaction. However, it remains unclear which six-degree-of-freedom (6DoF) gestures align with real-world mixing practices and…

Human-Computer Interaction · Computer Science 2026-02-27 Jeremy Wertheim Co Chen , Rendell Christian Ngo , Cedric Matthew Yu , Hans Emilio Lumagui , Ethan Badayos , Jordan Aiko Deja

Augmented reality (AR), virtual reality (VR) and mixed reality (MR) are technologies of great potential due to the engaging and enriching experiences they are capable of providing. Their use is rapidly increasing in diverse fields such as…

Human-Computer Interaction · Computer Science 2020-08-31 Jason Rambach , Gergana Lilligreen , Alexander Schäfer , Ramya Bankanal , Alexander Wiebel , Didier Stricker

Mixed reality (MR) environments offer embodied spatial interaction, providing intuitive 3D manipulation capabilities that enhance the conceptual design process. Parametric modeling, a powerful and advanced architectural design method,…

Human-Computer Interaction · Computer Science 2025-06-09 Ruochen Ji , Lyu Tiangang

Mixed Reality aims to merge the digital and physical worlds to create immersive human-computer interactions. Despite notable advancements, the absence of realistic haptic feedback often breaks the immersive experience by creating a…

Human-Computer Interaction · Computer Science 2024-06-12 Haoyu Wang