English
Related papers

Related papers: Interfacing with history: Curating with audio augm…

200 papers

Extended Reality (XR) enables immersive capture and re-experience of personal memories, yet how interface representations shape these experiences remains underexplored. We examine how users relive and share XR memories through three…

Human-Computer Interaction · Computer Science 2026-04-20 Zaid Ahmed , Omar A. Khan , Hyeongil Nam , Kangsoo Kim

We present RealityTalk, a system that augments real-time live presentations with speech-driven interactive virtual elements. Augmented presentations leverage embedded visuals and animation for engaging and expressive storytelling. However,…

Human-Computer Interaction · Computer Science 2022-08-15 Jian Liao , Adnan Karim , Shivesh Jadon , Rubaiat Habib Kazi , Ryo Suzuki

Particularly close attention is being paid today among researchers in social science disciplines to aspects of learning in the digital age, especially for the Digitally Native Generation. In the context of museums, the question is: how can…

Digitizing physical objects into the virtual world has the potential to unlock new research and applications in embodied AI and mixed reality. This work focuses on recreating interactive digital twins of real-world articulated objects,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Zhenyu Jiang , Cheng-Chun Hsu , Yuke Zhu

Selection of occluded objects is a challenging problem in virtual reality, even more so if multiple objects are involved. With the advent of new artificial intelligence technologies, we explore the possibility of leveraging large language…

Human-Computer Interaction · Computer Science 2024-10-29 Junlong Chen , Jens Grubert , Per Ola Kristensson

Digital devices are now ubiquitous and have the potential to be used to support positive changes in human lives and promote psychological well-being. This paper presents three interactive systems that we created focusing on introspection…

Human-Computer Interaction · Computer Science 2016-08-22 Renaud Gervais , Joan Sol Roo , Jérémy Frey , Martin Hachet

In this article, we present and discuss a user-study prototype, developed for Bakkehuset historic house museum in Copenhagen. We examine how the prototype - a digital sound installation - can expand visitors' experiences of the house and…

Human-Computer Interaction · Computer Science 2023-12-22 Mia F. Yates , Anders Sundnes Løvlie

Augmented Reality (AR) technologies are redefining how we perceive and interact with the world by seamlessly integrating digital elements into our physical surroundings. These technologies offer personalized experiences and transform…

Human-Computer Interaction · Computer Science 2025-10-28 You-Jin Kim

Active speaker detection and speech enhancement have become two increasingly attractive topics in audio-visual scenario understanding. According to their respective characteristics, the scheme of independently designed architecture has been…

Sound · Computer Science 2022-07-08 Junwen Xiong , Yu Zhou , Peng Zhang , Lei Xie , Wei Huang , Yufei Zha

Augmented data storytelling enhances narrative delivery by integrating visualizations with physical environments and presenter actions. Existing systems predominantly rely on body gestures or speech to control visualizations, leaving…

Human-Computer Interaction · Computer Science 2025-08-08 Kentaro Takahira , Yue Yu , Takanori Fujiwara , Ryo Suzuki , Huamin Qu

In Augmented Reality (AR), virtual objects interact with real objects. However, the lack of physicality of virtual objects leads to the absence of natural sonic interactions. When virtual and real objects collide, either no sound or a…

Human-Computer Interaction · Computer Science 2025-08-05 Laura Schütz , Sasan Matinfar , Ulrich Eck , Daniel Roth , Nassir Navab

In this paper, we describe an electronic guidebook prototype and report on a study of its use in a historic house. Supported by mechanisms in the guidebook, visitors constructed experiences that had a high degree of interaction with three…

Human-Computer Interaction · Computer Science 2007-05-23 Allison Woodruff , Paul M. Aoki , Amy Hurst , Margaret H. Szymanski

Cultural heritage applications and advanced machine learning models are creating a fruitful synergy to provide effective and accessible ways of interacting with artworks. Smart audio-guides, personalized art-related content and gamification…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Dario Cioni , Lorenzo Berlincioni , Federico Becattini , Alberto del Bimbo

Immersive technologies are capable of transporting people to distant or inaccessible environments that they might not otherwise visit. Practitioners and researchers alike are discovering new ways to replicate and enhance existing tourism…

Human-Computer Interaction · Computer Science 2025-03-20 Lillian Maria Eagan , Jacob Young , Jesse Bering , Tobias Langlotz

Augmented Reality (AR) is transforming the way we interact with virtual information in the physical world. By overlaying digital content in real-world environments, AR enables new forms of immersive and engaging experiences. However,…

Human-Computer Interaction · Computer Science 2025-04-24 Julian Rasch , Florian Müller , Francesco Chiossi

As augmented reality technology and hardware become more mature and affordable, researchers have been exploring more intuitive and discoverable interaction techniques for immersive environments. In this paper, we investigate multimodal…

Human-Computer Interaction · Computer Science 2022-12-02 Xiaoyan Zhou , Adam S. Williams , Francisco R. Ortega

Interactive digital storytelling becomes a popular choice for information presentation in many fields. Its application spans from media industry and business information visualization, through digital cultural heritage, serious games,…

Human-Computer Interaction · Computer Science 2020-11-10 Selma Rizvic , Dusanka Boskovic , Vensada Okanovic , Sanda Sljivo , Merima Zukic

Embodiment can enhance conversational agents, such as increasing their perceived presence. This is typically achieved through visual representations of a virtual body; however, visual modalities are not always available, such as when users…

Human-Computer Interaction · Computer Science 2026-01-30 Yi Fei Cheng , Jarod Bloch , Alexander Wang , Andrea Bianchi , Anusha Withana , Anhong Guo , Laurie M. Heller , David Lindlbauer

Collaborative virtual environments allow workers to contribute to team projects across space and time. While much research has closely examined the problem of working in different spaces at the same time, few have investigated the best…

Human-Computer Interaction · Computer Science 2025-02-04 Alexander Giovannelli , Leonardo Pavanatto , Shakiba Davari , Haichao Miao , Vuthea Chheang , Brian Giera , Peer-Timo Bremer , Doug Bowman

Incorporating accurate physics-based simulation into interactive design tools is challenging. However, adding the physics accurately becomes crucial to several emerging technologies. For example, in virtual/augmented reality (VR/AR) videos,…

Human-Computer Interaction · Computer Science 2017-12-05 Dingzeyu Li