English
Related papers

Related papers: Materialising contexts: virtual soundscapes for re…

200 papers

Mixed Reality (MR) is a powerful interactive technology that yields new types of user experience. We present a semantic based interactive MR framework that exceeds the current geometry level approaches, a step change in generating…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Long Chen , Wen Tang , Nigel John , Tao Ruan Wan , Jian Jun Zhang

Immersive technologies are capable of transporting people to distant or inaccessible environments that they might not otherwise visit. Practitioners and researchers alike are discovering new ways to replicate and enhance existing tourism…

Human-Computer Interaction · Computer Science 2025-03-20 Lillian Maria Eagan , Jacob Young , Jesse Bering , Tobias Langlotz

Our environment is filled with rich and dynamic acoustic information. When we walk into a cathedral, the reverberations as much as appearance inform us of the sanctuary's wide open space. Similarly, as an object moves around us, we expect…

Sound · Computer Science 2023-01-18 Andrew Luo , Yilun Du , Michael J. Tarr , Joshua B. Tenenbaum , Antonio Torralba , Chuang Gan

With the proliferation of devices that display augmented reality (AR), now is the time for scholars and practitioners to evaluate and engage critically with emerging applications of the medium. AR mediates the way users see their bodies,…

Human-Computer Interaction · Computer Science 2023-03-27 Rob Eagle

Computer-generated visualisations can accompany recorded or live music to create novel audiovisual experiences for audiences. We present a system to streamline the creation of audio-driven visualisations based on audio feature extraction…

Multimedia · Computer Science 2021-06-21 Max Graf , Harold Chijioke Opara , Mathieu Barthet

The state of the art review broadly oversees the use of novel research utilized in the creation of virtual environments applied in interactive art experiences, with a specific focus on the application of procedural animation in spatially…

Human-Computer Interaction · Computer Science 2021-05-20 C. Tollola

Spatial audio is an essential medium to audiences for 3D visual and auditory experience. However, the recording devices and techniques are expensive or inaccessible to the general public. In this work, we propose a self-supervised audio…

Sound · Computer Science 2019-05-15 Yu-Ding Lu , Hsin-Ying Lee , Hung-Yu Tseng , Ming-Hsuan Yang

Digital technologies and tools have transformed the way we can study cultural heritage and the way we can recreate it digitally. Techniques such as laser scanning, photogrammetry, and a variety of Mixed Reality solutions have enabled…

Human-Computer Interaction · Computer Science 2025-07-28 Wieslaw Kopeć , Anna Jaskulska , Władysław Fuchs , Wiktor Stawski , Stanisław Knapiński , Barbara Karpowicz , Rafał Masłyk

Autonomous soundscape augmentation systems typically use trained models to pick optimal maskers to effect a desired perceptual change. While acoustic information is paramount to such systems, contextual information, including participant…

Sound · Computer Science 2024-07-03 Kenneth Ooi , Karn N. Watcharasupat , Bhan Lam , Zhen-Ting Ong , Woon-Seng Gan

In this paper, we introduce our research challenges for creating new musical instruments using everyday-life media with intimate interfaces, such as the self-body, clothes, water and stuffed toys. Various sensor technologies including image…

Human-Computer Interaction · Computer Science 2020-10-06 Kenji Mase , Tomoko Yonezawa

The Mediterranean Sea has a vast maritime heritage which exploitation is made difficult because of the many limitations imposed by the submerged environment. Archaeological diving tours, in fact, suffer from the impossibility to provide…

Human-Computer Interaction · Computer Science 2020-10-15 Fabio Bruno , Loris Barbieri , Marino Mangeruga , Marco Cozza , Antonio Lagudi , Jan Čejka , Fotis Liarokapis , Dimitrios Skarlatos

The rise of consumer augmented reality (AR) technology has opened up new possibilities for interventions intended to disrupt and subvert cultural conventions. From defacing corporate logos to erecting geofenced digital monuments, more and…

Human-Computer Interaction · Computer Science 2022-04-22 Rafael M. L. Silva , Erica Principe Cruz , Daniela K. Rosner , Dayton Kelly , Andrés Monroy-Hernández , Fannie Liu

Virtual museums aim to promote access to cultural artifacts. However, they often face the challenge of getting audiences to read and understand a large amount of information in an uncontrolled online environment. Inspired by successful…

Human-Computer Interaction · Computer Science 2019-02-12 Zhenjie Zhao

Humans possess a remarkable ability to integrate auditory and visual information, enabling a deeper understanding of the surrounding environment. This early fusion of audio and visual cues, demonstrated through cognitive psychology and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shentong Mo , Pedro Morgado

Audio-visual navigation combines sight and hearing to navigate to a sound-emitting source in an unmapped environment. While recent approaches have demonstrated the benefits of audio input to detect and find the goal, they focus on clean and…

Sound · Computer Science 2023-01-04 Abdelrahman Younes , Daniel Honerkamp , Tim Welschehold , Abhinav Valada

Physical agents that can autonomously generate engaging, life-like behaviour will lead to more responsive and interesting robots and other autonomous systems. Although many advances have been made for one-to-one interactions in well…

Human-Computer Interaction · Computer Science 2020-06-25 Lingheng Meng , Daiwei Lin , Adam Francey , Rob Gorbet , Philip Beesley , Dana Kulić

A virtual acoustic source inside a medium can be created by emitting a time-reversed point-source response from the enclosing boundary into the medium. However, in many practical situations the medium can be accessed from one side only. In…

Language barriers in virtual meetings remain a persistent challenge to global collaboration. Real-time translation offers promise, yet current integrations often neglect perceptual cues. This study investigates how spatial audio rendering…

Human-Computer Interaction · Computer Science 2025-11-13 Margarita Geleta , Hong Sodoma , Hannes Gamper

Deaf and hard of hearing (DHH) students often experience communication barriers in higher education, which are particularly acute in experiential learning environments such as laboratories. Traditional accessibility services, such as…

Human-Computer Interaction · Computer Science 2026-04-02 Roshan Mathew , Roshan L. Peiris

By situating computer-generated content in the physical world, mobile augmented reality (AR) can support many tasks that involve effective search and inspection of physical environments. Currently, there is limited information regarding the…

Human-Computer Interaction · Computer Science 2025-11-04 You-Jin Kim , Radha Kumaran , Ehsan Sayyad , Anne Milner , Tom Bullock , Barry Giesbrecht , Tobias Höllerer