Audio Simulation for Sound Source Localization in Virtual Evironment
Machine Learning
2024-04-03 v1 Sound
Audio and Speech Processing
Abstract
Non-line-of-sight localization in signal-deprived environments is a challenging yet pertinent problem. Acoustic methods in such predominantly indoor scenarios encounter difficulty due to the reverberant nature. In this study, we aim to locate sound sources to specific locations within a virtual environment by leveraging physically grounded sound propagation simulations and machine learning methods. This process attempts to overcome the issue of data insufficiency to localize sound sources to their location of occurrence especially in post-event localization. We achieve 0.786+/- 0.0136 F1-score using an audio transformer spectrogram approach.
Cite
@article{arxiv.2404.01611,
title = {Audio Simulation for Sound Source Localization in Virtual Evironment},
author = {Yi Di Yuan and Swee Liang Wong and Jonathan Pan},
journal= {arXiv preprint arXiv:2404.01611},
year = {2024}
}
Comments
2024 IEEE World Forum on Public Safety Technology