MicAugment: One-shot Microphone Style Transfer
Sound
2020-10-20 v1 Machine Learning
Audio and Speech Processing
Machine Learning
Abstract
A crucial aspect for the successful deployment of audio-based models "in-the-wild" is the robustness to the transformations introduced by heterogeneous acquisition conditions. In this work, we propose a method to perform one-shot microphone style transfer. Given only a few seconds of audio recorded by a target device, MicAugment identifies the transformations associated to the input acquisition pipeline and uses the learned transformations to synthesize audio as if it were recorded under the same conditions as the target audio. We show that our method can successfully apply the style transfer to real audio and that it significantly increases model robustness when used as data augmentation in the downstream tasks.
Cite
@article{arxiv.2010.09658,
title = {MicAugment: One-shot Microphone Style Transfer},
author = {Zalán Borsos and Yunpeng Li and Beat Gfeller and Marco Tagliasacchi},
journal= {arXiv preprint arXiv:2010.09658},
year = {2020}
}