Audio Editing with Non-Rigid Text Prompts
Abstract
In this paper, we explore audio-editing with non-rigid text edits. We show that the proposed editing pipeline is able to create audio edits that remain faithful to the input audio. We explore text prompts that perform addition, style transfer, and in-painting. We quantitatively and qualitatively show that the edits are able to obtain results which outperform Audio-LDM, a recently released text-prompted audio generation model. Qualitative inspection of the results points out that the edits given by our approach remain more faithful to the input audio in terms of keeping the original onsets and offsets of the audio events.
Cite
@article{arxiv.2310.12858,
title = {Audio Editing with Non-Rigid Text Prompts},
author = {Francesco Paissan and Luca Della Libera and Zhepei Wang and Mirco Ravanelli and Paris Smaragdis and Cem Subakan},
journal= {arXiv preprint arXiv:2310.12858},
year = {2024}
}
Comments
Proceedings of Interspeech. Please refer to the reference available at https://www.isca-archive.org/interspeech_2024/paissan24b_interspeech.html