English

Sampling Frequency Independent Dialogue Separation

Audio and Speech Processing 2022-06-07 v1 Sound

Abstract

In some DNNs for audio source separation, the relevant model parameters are independent of the sampling frequency of the audio used for training. Considering the application of dialogue separation, this is shown for two DNN architectures: a U-Net and a fully-convolutional model. The models are trained with audio sampled at 8 kHz. The learned parameters are transferred to models for processing audio at 48 kHz. The separated audio sources are compared with the ones produced by the same model architectures trained with 48 kHz versions of the same training data. A listening test and computational measures show that there is no significant perceptual difference between the models trained with 8 kHz or with 48 kHz. This transferability of the learned parameters allows for a faster and computationally less costly training. It also enables using training datasets available at a lower sampling frequency than the one needed by the application at hand, or using data collections with multiple sampling frequencies.

Keywords

Cite

@article{arxiv.2206.02124,
  title  = {Sampling Frequency Independent Dialogue Separation},
  author = {Jouni Paulus and Matteo Torcoli},
  journal= {arXiv preprint arXiv:2206.02124},
  year   = {2022}
}

Comments

accepted into EUSIPCO 2022

R2 v1 2026-06-24T11:39:34.350Z