English

Complex ratio masking for singing voice separation

Audio and Speech Processing 2020-11-05 v1 Sound

Abstract

Music source separation is important for applications such as karaoke and remixing. Much of previous research focuses on estimating short-time Fourier transform (STFT) magnitude and discarding phase information. We observe that, for singing voice separation, phase can make considerable improvement in separation quality. This paper proposes a complex ratio masking method for voice and accompaniment separation. The proposed method employs DenseUNet with self attention to estimate the real and imaginary components of STFT for each sound source. A simple ensemble technique is introduced to further improve separation performance. Evaluation results demonstrate that the proposed method outperforms recent state-of-the-art models for both separated voice and accompaniment.

Keywords

Cite

@article{arxiv.2011.02008,
  title  = {Complex ratio masking for singing voice separation},
  author = {Yixuan Zhang and Yuzhou Liu and DeLiang Wang},
  journal= {arXiv preprint arXiv:2011.02008},
  year   = {2020}
}
R2 v1 2026-06-23T19:53:58.826Z