English

BERT for Joint Multichannel Speech Dereverberation with Spatial-aware Tasks

Audio and Speech Processing 2020-10-23 v2 Computation and Language Machine Learning Sound

Abstract

We propose a method for joint multichannel speech dereverberation with two spatial-aware tasks: direction-of-arrival (DOA) estimation and speech separation. The proposed method addresses involved tasks as a sequence to sequence mapping problem, which is general enough for a variety of front-end speech enhancement tasks. The proposed method is inspired by the excellent sequence modeling capability of bidirectional encoder representation from transformers (BERT). Instead of utilizing explicit representations from pretraining in a self-supervised manner, we utilizes transformer encoded hidden representations in a supervised manner. Both multichannel spectral magnitude and spectral phase information of varying length utterances are encoded. Experimental result demonstrates the effectiveness of the proposed method.

Keywords

Cite

@article{arxiv.2010.10892,
  title  = {BERT for Joint Multichannel Speech Dereverberation with Spatial-aware Tasks},
  author = {Yang Jiao},
  journal= {arXiv preprint arXiv:2010.10892},
  year   = {2020}
}
R2 v1 2026-06-23T19:31:03.998Z