English

Multi-Channel Multi-Speaker ASR Using Target Speaker's Solo Segment

Audio and Speech Processing 2024-06-19 v2

Abstract

In the field of multi-channel, multi-speaker Automatic Speech Recognition (ASR), the task of discerning and accurately transcribing a target speaker's speech within background noise remains a formidable challenge. Traditional approaches often rely on microphone array configurations and the information of the target speaker's location or voiceprint. This study introduces the Solo Spatial Feature (Solo-SF), an innovative method that utilizes a target speaker's isolated speech segment to enhance ASR performance, thereby circumventing the need for conventional inputs like microphone array layouts. We explore effective strategies for selecting optimal solo segments, a crucial aspect for Solo-SF's success. Through evaluations conducted on the AliMeeting dataset and AISHELL-1 simulations, Solo-SF demonstrates superior performance over existing techniques, significantly lowering Character Error Rates (CER) in various test conditions. Our findings highlight Solo-SF's potential as an effective solution for addressing the complexities of multi-channel, multi-speaker ASR tasks.

Keywords

Cite

@article{arxiv.2406.09589,
  title  = {Multi-Channel Multi-Speaker ASR Using Target Speaker's Solo Segment},
  author = {Yiwen Shao and Shi-Xiong Zhang and Yong Xu and Meng Yu and Dong Yu and Daniel Povey and Sanjeev Khudanpur},
  journal= {arXiv preprint arXiv:2406.09589},
  year   = {2024}
}

Comments

Accepted for presentation at Interspeech 2024

R2 v1 2026-06-28T17:05:19.554Z