English

Listen first: Output-based multi-microphone speech enhancement

Audio and Speech Processing 2026-07-14 v1

Abstract

Traditionally, hearing-aid speech enhancement (SE) algorithms rely on input-based feature estimation, often derived by a voice activity detector (VAD), to configure beamformers. Yet features extracted from noisy microphone signals can become unreliable in challenging acoustic scenes where users most need help. We introduce a novel paradigm in which the settings of a sound processing system are determined by evaluating characteristics of its output. To demonstrate this idea, we employ an output-based system that selects among a set of minimum power distortionless response (MPDR) beamformers. Although MPDR beamformers are typically avoided due to their sensitivity to steering errors, we show that they become effective within an output-based framework. We compare the proposed system to a conventional input-based minimum variance distortionless response (MVDR) baseline. Experimental results show that the proposed system consistently outperforms the MVDR baseline, particularly at low SNRs, in terms of SNR, ESTOI and PESQ.

Cite

@article{arxiv.2607.12529,
  title  = {Listen first: Output-based multi-microphone speech enhancement},
  author = {Panos Apostolidis and Svend Feldt and Zheng-Hua Tan and Jan Østergaard and Jesper Jensen},
  journal= {arXiv preprint arXiv:2607.12529},
  year   = {2026}
}

Comments

Accepted at the International Workshop on Acoustic Signal Enhancement (IWAENC) 2026