English

A Dual-Branch Parallel Network for Speech Enhancement and Restoration

Audio and Speech Processing 2026-02-24 v2 Artificial Intelligence

Abstract

We present a novel general speech restoration model, DBP-Net (dual-branch parallel network), designed to effectively handle complex real-world distortions including noise, reverberation, and bandwidth degradation. Unlike prior approaches that rely on a single processing path or separate models for enhancement and restoration, DBP-Net introduces a unified architecture with dual parallel branches-a masking-based branch for distortion suppression and a mapping-based branch for spectrum reconstruction. A key innovation behind DBP-Net lies in the parameter sharing between the two branches and a cross-branch skip fusion, where the output of the masking branch is explicitly fused into the mapping branch. This design enables DBP-Net to simultaneously leverage complementary learning strategies-suppression and generation-within a lightweight framework. Experimental results show that DBP-Net significantly outperforms existing baselines in comprehensive speech restoration tasks while maintaining a compact model size. These findings suggest that DBP-Net offers an effective and scalable solution for unified speech enhancement and restoration in diverse distortion scenarios.

Keywords

Cite

@article{arxiv.2409.08702,
  title  = {A Dual-Branch Parallel Network for Speech Enhancement and Restoration},
  author = {Da-Hee Yang and Dail Kim and Joon-Hyuk Chang and Jeonghwan Choi and Han-gil Moon},
  journal= {arXiv preprint arXiv:2409.08702},
  year   = {2026}
}

Comments

Accepted for publication in Computer Speech & Language (2026). Final published version available at: https://doi.org/10.1016/j.csl.2026.101959