中文
相关论文

相关论文: FUSE: Universal Speech Enhancement using Multi-Sta…

200 篇论文

Universal speech enhancement aims at handling inputs with various speech distortions and recording conditions. In this work, we propose a novel hybrid architecture that synergizes the signal fidelity of discriminative modeling with the…

声音 · 计算机科学 2026-01-28 Yinghao Liu , Chengwei Liu , Xiaotao Liang , Haoyin Yan , Shaofei Xue , Zheng Xue

It is promising to design a single model that can suppress various distortions and improve speech quality, i.e., universal speech enhancement (USE). Compared to supervised learning-based predictive methods, diffusion-based generative models…

音频与语音处理 · 电气工程与系统科学 2025-06-02 Jie Zhang , Haoyin Yan , Xiaofei Li

Generative Universal Speech Enhancement (USE) methods aim to leverage generative models to improve speech quality under various types of distortions. However, existing generative speech enhancement methods often suffer from semantic…

音频与语音处理 · 电气工程与系统科学 2026-04-07 Xingchen Li , Hanke Xie , Ziqian Wang , Zihan Zhang , Longshuai Xiao , Shuai Wang , Lei Xie

We introduce GAP-URGENet, a generative-predictive fusion framework developed for Track 1 of the ICASSP 2026 URGENT Challenge. The system integrates a generative branch, which performs full-stack speech restoration in a self-supervised…

音频与语音处理 · 电气工程与系统科学 2026-04-03 Xiaobin Rong , Yushi Wang , Zheng Wang , Jing Lu

Speech enhancement is crucial for ubiquitous human-computer interaction. Recently, ultrasound-based acoustic sensing has emerged as an attractive choice for speech enhancement because of its superior ubiquity and performance. However, due…

声音 · 计算机科学 2025-05-20 Luca Jiang-Tao Yu , Running Zhao , Sijie Ji , Edith C. H. Ngai , Chenshu Wu

Removing background noise from speech audio has been the subject of considerable effort, especially in recent years due to the rise of virtual communication and amateur recordings. Yet background noise is not the only unpleasant disturbance…

声音 · 计算机科学 2022-09-19 Joan Serrà , Santiago Pascual , Jordi Pons , R. Oguz Araz , Davide Scaini

Speech enhancement (SE) aims to suppress the additive noise from a noisy speech signal to improve the speech's perceptual quality and intelligibility. However, the over-suppression phenomenon in the enhanced speech might degrade the…

音频与语音处理 · 电气工程与系统科学 2022-04-11 Yuchen Hu , Nana Hou , Chen Chen , Eng Siong Chng

Universal speech enhancement aims to handle input speech with different distortions and input formats. To tackle this challenge, we present TS-URGENet, a Three-Stage Universal, Robust, and Generalizable speech Enhancement Network. To…

音频与语音处理 · 电气工程与系统科学 2025-05-27 Xiaobin Rong , Dahan Wang , Qinwen Hu , Yushi Wang , Yuxiang Hu , Jing Lu

The joint training of speech enhancement and speaker embedding networks for speaker recognition is widely adopted under noisy acoustic environments. While effective, this paradigm often fails to leverage the generalization and robustness…

音频与语音处理 · 电气工程与系统科学 2026-04-29 Chong-Xin Gan , Peter Bell , Man-Wai Mak , Zhe Li , Zezhong Jin , Zilong Huang , Kong Aik Lee

When the parameters of Bayesian Short-time Spectral Amplitude (STSA) estimator for speech enhancement are selected based on the characteristics of the human auditory system, the gain function of the estimator becomes more flexible. Although…

声音 · 计算机科学 2025-12-18 Suman Samui

Speech enhancement remains challenging due to the trade-off between efficiency and perceptual quality. In this paper, we introduce MAGE, a Masked Audio Generative Enhancer that advances generative speech enhancement through a compact and…

音频与语音处理 · 电气工程与系统科学 2026-03-16 The Hieu Pham , Tan Dat Nguyen , Phuong Thanh Tran , Joon Son Chung , Duc Dung Nguyen

There has been a growing effort to develop universal speech enhancement (SE) to handle inputs with various speech distortions and recording conditions. The URGENT Challenge series aims to foster such universal SE by embracing a broad range…

音频与语音处理 · 电气工程与系统科学 2025-06-03 Kohei Saijo , Wangyou Zhang , Samuele Cornell , Robin Scheibler , Chenda Li , Zhaoheng Ni , Anurag Kumar , Marvin Sach , Yihui Fu , Wei Wang , Tim Fingscheidt , Shinji Watanabe

Generative models have excelled in audio tasks using approaches such as language models, diffusion, and flow matching. However, existing generative approaches for speech enhancement (SE) face notable challenges: language model-based methods…

音频与语音处理 · 电气工程与系统科学 2025-05-28 Ziqian Wang , Zikai Liu , Xinfa Zhu , Yike Zhu , Mingshuai Liu , Jun Chen , Longshuai Xiao , Chao Weng , Lei Xie

Recently, deep neural network (DNN) based time-frequency (T-F) mask estimation has shown remarkable effectiveness for speech enhancement. Typically, a single T-F mask is first estimated based on DNN and then used to mask the spectrogram of…

音频与语音处理 · 电气工程与系统科学 2021-09-29 Liangchen Zhou , Wenbin Jiang , Jingyan Xu , Fei Wen , Peilin Liu

We propose a multi-channel speech enhancement approach with a novel two-stage feature fusion method and a pre-trained acoustic model in a multi-task learning paradigm. In the first fusion stage, the time-domain and frequency-domain features…

声音 · 计算机科学 2021-09-27 Quandong Wang , Junnan Wu , Zhao Yan , Sichong Qian , Liyong Guo , Lichun Fan , Weiji Zhuang , Peng Gao , Yujun Wang

We introduce EffiFusion-GAN (Efficient Fusion Generative Adversarial Network), a lightweight yet powerful model for speech enhancement. The model integrates depthwise separable convolutions within a multi-scale block to capture diverse…

声音 · 计算机科学 2025-08-21 Bin Wen , Tien-Ping Tan

Online Speech Enhancement was mainly reserved for predictive models. A key advantage of these models is that for an incoming signal frame from a stream of data, the model is called only once for enhancement. In contrast, generative Speech…

音频与语音处理 · 电气工程与系统科学 2025-10-22 Bunlong Lay , Rostislav Makarov , Simon Welker , Maris Hillemann , Timo Gerkmann

Speech Foundation Models have gained significant attention recently. Prior works have shown that the fusion of representations from multiple layers of the same model or the fusion of multiple models can improve performance on downstream…

音频与语音处理 · 电气工程与系统科学 2025-11-12 Yi-Jen Shih , David Harwath

The multi-stream paradigm of audio processing, in which several sources are simultaneously considered, has been an active research area for information fusion. Our previous study offered a promising direction within end-to-end automatic…

计算与语言 · 计算机科学 2019-10-24 Ruizhi Li , Gregory Sell , Xiaofei Wang , Shinji Watanabe , Hynek Hermansky

Rapid growth in speech data demands adaptive models, as traditional static methods fail to keep pace with dynamic and diverse speech information. We introduce continuous speech learning, a new set-up targeting at bridging the adaptation gap…

计算与语言 · 计算机科学 2025-06-04 Guitao Wang , Jinming Zhao , Hao Yang , Guilin Qi , Tongtong Wu , Gholamreza Haffari
‹ 上一页 1 2 3 10 下一页 ›