中文
相关论文

相关论文: Speech Enhancement via Deep Spectrum Image Transla…

200 篇论文

This paper presents a novel multi-channel speech enhancement approach, FoVNet, that enables highly efficient speech enhancement within a configurable field of view (FoV) of a smart-glasses user without needing specific target-talker(s)…

声音 · 计算机科学 2024-08-14 Zhongweiyang Xu , Ali Aroudi , Ke Tan , Ashutosh Pandey , Jung-Suk Lee , Buye Xu , Francesco Nesta

Over the past few years, speech enhancement methods based on deep learning have greatly surpassed traditional methods based on spectral subtraction and spectral estimation. Many of these new techniques operate directly in the the short-time…

音频与语音处理 · 电气工程与系统科学 2020-08-28 Jean-Marc Valin , Umut Isik , Neerad Phansalkar , Ritwik Giri , Karim Helwani , Arvindh Krishnaswamy

Recent studies have demonstrated that incorporating auxiliary information, such as speaker voiceprint or visual cues, can substantially improve Speech Enhancement (SE) performance. However, single-channel methods often yield suboptimal…

音频与语音处理 · 电气工程与系统科学 2026-03-06 Chihyun Liu , Jiaxuan Fan , Mingtung Sun , Michael Anthony , Mingsian R. Bai , Yu Tsao

Speech enhancement using artificial neural networks aims to remove noise from noisy speech signals while preserving the speech content. However, speech enhancement networks often introduce distortions to the speech signal, referred to as…

声音 · 计算机科学 2025-08-15 Iksoon Jeong , Kyung-Joong Kim , Kang-Hun Ahn

Sub-band models have achieved promising results due to their ability to model local patterns in the spectrogram. Some studies further improve the performance by fusing sub-band and full-band information. However, the structure for the…

声音 · 计算机科学 2022-01-26 Feng Dang , Hangting Chen , Pengyuan Zhang

Compensation for channel mismatch and noise interference is essential for robust automatic speech recognition. Enhanced speech has been introduced into the multi-condition training of acoustic models to improve their generalization ability.…

声音 · 计算机科学 2022-11-24 Hung-Shin Lee , Pin-Yuan Chen , Yao-Fei Cheng , Yu Tsao , Hsin-Min Wang

Previously proposed FullSubNet has achieved outstanding performance in Deep Noise Suppression (DNS) Challenge and attracted much attention. However, it still encounters issues such as input-output mismatch and coarse processing for…

声音 · 计算机科学 2022-03-29 Jun Chen , Zilin Wang , Deyi Tuo , Zhiyong Wu , Shiyin Kang , Helen Meng

Deep learning-based speech enhancement has shown unprecedented performance in recent years. The most popular mono speech enhancement frameworks are end-to-end networks mapping the noisy mixture into an estimate of the clean speech. With…

音频与语音处理 · 电气工程与系统科学 2022-02-02 Bahareh Tolooshams , Kazuhito Koishida

In this paper, we propose long short term memory speech enhancement network (LSTMSE-Net), an audio-visual speech enhancement (AVSE) method. This innovative method leverages the complementary nature of visual and audio information to boost…

Recent research has delved into speech enhancement (SE) approaches that leverage audio embeddings from pre-trained models, diverging from time-frequency masking or signal prediction techniques. This paper introduces an efficient and…

音频与语音处理 · 电气工程与系统科学 2025-06-16 Xingwei Sun , Heinrich Dinkel , Yadong Niu , Linzhang Wang , Junbo Zhang , Jian Luan

In the evolving landscape of 6G networks, semantic communications are poised to revolutionize data transmission by prioritizing the transmission of semantic meaning over raw data accuracy. This paper presents a Vision Transformer…

图像与视频处理 · 电气工程与系统科学 2025-03-24 Muhammad Ahmed Mohsin , Muhammad Jazib , Zeeshan Alam , Muhmmad Farhan Khan , Muhammad Saad , Muhammad Ali Jamshed

Audio-visual speech enhancement (AV-SE) methods utilize auxiliary visual cues to enhance speakers' voices. Therefore, technically they should be able to outperform the audio-only speech enhancement (SE) methods. However, there are few works…

音频与语音处理 · 电气工程与系统科学 2023-03-14 Zirun Zhu , Hemin Yang , Min Tang , Ziyi Yang , Sefik Emre Eskimez , Huaming Wang

Speech enhancement in multichannel settings has been realized by utilizing the spatial information embedded in multiple microphone signals. Moreover, deep neural networks (DNNs) have been recently advanced in this field; however, studies on…

音频与语音处理 · 电气工程与系统科学 2024-10-28 Dongheon Lee , Seongrae Kim , Jung-Woo Choi

Speech enhancement plays an essential role in improving the quality of speech signals in noisy environments. This paper investigates the efficacy of integrating Bidirectional Gated Recurrent Units (BGRU) and Transformer models for speech…

声音 · 计算机科学 2025-02-26 Souliman Alghnam , Mohammad Alhussien , Khaled Shaheen

Data-driven speech enhancement employing deep neural networks (DNNs) can provide state-of-the-art performance even in the presence of non-stationary noise. During the training process, most of the speech enhancement neural networks are…

音频与语音处理 · 电气工程与系统科学 2021-04-01 Ziyi Xu , Maximilian Strake , Tim Fingscheidt

Neural multi-channel speech enhancement models, in particular those based on the U-Net architecture, demonstrate promising performance and generalization potential. These models typically encode input channels independently, and integrate…

声音 · 计算机科学 2024-10-08 Ibrahim Aldarmaki , Thamar Solorio , Bhiksha Raj , Hanan Aldarmaki

This paper presents a proposed AI Deep Learning model that addresses common challenges encountered in Visible Light Communication (VLC) systems. In this work, we run a Python simulation that models a basic VLC system primarily affected by…

信号处理 · 电气工程与系统科学 2025-07-14 A. A. Nutfaji , Moustafa Hassan Elmallah

Speech quality and intelligibility are significantly degraded in noisy environments. This paper presents a novel transformer-based learning framework to address the single-channel noise suppression problem for real-time applications.…

声音 · 计算机科学 2025-11-18 Behnaz Bahmei , Siamak Arzanpour , Elina Birmingham

Data augmentation is conventionally used to inject robustness in Speaker Verification systems. Several recently organized challenges focus on handling novel acoustic environments. Deep learning based speech enhancement is a modern solution…

音频与语音处理 · 电气工程与系统科学 2020-04-29 Saurabh Kataria , Phani Sankar Nidadavolu , Jesús Villalba , Najim Dehak

Data augmentation has proven to be a promising prospect in improving the performance of deep learning models by adding variability to training data. In previous work with developing a noise robust acoustic-to-articulatory speech inversion…

音频与语音处理 · 电气工程与系统科学 2023-06-02 Yashish M. Siriwardena , Ahmed Adel Attia , Ganesh Sivaraman , Carol Espy-Wilson