English
Related papers

Related papers: Adaptive Slimming for Scalable and Efficient Speec…

200 papers

This paper addresses the challenges of Hindi speech separation and enhancement using advanced neural network architectures, with a focus on edge devices. We propose a refined approach leveraging the DEMUCS model to overcome limitations of…

Sound · Computer Science 2025-08-25 Arnav Ramamoorthy

Varying-size models are often required to deploy ASR systems under different hardware and/or application constraints such as memory and latency. To avoid redundant training and optimization efforts for individual models of different sizes,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-30 Jingjing Xu , Wei Zhou , Zijian Yang , Eugen Beck , Ralf Schlueter

Thanks to the latest deep learning algorithms, silent speech interfaces (SSI) are now able to synthesize intelligible speech from articulatory movement data under certain conditions. However, the resulting models are rather…

In this study, we aim to explore efficient tuning methods for speech self-supervised learning. Recent studies show that self-supervised learning (SSL) can learn powerful representations for different speech tasks. However, fine-tuning…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-31 Zih-Ching Chen , Chin-Lun Fu , Chih-Ying Liu , Shang-Wen Li , Hung-yi Lee

Recent studies have shown that post-deployment adaptation can improve the robustness of speech enhancement models in unseen noise conditions. However, existing methods often incur prohibitive computational and memory costs, limiting their…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-10 Longbiao Cheng , Shih-Chii Liu

Although deep learning (DL) has achieved notable progress in speech enhancement (SE), further research is still required for a DL-based SE system to adapt effectively and efficiently to particular speakers. In this study, we propose a novel…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-11 Cheng Yu , Szu-Wei Fu , Tsun-An Hsieh , Yu Tsao , Mirco Ravanelli

In challenging environments with significant noise and reverberation, traditional speech enhancement (SE) methods often lead to over-suppressed speech, creating artifacts during listening and harming downstream tasks performance. To…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-03 Hsin-Tien Chiang , Hao Zhang , Yong Xu , Meng Yu , Dong Yu

Recent research on speech enhancement (SE) has seen the emergence of deep-learning-based methods. It is still a challenging task to determine the effective ways to increase the generalizability of SE under diverse test conditions. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-01 Ryandhimas E. Zezario , Chiou-Shann Fuh , Hsin-Min Wang , Yu Tsao

While significant improvements have been made in recent years in terms of end-to-end automatic speech recognition (ASR) performance, such improvements were obtained through the use of very large neural networks, unfit for embedded use on…

Computation and Language · Computer Science 2020-03-25 Alex Bie , Bharat Venkitesh , Joao Monteiro , Md. Akmal Haidar , Mehdi Rezagholizadeh

Transformer models have been used in automatic speech recognition (ASR) successfully and yields state-of-the-art results. However, its performance is still affected by speaker mismatch between training and test data. Further finetuning a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-19 Yingzhu Zhao , Chongjia Ni , Cheung-Chi Leung , Shafiq Joty , Eng Siong Chng , Bin Ma

Diffusion-based speech enhancement (SE) models need to incorporate correct prior knowledge as reliable conditions to generate accurate predictions. However, providing reliable conditions using noisy features is challenging. One solution is…

Sound · Computer Science 2025-10-08 Hao Shi , Xugang Lu , Kazuki Shimada , Tatsuya Kawahara

This research exploits the applications of reconfigurable intelligent surface (RIS)-assisted multiple input multiple output (MIMO) systems, specifically addressing the enhancement of communication reliability with modulated signals.…

Information Theory · Computer Science 2024-10-10 Trinh Van Chien , Bui Trong Duc , Ho Viet Duc Luong , Huynh Thi Thanh Binh , Hien Quoc Ngo , Symeon Chatzinotas

Single-channel speech enhancement algorithms are often used in resource-constrained embedded devices, where low latency and low complexity designs gain more importance. In recent years, researchers have proposed a wide variety of novel…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-29 Nicolás Arrieta Larraza , Niels de Koeijer

Federated learning (FL) is a novel machine learning setting that enables on-device intelligence via decentralized training and federated optimization. Deep neural networks' rapid development facilitates the learning techniques for modeling…

Machine Learning · Computer Science 2021-09-27 Shaoxiong Ji , Wenqi Jiang , Anwar Walid , Xue Li

The Transformer architecture is widely used for machine translation tasks. However, its resource-intensive nature makes it challenging to implement on constrained embedded devices, particularly where available hardware resources can vary at…

Computation and Language · Computer Science 2021-08-03 Hishan Parry , Lei Xun , Amin Sabet , Jia Bi , Jonathon Hare , Geoff V. Merrett

Distributed microphone array (DMA) is a promising next-generation platform for speech interaction, where speech enhancement (SE) is still required to improve the speech quality in noisy cases. Existing SE methods usually first gather raw…

Sound · Computer Science 2026-01-27 Chengqian Jiang , Jie Zhang , Haoyin Yan

Personalized speech enhancement (PSE) is a real-time SE approach utilizing a speaker embedding of a target person to remove background noise, reverberation, and interfering voices. To deploy a PSE model for full duplex communications, the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-29 Sefik Emre Eskimez , Takuya Yoshioka , Alex Ju , Min Tang , Tanel Parnamaa , Huaming Wang

Recently, more and more personalized speech enhancement systems (PSE) with excellent performance have been proposed. However, two critical issues still limit the performance and generalization ability of the model: 1) Acoustic environment…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-23 Xiaofeng Ge , Jiangyu Han , Haixin Guan , Yanhua Long

We consider a wireless network comprising multiple singleantenna repeaters that amplify and instantaneously re-transmit received signals in a full-duplex (FD) communication setting. Specifically, we study a massive multiple-input multiple…

Information Theory · Computer Science 2026-01-29 Mohammadali Mohammadi , Dhanushka Kudathanthirige , Himal A. Suraweera , Hien Quoc Ngo , Michail Matthaiou

The direct expansion of deep neural network (DNN) based wide-band speech enhancement (SE) to full-band processing faces the challenge of low frequency resolution in low frequency range, which would highly likely lead to deteriorated…

Sound · Computer Science 2022-06-28 Zhongshu Hou , Qinwen Hu , Kai Chen , Jing Lu