English
Related papers

Related papers: Pruning-aware Loss Functions for STOI-Optimized Pr…

200 papers

In multi speakers environments, cochlear implant (CI) users may attend to a target sound source in a different manner from the normal hearing (NH) individuals during a conversation. This study attempted to investigate the effect of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-05 Sara Akbarzadeh , Sungmin Lee , Chin-Tuan Tan

Transformer-based models have become the state of the art across multiple domains, from natural language processing to machine listening, thanks to the attention mechanisms. However, the attention layers require a large number of parameters…

Hidden hearing loss, or cochlear neural degeneration (CND), disrupts suprathreshold auditory coding without affecting clinical thresholds, making it difficult to diagnose. We present an information-theoretic framework to evaluate speech…

Neurons and Cognition · Quantitative Biology 2025-10-09 Ahsan J. Cheema , Sunil Puria

The conventional wisdom has been that designing ultra-compact, battery-constrained wireless hearables with on-device speech AI models is challenging due to the high computational demands of streaming deep learning models. Speech AI models…

Sound · Computer Science 2025-10-23 Malek Itani , Tuochao Chen , Arun Raghavan , Gavriel Kohlberg , Shyamnath Gollakota

Pruning is a widely used technique to reduce the size and inference cost of large language models (LLMs), but it often causes performance degradation. To mitigate this, existing restoration methods typically employ parameter-efficient…

Machine Learning · Computer Science 2025-10-28 Zijian Feng , Hanzhang Zhou , Zixiao Zhu , Tianjiao Li , Jia Jim Deryl Chua , Lee Onn Mak , Gee Wah Ng , Kezhi Mao

Advanced auditory models are useful in designing signal-processing algorithms for hearing-loss compensation or speech enhancement. Such auditory models provide rich and detailed descriptions of the auditory pathway, and might allow for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-18 Peter Leer , Jesper Jensen , Zheng-Hua Tan , Jan Østergaard , Lars Bramsløw

Current deep learning (DL) based approaches to speech intelligibility enhancement in noisy environments are often trained to minimise the feature distance between noise-free speech and enhanced speech signals. Despite improving the speech…

Speech separation approaches for single-channel, dry speech mixtures have significantly improved. However, real-world spatial and reverberant acoustic environments remain challenging, limiting the effectiveness of these approaches for…

Cochlear Implant (CI) surgery treats severe hearing loss by inserting an electrode array into the cochlea to stimulate the auditory nerve. An important step in this procedure is mastoidectomy, which removes part of the mastoid region of the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Yike Zhang , Eduardo Davalos , Dingjie Su , Ange Lou , Jack Noble

The growing size of neural language models has led to increased attention in model compression. The two predominant approaches are pruning, which gradually removes weights from a pre-trained model, and distillation, which trains a smaller…

Computation and Language · Computer Science 2022-05-04 Mengzhou Xia , Zexuan Zhong , Danqi Chen

Pruning is a promising approach to compress deep learning models in order to deploy them on resource-constrained edge devices. However, many existing pruning solutions are based on unstructured pruning, which yields models that cannot…

Machine Learning · Computer Science 2023-03-16 Kaiqi Zhao , Animesh Jain , Ming Zhao

Compression techniques for deep neural networks are important for implementing them on small embedded devices. In particular, channel-pruning is a useful technique for realizing compact networks. However, many conventional methods require…

Machine Learning · Statistics 2021-11-03 Kohei Yamamoto , Kurato Maeno

Current hearing aids normally provide amplification based on a general prescriptive fitting, and the benefits provided by the hearing aids vary among different listening environments despite the inclusion of noise suppression feature.…

Sound · Computer Science 2021-06-10 Zehai Tu , Ning Ma , Jon Barker

Electrical hearing by cochlear implants (CIs) may be fundamentally different from acoustic hearing by normal-hearing (NH) listeners, presumably showing unequal speech quality perception in various noise environments. Noise reduction (NR)…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-04 Sara Akbarzadeh , Sungmin Lee , Fei Chen , Chin-Tuan Tan

Efficient channel state information (CSI) compression is essential in frequency division duplexing (FDD) massive multiple-input multiple-output (MIMO) systems due to the substantial feedback overhead. Recently, deep learning-based…

Information Theory · Computer Science 2026-05-19 Mehdi Sattari , Deniz Gündüz , Tommy Svensson

Recent years have seen significant efforts to adopt Artificial Intelligence (AI) in healthcare for various use cases, from computer-aided diagnosis to ICU triage. However, the size of AI models has been rapidly growing due to scaling laws…

Image and Video Processing · Electrical Eng. & Systems 2024-04-16 Mohammed Adnan , Qinle Ba , Nazim Shaikh , Shivam Kalra , Satarupa Mukherjee , Auranuch Lorsakul

Modern speech enhancement algorithms achieve remarkable noise suppression by means of large recurrent neural networks (RNNs). However, large RNNs limit practical deployment in hearing aid hardware (HW) form-factors, which are battery…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-15 Igor Fedorov , Marko Stamenovic , Carl Jensen , Li-Chia Yang , Ari Mandell , Yiming Gan , Matthew Mattina , Paul N. Whatmough

Channel pruning is a promising technique to compress the parameters of deep convolutional neural networks(DCNN) and to speed up the inference. This paper aims to address the long-standing inefficiency of channel pruning. Most channel…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Zhouyang Xie , Yan Fu , Shengzhao Tian , Junlin Zhou , Duanbing Chen

Convolutional neural networks have shown tremendous performance capabilities in computer vision tasks, but their excessive amounts of weight storage and arithmetic operations prevent them from being adopted in embedded environments. One of…

Neural and Evolutionary Computing · Computer Science 2020-09-08 Hyeong-Ju Kang

Current deep learning (DL) based approaches to speech intelligibility enhancement in noisy environments are generally trained to minimise the distance between clean and enhanced speech features. These often result in improved speech quality…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-16 Tassadaq Hussain , Muhammad Diyan , Mandar Gogate , Kia Dashtipour , Ahsan Adeel , Yu Tsao , Amir Hussain