English
Related papers

Related papers: A Speech Intelligibility Enhancement Model based o…

200 papers

Cochlear implants (CIs) provide a solution for individuals with severe sensorineural hearing loss to regain their hearing abilities. When someone experiences this form of hearing impairment in both ears, they may be equipped with two…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-03 Tom Gajecki , Waldo Nogueira

Recent studies demonstrate the effectiveness of Self Supervised Learning (SSL) speech representations for Speech Inversion (SI). However, applying SI in real-world scenarios remains challenging due to the pervasive presence of background…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-22 Saba Tabatabaee , Carol Espy-Wilson

Large Audio Language Models (LALMs) have been widely applied in real-time scenarios, such as in-car assistants and online meeting comprehension. In practice, audio inputs are often corrupted by device and environmental noise, leading to…

Sound · Computer Science 2026-01-13 Yuanhe Zhang , Jiayu Tian , Yibo Zhang , Shilinlu Yan , Liang Lin , Zhenhong Zhou , Li Sun , Sen Su

The estimation of speech intelligibility is still far from being a solved problem. Especially one aspect is problematic: most of the standard models require a clean reference signal in order to estimate intelligibility. This is an issue of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-29 Mahdie Karbasi , Stefan Bleeck , Dorothea Kolossa

Cognitive impairment (CI) is of growing public health concern, and early detection is vital for effective intervention. Speech has gained attention as a non-invasive and easily collectible biomarker for assessing cognitive decline.…

Sound · Computer Science 2025-06-24 Mostafa Shahin , Beena Ahmed , Julien Epps

The integration of artificial intelligence into hearing assistance marks a paradigm shift from traditional amplification-based systems to intelligent, context-aware audio processing. This systematic literature review evaluates advances in…

Sound · Computer Science 2025-08-05 Haris Khan , Shumaila Asif , Hassan Nasir , Kamran Aziz Bhatti , Shahzad Amin Sheikh

Multimodal language analysis often considers relationships between features based on text and those based on acoustical and visual properties. Text features typically outperform non-text features in sentiment analysis or emotion recognition…

Machine Learning · Computer Science 2019-12-03 Zhongkai Sun , Prathusha Sarma , William Sethares , Yingyu Liang

Automatic speech recognition (ASR) degrades severely in noisy environments. Although speech enhancement (SE) front-ends effectively suppress background noise, they often introduce artifacts that harm recognition. Observation addition (OA)…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-25 Haoyang Li , Changsong Liu , Wei Rao , Hao Shi , Sakriani Sakti , Eng Siong Chng

Real-time speech enhancement (SE) is essential to online speech communication. Causal SE models use only the previous context while predicting future information, such as phoneme continuation, may help performing causal SE. The phonetic…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-30 Emiru Tsunoo , Yuki Saito , Wataru Nakata , Hiroshi Saruwatari

Noisy situations cause huge problems for suffers of hearing loss as hearing aids often make the signal more audible but do not always restore the intelligibility. In noisy settings, humans routinely exploit the audio-visual (AV) nature of…

Sound · Computer Science 2019-09-24 Mandar Gogate , Kia Dashtipour , Ahsan Adeel , Amir Hussain

Individuals with hearing impairments face challenges in their ability to comprehend speech, particularly in noisy environments. The aim of this study is to explore the effectiveness of audio-visual speech enhancement (AVSE) in enhancing the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-07 Richard Lee Lai , Jen-Cheng Hou , I-Chun Chern , Kuo-Hsuan Hung , Yi-Ting Chen , Mandar Gogate , Tughrul Arslan , Amir Hussain , Yu Tsao

Current medical AI systems often fail to replicate real-world clinical reasoning, as they are predominantly trained and evaluated on static text and question-answer tasks. These tuning methods and benchmarks overlook critical aspects like…

Computation and Language · Computer Science 2026-02-24 Zijie Liu , Xinyu Zhao , Jie Peng , Zhuangdi Zhu , Qingyu Chen , Kaidi Xu , Xia Hu , Tianlong Chen

This paper proposes neural networks for compensating sensorineural hearing loss. The aim of the hearing loss compensation task is to transform a speech signal to increase speech intelligibility after further processing by a person with a…

Sound · Computer Science 2023-10-26 Szymon Drgas , Lars Bramsløw , Archontis Politis , Gaurav Naithani , Tuomas Virtanen

Supervised learning based methods for source localization, being data driven, can be adapted to different acoustic conditions via training and have been shown to be robust to adverse acoustic environments. In this paper, a convolutional…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-22 Soumitro Chakrabarty , Emanuël A. P. Habets

An accurate objective speech intelligibility prediction algorithms is of great interest for many applications such as speech enhancement for hearing aids. Most algorithms measures the signal-to-noise ratios or correlations between the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-07 Zehai Tu , Ning Ma , Jon Barker

Human listeners readily adjust to unfamiliar speakers and language varieties through exposure, but do these adaptation benefits extend to state-of-the-art spoken language models? We introduce a scalable framework that allows for in-context…

Computation and Language · Computer Science 2025-05-22 Nathan Roll , Calbert Graham , Yuka Tatsumi , Kim Tien Nguyen , Meghan Sumner , Dan Jurafsky

Since the advent of Deep Learning (DL), Speech Enhancement (SE) models have performed well under a variety of noise conditions. However, such systems may still introduce sonic artefacts, sound unnatural, and restrict the ability for a user…

Estimating time-frequency domain masks for speech enhancement using deep learning approaches has recently become a popular field of research. In this paper, we propose a mask-based speech enhancement framework by using concatenated…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-29 Ziyi Xu , Maximilian Strake , Tim Fingscheidt

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

Machine Learning · Computer Science 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

Improving speech system performance in noisy environments remains a challenging task, and speech enhancement (SE) is one of the effective techniques to solve the problem. Motivated by the promising results of generative adversarial networks…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-05 Daniel Michelsanti , Zheng-Hua Tan