中文
相关论文

相关论文: When Audio-Language Models Fail to Leverage Multim…

200 篇论文

Automatic Speech Recognition (ASR) is increasingly used to document clinical encounters, yet its reliability in multilingual and demographically diverse Indian healthcare contexts remains largely unknown. In this study, we conduct the first…

In recent years, automatic speech recognition (ASR) models greatly improved transcription performance both in clean, low noise, acoustic conditions and in reverberant environments. However, all these systems rely on the availability of…

音频与语音处理 · 电气工程与系统科学 2024-09-18 Francesco Nespoli , Daniel Barreda , Patrick A. Naylor

Machine anomalous sound detection (ASD) is a valuable technique across various applications. However, its generalization performance is often limited due to challenges in data collection and the complexity of acoustic environments. Inspired…

声音 · 计算机科学 2025-08-19 Bing Han , Anbai Jiang , Xinhu Zheng , Wei-Qiang Zhang , Jia Liu , Pingyi Fan , Yanmin Qian

The performance of Automatic Speech Recognition (ASR) systems has constantly increased in state-of-the-art development. However, performance tends to decrease considerably in more challenging conditions (e.g., background noise, multiple…

计算与语言 · 计算机科学 2024-05-24 Ronald Cumbal , Birger Moell , Jose Lopes , Olof Engwall

Automating dysarthria assessments offers the opportunity to develop practical, low-cost tools that address the current limitations of manual and subjective assessments. Nonetheless, the small size of most dysarthria datasets makes it…

计算与语言 · 计算机科学 2024-03-26 Xavier F. Cadet , Ranya Aloufi , Sara Ahmadi-Abhari , Hamed Haddadi

Single-word Automatic Speech Recognition (ASR) is a challenging task due to the lack of linguistic context and sensitivity to noise, pronunciation variation, and channel artifacts, especially in low-resource, communication-critical domains…

声音 · 计算机科学 2026-01-30 Manali Sharma , Riya Naik , Buvaneshwari G

Linguistic anomalies detectable in spontaneous speech have shown promise for various clinical applications including screening for dementia and other forms of cognitive impairment. The feasibility of deploying automated tools that can…

音频与语音处理 · 电气工程与系统科学 2022-11-15 Changye Li , Trevor Cohen , Serguei Pakhomov

Automatic speech recognition (ASR) systems often degrade on accented speech because acoustic-phonetic and prosodic shifts induce a mismatch to training data, making labeled accent adaptation costly. However, common pseudo-label selection…

计算与语言 · 计算机科学 2026-02-17 Ligong Lei , Wenwen Lu , Xudong Pang , Zaokere Kadeer , Aishan Wumaier

Nowadays, research in speech technologies has gotten a lot out thanks to recently created public domain corpora that contain thousands of recording hours. These large amounts of data are very helpful for training the new complex models…

音频与语音处理 · 电气工程与系统科学 2021-05-12 Guillermo Cámbara , Alex Peiró-Lilja , Mireia Farrús , Jordi Luque

Large language models (LLM) have demonstrated the ability to understand human language by leveraging large amount of text data. Automatic speech recognition (ASR) systems are often limited by available transcribed speech data and benefit…

音频与语音处理 · 电气工程与系统科学 2024-09-26 Prashanth Gurunath Shivakumar , Jari Kolehmainen , Aditya Gourav , Yi Gu , Ankur Gandhe , Ariya Rastrow , Ivan Bulyko

Speech enhancement methods are commonly believed to improve the performance of automatic speech recognition (ASR) in noisy environments. However, the effectiveness of these techniques cannot be taken for granted in the case of modern…

Zero-shot ASR for Arabic remains challenging: while multilingual models perform well on Modern Standard Arabic (MSA), error rates rise sharply on dialectal and accented speech due to linguistic mismatch and scarce labeled data. We study…

计算与语言 · 计算机科学 2026-01-13 Bashar Talafha , Amin Abu Alhassan , Muhammad Abdul-Mageed

Speech impairments caused by conditions such as cerebral palsy or genetic disorders pose significant challenges for automatic speech recognition (ASR) systems. Despite recent advances, ASR models like Whisper struggle with non-normative…

计算与语言 · 计算机科学 2025-06-30 Niclas Pokel , Pehuén Moure , Roman Boehringer , Yingqiang Gao

Dysarthria is a motor speech disorder often characterized by reduced speech intelligibility through slow, uncoordinated control of speech production muscles. Automatic Speech recognition (ASR) systems can help dysarthric talkers communicate…

声音 · 计算机科学 2023-08-17 Mohammad Soleymanpour , Michael T. Johnson , Rahim Soleymanpour , Jeffrey Berry

Recent advances in automatic speech recognition (ASR) and speech enhancement have led to a widespread assumption that improving perceptual audio quality should directly benefit recognition accuracy. In this work, we rigorously examine…

声音 · 计算机科学 2026-03-06 Akif Islam , Raufun Nahar , Md. Ekramul Hamid

Automatic Speech Recognition (ASR) models demonstrate outstanding performance on high-resource languages but face significant challenges when applied to low-resource languages due to limited training data and insufficient cross-lingual…

音频与语音处理 · 电气工程与系统科学 2025-06-17 Ming-Hao Hsu , Hung-yi Lee

This study investigates the impact of integrating a dataset of disordered speech recordings ($\sim$1,000 hours) into the fine-tuning of a near state-of-the-art ASR baseline system. Contrary to what one might expect, despite the data being…

音频与语音处理 · 电气工程与系统科学 2025-12-22 Jimmy Tobin , Katrin Tomanek , Subhashini Venugopalan

Automatic Speech Recognition (ASR) models have achieved remarkable accuracy in general settings, yet their performance often degrades in domain-specific applications due to data mismatch and linguistic variability. This challenge is…

Automatic recognition of disordered and elderly speech remains a highly challenging task to date due to the difficulty in collecting such data in large quantities. This paper explores a series of approaches to integrate domain adapted SSL…

声音 · 计算机科学 2023-06-23 Shujie Hu , Xurong Xie , Zengrui Jin , Mengzhe Geng , Yi Wang , Mingyu Cui , Jiajun Deng , Xunying Liu , Helen Meng

We show the performance of Automatic Speech Recognition (ASR) systems that use semi-supervised speech representations can be boosted by a complimentary pitch accent detection module, by introducing a joint ASR and pitch accent detection…

计算与语言 · 计算机科学 2025-08-08 David Sasu , Natalie Schluter