English
Related papers

Related papers: HarmoniFuse: A Component-Selective and Prompt-Adap…

200 papers

Vietnamese Speech Emotion Recognition (SER) remains challenging due to ambiguous acoustic patterns and the lack of reliable annotated data, especially in real-world conditions where emotional boundaries are not clearly separable. To address…

Computation and Language · Computer Science 2026-04-03 Truc Nguyen , Then Tran , Binh Truong , Phuoc Nguyen T. H

Single-word Automatic Speech Recognition (ASR) is a challenging task due to the lack of linguistic context and sensitivity to noise, pronunciation variation, and channel artifacts, especially in low-resource, communication-critical domains…

Sound · Computer Science 2026-01-30 Manali Sharma , Riya Naik , Buvaneshwari G

Multi-intent Spoken Language Understanding has great potential for widespread implementation. Jointly modeling Intent Detection and Slot Filling in it provides a channel to exploit the correlation between intents and slots. However, current…

Computation and Language · Computer Science 2022-10-10 Feifan Song , Lianzhe Huang , Houfeng Wang

Speech language models (Speech LMs) enable end-to-end speech-text modeling within a single model, offering a promising direction for spoken dialogue systems. The choice of speech-text jointly decoding paradigm plays a critical role in…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-12 Haibin Wu , Yuxuan Hu , Ruchao Fan , Xiaofei Wang , Kenichi Kumatani , Bo Ren , Jianwei Yu , Heng Lu , Lijuan Wang , Yao Qian , Jinyu Li

Speech large language models (LLMs) observe paralinguistic cues such as prosody, emotion, and non-verbal sounds--crucial for intent understanding. However, leveraging these cues faces challenges: limited training data, annotation…

In real-world applications, automatic speech recognition (ASR) systems must handle overlapping speech from multiple speakers and recognize rare words like technical terms. Traditional methods address multi-talker ASR and contextual biasing…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-17 Jiajun He , Naoki Sawada , Koichi Miyazaki , Tomoki Toda

Language understanding in speech-based systems have attracted much attention in recent years with the growing demand for voice interface applications. However, the robustness of natural language understanding (NLU) systems to errors…

Computation and Language · Computer Science 2022-03-17 Lingyun Feng , Jianwei Yu , Deng Cai , Songxiang Liu , Haitao Zheng , Yan Wang

While Speech Foundation Models (SFMs) excel in various speech tasks, their performance for low-resource tasks such as child Automatic Speech Recognition (ASR) is hampered by limited pretraining data. To address this, we explore different…

Computation and Language · Computer Science 2025-01-16 Natarajan Balaji Shankar , Zilai Wang , Eray Eren , Abeer Alwan

Attention-based sequence-to-sequence modeling provides a powerful and elegant solution for applications that need to map one sequence to a different sequence. Its success heavily relies on the availability of large amounts of training data.…

Computation and Language · Computer Science 2021-02-12 Yun Tang , Juan Pino , Changhan Wang , Xutai Ma , Dmitriy Genzel

The performance bottleneck of Automatic Speech Recognition (ASR) in stuttering speech scenarios has limited its applicability in domains such as speech rehabilitation. This paper proposed an LLM-driven ASR-SED multi-task learning framework…

Sound · Computer Science 2025-05-29 Shangkun Huang , Jing Deng , Jintao Kang , Rong Zheng

Generative models have excelled in audio tasks using approaches such as language models, diffusion, and flow matching. However, existing generative approaches for speech enhancement (SE) face notable challenges: language model-based methods…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-28 Ziqian Wang , Zikai Liu , Xinfa Zhu , Yike Zhu , Mingshuai Liu , Jun Chen , Longshuai Xiao , Chao Weng , Lei Xie

Training automatic speech recognition (ASR) models increasingly relies on decentralized federated learning to ensure data privacy and accessibility, producing multiple local models that require effective merging. In hybrid ASR systems,…

Computation and Language · Computer Science 2026-03-06 Mengze Hong , Yi Gu , Di Jiang , Hanlin Gu , Chen Jason Zhang , Lu Wang , Zhiyang Su

Compensation for channel mismatch and noise interference is essential for robust automatic speech recognition. Enhanced speech has been introduced into the multi-condition training of acoustic models to improve their generalization ability.…

Sound · Computer Science 2022-11-24 Hung-Shin Lee , Pin-Yuan Chen , Yao-Fei Cheng , Yu Tsao , Hsin-Min Wang

Fine-tuning pretrained language models (LMs) is a popular approach to automatic speech recognition (ASR) error detection during post-processing. While error detection systems often take advantage of statistical language archetypes captured…

Computation and Language · Computer Science 2021-08-05 Seongmin Park , Dongchan Shin , Sangyoun Paik , Subong Choi , Alena Kazakova , Jihwa Lee

Recent advancements in multilingual automatic speech recognition (ASR) have been driven by large-scale end-to-end models like Whisper. However, challenges such as language interference and expanding to unseen languages (language expansion)…

Computation and Language · Computer Science 2025-09-29 Hongli Yang , Sheng Li , Hao Huang , Ayiduosi Tuohan , Yizhou Peng

Speech emotion recognition (SER) is an important technology in human-computer interaction. However, achieving high performance is challenging due to emotional complexity and scarce annotated data. To tackle these challenges, we propose a…

Sound · Computer Science 2026-03-06 Cong Wang , Yizhong Geng , Yuhua Wen , Qifei Li , Yingming Gao , Ruimin Wang , Chunfeng Wang , Hao Li , Ya Li , Wei Chen

Hearing aids (HAs) are widely used to provide personalized speech enhancement (PSE) services, improving the quality of life for individuals with hearing loss. However, HA performance significantly declines in noisy environments as it treats…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-10 Ye Ni , Ruiyu Liang , Xiaoshuai Hao , Jiaming Cheng , Qingyun Wang , Chengwei Huang , Cairong Zou , Wei Zhou , Weiping Ding , Björn W. Schuller

This paper presents a novel hybrid Automatic Speech Recognition (ASR) system designed specifically for resource-constrained robots. The proposed approach combines Hidden Markov Models (HMMs) with deep learning models and leverages socket…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-25 Anshul Ranjan , Kaushik Jegadeesan

Recent efforts target spoken language models (SLMs) that not only listen but also speak for more natural human-LLM interaction. Joint speech-text modeling is a promising direction to achieve this. However, the effectiveness of recent speech…

Computation and Language · Computer Science 2026-02-06 Liang-Hsuan Tseng , Yi-Chang Chen , Kuan-Yi Lee , Da-Shan Shiu , Hung-yi Lee

We propose a multi-stage framework for universal speech enhancement, designed for the Interspeech 2025 URGENT Challenge. Our system first employs a Sparse Compression Network to robustly separate sources and extract an initial clean speech…

Sound · Computer Science 2025-06-03 Nabarun Goswami , Tatsuya Harada