English
Related papers

Related papers: Speaker Tagging Correction With Non-Autoregressive…

200 papers

ASR models often suffer from a long-form deletion problem where the model predicts sequential blanks instead of words when transcribing a lengthy audio (in the order of minutes or hours). From the perspective of a user or downstream system…

Speaker diarization is an important pre-processing step for many speech applications, and it aims to solve the "who spoke when" problem. Although the standard diarization systems can achieve satisfactory results in various scenarios, they…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-18 Zili Huang , Shinji Watanabe , Yusuke Fujita , Paola Garcia , Yiwen Shao , Daniel Povey , Sanjeev Khudanpur

Dysarthric speech reconstruction (DSR), which aims to improve the quality of dysarthric speech, remains a challenge, not only because we need to restore the speech to be normal, but also must preserve the speaker's identity. The speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-21 Disong Wang , Songxiang Liu , Xixin Wu , Hui Lu , Lifa Sun , Xunying Liu , Helen Meng

Automatic speech recognition (ASR) systems have dramatically improved over the last few years. ASR systems are most often trained from 'typical' speech, which means that underrepresented groups don't experience the same level of…

Automatic Speech Recognition (ASR) technology has made significant progress in recent years, providing accurate transcription across various domains. However, some challenges remain, especially in noisy environments and specialized jargon.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-06 Aviv Shamsian , Aviv Navon , Neta Glazer , Gill Hetz , Joseph Keshet

Automatic Speech Recognition systems have made significant progress with large-scale pre-trained models. However, most current systems focus solely on transcribing the speech without identifying speaker roles, a function that is critical…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-13 Anfeng Xu , Tiantian Feng , Shrikanth Narayanan

Text mismatch between pre-collected data, either training data or enrollment data, and the actual test data can significantly hurt text-dependent speaker verification (SV) system performance. Although this problem can be solved by carefully…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-07 Yexin Yang , Shuai Wang , Xun Gong , Yanmin Qian , Kai Yu

Despite the remarkable progress in end-to-end Automatic Speech Recognition (ASR) engines, accurately transcribing dysarthric speech remains a major challenge. In this work, we proposed a two-stage framework for the Speech Accessibility…

Computation and Language · Computer Science 2025-05-27 Moreno La Quatra , Alkis Koudounas , Valerio Mario Salerno , Sabato Marco Siniscalchi

Given recent advances in generative AI technology, a key question is how large language models (LLMs) can enhance acoustic modeling tasks using text decoding results from a frozen, pretrained automatic speech recognition (ASR) model. To…

Over the last few years, deep learning has grown in popularity for speaker verification, identification, and diarization. Inarguably, a significant part of this success is due to the demonstrated effectiveness of their speaker…

Sound · Computer Science 2022-10-07 Yehoshua Dissen , Felix Kreuk , Joseph Keshet

Transformer models have been used in automatic speech recognition (ASR) successfully and yields state-of-the-art results. However, its performance is still affected by speaker mismatch between training and test data. Further finetuning a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-19 Yingzhu Zhao , Chongjia Ni , Cheung-Chi Leung , Shafiq Joty , Eng Siong Chng , Bin Ma

In automatic speech processing systems, speaker diarization is a crucial front-end component to separate segments from different speakers. Inspired by the recent success of deep neural networks (DNNs) in semantic inferencing, triplet…

Audio and Speech Processing · Electrical Eng. & Systems 2018-08-07 Huan Song , Megan Willi , Jayaraman J. Thiagarajan , Visar Berisha , Andreas Spanias

This paper presents the system developed to address the MISP 2025 Challenge. For the diarization system, we proposed a hybrid approach combining a WavLM end-to-end segmentation method with a traditional multi-module clustering technique to…

Sound · Computer Science 2025-05-29 Shangkun Huang , Yuxuan Du , Jingwen Yang , Dejun Zhang , Xupeng Jia , Jing Deng , Jintao Kang , Rong Zheng

This paper presents the TEA-ASLP's system submitted to the MLC-SLM 2025 Challenge, addressing multilingual conversational automatic speech recognition (ASR) in Task I and speech diarization ASR in Task II. For Task I, we enhance Ideal-LLM…

Sound · Computer Science 2025-07-25 Hongfei Xue , Kaixun Huang , Zhikai Zhou , Shen Huang , Shidong Shang

Automatic speech recognition (ASR) systems are known to be sensitive to the sociolinguistic variability of speech data, in which gender plays a crucial role. This can result in disparities in recognition accuracy between male and female…

Computation and Language · Computer Science 2023-10-11 Dennis Fucci , Marco Gaido , Matteo Negri , Mauro Cettolo , Luisa Bentivogli

Speaker extraction and diarization are two enabling techniques for real-world speech applications. Speaker extraction aims to extract a target speaker's voice from a speech mixture, while speaker diarization demarcates speech segments by…

Sound · Computer Science 2025-01-17 Junyi Ao , Mehmet Sinan Yıldırım , Ruijie Tao , Meng Ge , Shuai Wang , Yanmin Qian , Haizhou Li

While current state-of-the-art Automatic Speech Recognition (ASR) systems achieve high accuracy on typical speech, they suffer from significant performance degradation on disordered speech and other atypical speech patterns. Personalization…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-21 Katrin Tomanek , Françoise Beaufays , Julie Cattiau , Angad Chandorkar , Khe Chai Sim

Target-speaker automatic speech recognition (ASR) aims to transcribe the desired speech of a target speaker from multi-talker overlapped utterances. Most of the existing target-speaker ASR (TS-ASR) methods involve either training from…

Computation and Language · Computer Science 2024-01-12 Hao Ma , Zhiyuan Peng , Mingjie Shao , Jing Li , Ju Liu

There is increasingly more evidence that automatic speech recognition (ASR) systems are biased against different speakers and speaker groups, e.g., due to gender, age, or accent. Research on bias in ASR has so far primarily focused on…

Computation and Language · Computer Science 2025-07-09 Tanvina Patel , Wiebke Hutiri , Aaron Yi Ding , Odette Scharenborg

Speaker diarization, the process of segmenting an audio stream or transcribed speech content into homogenous partitions based on speaker identity, plays a crucial role in the interpretation and analysis of human speech. Most existing…

Machine Learning · Computer Science 2024-08-23 Luyao Cheng , Hui Wang , Siqi Zheng , Yafeng Chen , Rongjie Huang , Qinglin Zhang , Qian Chen , Xihao Li