English
Related papers

Related papers: Improving Speaker Assignment in Speaker-Attributed…

200 papers

Automatic speech recognition (ASR) systems are typically optimized for verbatim transcription, which preserves disfluencies, filler words, and informal spoken structures that are often unsuitable for downstream writing-oriented…

Computation and Language · Computer Science 2026-05-20 Wanyi Ning , Yinshang Guo , Haitao Qian , Jiyuan Cheng , Weiyuan Feng , Yufei Zhang

With the recent advances in technology, automatic speech recognition (ASR) has been widely used in real-world applications. The efficiency of converting large amounts of speech into text accurately with limited resources has become more…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-09 Yoo Rhee Oh , Kiyoung Park , Jeon Gyu Park

Spatial information is a critical clue for multi-channel multi-speaker target speech recognition. Most state-of-the-art multi-channel Automatic Speech Recognition (ASR) systems extract spatial features only during the speech separation…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-27 Yiwen Shao , Yong Xu , Sanjeev Khudanpur , Dong Yu

Speaker Diarization (SD) aims at grouping speech segments that belong to the same speaker. This task is required in many speech-processing applications, such as rich meeting transcription. In this context, distant microphone arrays usually…

Sound · Computer Science 2024-06-06 Theo Mariotte , Anthony Larcher , Silvio Montresor , Jean-Hugh Thomas

We propose an end-to-end Automatic Speech Recognition (ASR) system that can be trained on transcribed speech data, text-only data, or a mixture of both. The proposed model uses an integrated auxiliary block for text-based training. This…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-08 Vladimir Bataev , Roman Korostik , Evgeny Shabalin , Vitaly Lavrukhin , Boris Ginsburg

This paper presents an audio visual automatic speech recognition (AV-ASR) system using a Transformer-based architecture. We particularly focus on the scene context provided by the visual information, to ground the ASR. We extract…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-01 Georgios Paraskevopoulos , Srinivas Parthasarathy , Aparna Khare , Shiva Sundaram

Overlapping speech remains a major challenge for automatic speech recognition (ASR) in real-world applications, particularly in broadcast media with dynamic, multi-speaker interactions. We propose a light-weight, target-speaker-based…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-26 Aleš Pražák , Marie Kunešová , Josef Psutka

Stuttering -- characterized by involuntary disfluencies such as blocks, prolongations, and repetitions -- is often misinterpreted by automatic speech recognition (ASR) systems, resulting in elevated word error rates and making voice-driven…

Sound · Computer Science 2025-08-22 Dena Mujtaba , Nihar Mahapatra

Recent advances in speech-aware language models have coupled strong acoustic encoders with large language models, enabling systems that move beyond transcription to produce richer outputs. Among these, word-level timestamp prediction is…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-28 Xulin Fan , Vishal Sunder , Samuel Thomas , Mark Hasegawa-Johnson , Brian Kingsbury , George Saon

End-to-end automatic speech recognition (ASR) usually suffers from performance degradation when applied to a new domain due to domain shift. Unsupervised domain adaptation (UDA) aims to improve the performance on the unlabeled target domain…

Computation and Language · Computer Science 2023-02-23 Jiaming Zhou , Shiwan Zhao , Ning Jiang , Guoqing Zhao , Yong Qin

Off-the-shelf pre-trained Automatic Speech Recognition (ASR) systems are an increasingly viable service for companies of any size building speech-based products. While these ASR systems are trained on large amounts of data, domain mismatch…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-18 Anirudh Mani , Shruti Palaskar , Nimshi Venkat Meripo , Sandeep Konam , Florian Metze

Thanks to the rise of self-supervised learning, automatic speech recognition (ASR) systems now achieve near-human performance on a wide variety of datasets. However, they still lack generalization capability and are not robust to domain…

Machine Learning · Computer Science 2023-03-15 Lucas Maison , Yannick Estève

The Streaming Unmixing and Recognition Transducer (SURT) has recently become a popular framework for continuous, streaming, multi-talker speech recognition (ASR). With advances in architecture, objectives, and mixture simulation methods, it…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-30 Desh Raj , Matthew Wiesner , Matthew Maciejewski , Leibny Paola Garcia-Perera , Daniel Povey , Sanjeev Khudanpur

We propose an open-source framework for Command-style dictation that addresses the gap between resource-intensive Online systems and high-latency Batch processing. Our approach uses Voice Activity Detection (VAD) to segment audio and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-16 Kumarmanas Nethil , Vaibhav Mishra , Kriti Anandan , Kavya Manohar

Conventional end-to-end automatic speech recognition (ASR) systems rely on paired speech-text data for domain adaptation. Recent LLM-based ASR architectures connect a speech encoder to a large language model via a projection module,…

Prior works have investigated the use of articulatory features as complementary representations for automatic speech recognition (ASR), but their use was largely confined to shallow acoustic models. In this work, we revisit articulatory…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-13 Ahmed Adel Attia , Jing Liu , Carol Espy Wilson

When dealing with overlapped speech, the performance of automatic speech recognition (ASR) systems substantially degrades as they are designed for single-talker speech. To enhance ASR performance in conversational or meeting environments,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-16 Hassan Taherian , DeLiang Wang

In this work, we focus on improving ASR output segmentation in the context of low-resource language speech-to-text translation. ASR output segmentation is crucial, as ASR systems segment the input audio using purely acoustic information and…

Computation and Language · Computer Science 2020-10-20 David Wan , Zhengping Jiang , Chris Kedzie , Elsbeth Turcan , Peter Bell , Kathleen McKeown

We present improvements in automatic speech recognition (ASR) for Somali, a currently extremely under-resourced language. This forms part of a continuing United Nations (UN) effort to employ ASR-based keyword spotting systems to support…

Computation and Language · Computer Science 2019-07-09 Astik Biswas , Raghav Menon , Ewald van der Westhuizen , Thomas Niesler

Automatic speech recognition (ASR) has been an essential component of computer assisted language learning (CALL) and computer assisted language testing (CALT) for many years. As this technology continues to develop rapidly, it is important…

Computation and Language · Computer Science 2025-04-01 Michael McGuire