English
Related papers

Related papers: BUT System Description for CHiME-9 MCoRec Challeng…

200 papers

Speech recognition systems are a key intermediary in voice-driven human-computer interaction. Although speech recognition works well for pristine monologic audio, real-life use cases in open-ended interactive settings still present many…

Computation and Language · Computer Science 2023-12-12 Andreas Liesenfeld , Alianda Lopez , Mark Dingemanse

Topic classification systems on spoken documents usually consist of two modules: an automatic speech recognition (ASR) module to convert speech into text and a text topic classification (TTC) module to predict the topic class from the…

Computation and Language · Computer Science 2021-06-17 Tan Liu , Wu Guo , Bin Gu

Exploiting effective target modeling units is very important and has always been a concern in end-to-end automatic speech recognition (ASR). In this work, we propose a phonetic-assisted multi target units (PMU) modeling approach, to enhance…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-10 Li Li , Dongxing Xu , Haoran Wei , Yanhua Long

Modern Automatic Speech Recognition (ASR) systems can achieve high performance in terms of recognition accuracy. However, a perfectly accurate transcript still can be challenging to read due to disfluency, filter words, and other errata…

Computation and Language · Computer Science 2021-02-23 Junwei Liao , Yu Shi , Ming Gong , Linjun Shou , Sefik Eskimez , Liyang Lu , Hong Qu , Michael Zeng

Automatic Speech Recognition (ASR) has achieved remarkable success with deep learning, driving advancements in conversational artificial intelligence, media transcription, and assistive technologies. However, ASR systems still struggle in…

Sound · Computer Science 2026-03-17 Haoyuan Yang , Yue Zhang , Liqiang Jing , John H. L. Hansen

Although great progresses have been made in automatic speech recognition (ASR), significant performance degradation is still observed when recognizing multi-talker mixed speech. In this paper, we propose and evaluate several architectures…

Sound · Computer Science 2018-12-06 Yanmin Qian , Xuankai Chang , Dong Yu

Under noisy conditions, automatic speech recognition (ASR) can greatly benefit from the addition of visual signals coming from a video of the speaker's face. However, when multiple candidate speakers are visible this traditionally requires…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-12 Otavio Braga , Olivier Siohan

This paper describes the BUT submission to the ESDD 2026 Challenge, specifically focusing on Track 1: Environmental Sound Deepfake Detection with Unseen Generators. To address the critical challenge of generalizing to audio generated by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-10 Junyi Peng , Lin Zhang , Jin Li , Oldrich Plchot , Jan Cernocky

Building Automatic Speech Recognition (ASR) systems from scratch is significantly challenging, mostly due to the time-consuming and financially-expensive process of annotating a large amount of audio data with transcripts. Although several…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-22 Mengli Cheng , Chengyu Wang , Xu Hu , Jun Huang , Xiaobo Wang

The audio-visual speech fusion strategy AV Align has shown significant performance improvements in audio-visual speech recognition (AVSR) on the challenging LRS2 dataset. Performance improvements range between 7% and 30% depending on the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-20 George Sterpu , Christian Saam , Naomi Harte

We propose two improvements to target-speaker voice activity detection (TS-VAD), the core component in our proposed speaker diarization system that was submitted to the 2022 Multi-Channel Multi-Party Meeting Transcription (M2MeT) challenge.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-11 Maokui He , Xiang Lv , Weilin Zhou , JingJing Yin , Xiaoqi Zhang , Yuxuan Wang , Shutong Niu , Yuhang Cao , Heng Lu , Jun Du , Chin-Hui Lee

In this work, we propose a new automatic speech recognition (ASR) system based on feature learning and an end-to-end training procedure for air traffic control (ATC) systems. The proposed model integrates the feature learning block,…

Sound · Computer Science 2021-11-05 Peng Fan , Dongyue Guo , Yi Lin , Bo Yang , Jianwei Zhang

Existing speaker diarization systems typically rely on large amounts of manually annotated data, which is labor-intensive and difficult to obtain, especially in real-world scenarios. Additionally, language-specific constraints in these…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-13 Phat Lam , Lam Pham , Truong Nguyen , Dat Ngo , Thinh Pham , Tin Nguyen , Loi Khanh Nguyen , Alexander Schindler

Bangla, one of the most widely spoken languages, remains underrepresented in state-of-the-art automatic speech recognition (ASR) research, particularly under noisy and speaker-diverse conditions. This paper presents BanglaRobustNet, a…

Sound · Computer Science 2026-01-27 Md Sazzadul Islam Ridoy , Mubaswira Ibnat Zidney , Sumi Akter , Md. Aminur Rahman

In the two-person conversation scenario with one wearing smart glasses, transcribing and displaying the speaker's content in real-time is an intriguing application, providing a priori information for subsequent tasks such as translation and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-10 Ya Jiang , Hongbo Lan , Jun Du , Qing Wang , Shutong Niu

Code-switching automatic speech recognition (ASR) aims to transcribe speech that contains two or more languages accurately. To better capture language-specific speech representations and address language confusion in code-switching ASR, the…

Sound · Computer Science 2025-01-10 He Wang , Xucheng Wan , Naijun Zheng , Kai Liu , Huan Zhou , Guojian Li , Lei Xie

Automatic speech recognition (ASR) systems are designed to transcribe spoken language into written text and find utility in a variety of applications including voice assistants and transcription services. However, it has been observed that…

Computation and Language · Computer Science 2023-07-21 Anand Kumar Rai , Siddharth D Jaiswal , Animesh Mukherjee

Accents, as variations from standard pronunciation, pose significant challenges for speech recognition systems. Although joint automatic speech recognition (ASR) and accent recognition (AR) training has been proven effective in handling…

Sound · Computer Science 2023-11-20 Qijie Shao , Pengcheng Guo , Jinghao Yan , Pengfei Hu , Lei Xie

In recent research, slight performance improvement is observed from automatic speech recognition systems to audio-visual speech recognition systems in the end-to-end framework with low-quality videos. Unmatching convergence rates and…

Computation and Language · Computer Science 2024-03-12 Yusheng Dai , Hang Chen , Jun Du , Xiaofei Ding , Ning Ding , Feijun Jiang , Chin-Hui Lee

Automatic speech recognition (ASR) systems in the medical domain that focus on transcribing clinical dictations and doctor-patient conversations often pose many challenges due to the complexity of the domain. ASR output typically undergoes…

Computation and Language · Computer Science 2020-07-14 Monica Sunkara , Srikanth Ronanki , Kalpit Dixit , Sravan Bodapati , Katrin Kirchhoff