English
Related papers

Related papers: The NPU-ASLP System for Audio-Visual Speech Recogn…

200 papers

This report describes the submission system of the GIST-AiTeR team at the 2022 VoxCeleb Speaker Recognition Challenge (VoxSRC) Track 4. Our system mainly includes speech enhancement, voice activity detection , multi-scaled speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-07 Dongkeon Park , Yechan Yu , Kyeong Wan Park , Ji Won Kim , Hong Kook Kim

Fast Automatic Speech Recognition (ASR) is critical for latency-sensitive applications such as real-time captioning and meeting transcription. However, truly parallel ASR decoding remains challenging due to the sequential nature of…

Low-resource accented speech recognition is one of the important challenges faced by current ASR technology in practical applications. In this study, we propose a Conformer-based architecture, called Aformer, to leverage both the acoustic…

Sound · Computer Science 2023-06-21 Xuefei Wang , Yanhua Long , Yijie Li , Haoran Wei

Audio-visual speech recognition (AVSR) provides a promising solution to ameliorate the noise-robustness of audio-only speech recognition with visual information. However, most existing efforts still focus on audio modality to improve…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-21 Yuchen Hu , Ruizhe Li , Chen Chen , Chengwei Qin , Qiushi Zhu , Eng Siong Chng

Automatic speech recognition (ASR) of multi-channel multi-speaker overlapped speech remains one of the most challenging tasks to the speech community. In this paper, we look into this challenge by utilizing the location information of…

Sound · Computer Science 2021-11-23 Yiwen Shao , Shi-Xiong Zhang , Dong Yu

This report describes the submitted system to the In-Car Multi-Channel Automatic Speech Recognition (ICMC-ASR) challenge, which considers the ASR task with multi-speaker overlapping and Mandarin accent dynamics in the ICMC case. We…

Automatic speech recognition can potentially benefit from the lip motion patterns, complementing acoustic speech to improve the overall recognition performance, particularly in noise. In this paper we propose an audio-visual fusion strategy…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-02 George Sterpu , Christian Saam , Naomi Harte

This paper presents the contribution to the third 'CHiME' speech separation and recognition challenge including both front-end signal processing and back-end speech recognition. In the front-end, Multi-channel Wiener filter (MWF) is…

Sound · Computer Science 2015-09-22 Xiaofei Wang , Chao Wu , Pengyuan Zhang , Ziteng Wang , Yong Liu , Xu Li , Qiang Fu , Yonghong Yan

Recent advances in deep learning and automatic speech recognition (ASR) have enabled the end-to-end (E2E) ASR system and boosted the accuracy to a new level. The E2E systems implicitly model all conventional ASR components, such as the…

The University of Sheffield (USFD) participated in the International Workshop for Spoken Language Translation (IWSLT) in 2014. In this paper, we will introduce the USFD SLT system for IWSLT. Automatic speech recognition (ASR) is achieved by…

Computation and Language · Computer Science 2015-09-22 Raymond W. M. Ng , Mortaza Doulaty , Rama Doddipatla , Wilker Aziz , Kashif Shah , Oscar Saz , Madina Hasan , Ghada AlHarbi , Lucia Specia , Thomas Hain

This paper describes SHNU multilingual conversational speech recognition system (SHNU-mASR, team name-"maybe"), submitted to Track 1 of the INTERSPEECH 2025 MLC-SLM Challenge. Our system integrates a parallel-speech-encoder architecture…

Computation and Language · Computer Science 2025-07-09 Yuxiang Mei , Yuang Zheng , Dongxing Xu , Yanhua Long

The goal of this work is to train strong models for visual speech recognition without requiring human annotated ground truth data. We achieve this by distilling from an Automatic Speech Recognition (ASR) model that has been trained on a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Triantafyllos Afouras , Joon Son Chung , Andrew Zisserman

This paper describes the BUCEA speaker diarization system for the 2022 VoxCeleb Speaker Recognition Challenge. Voxsrc-22 provides the development set and test set of VoxConverse, and we mainly use the test set of VoxConverse for parameter…

Sound · Computer Science 2022-09-21 Ruohua Zhou , Yuxuan Du , Chenlei Hu

Source separation can improve automatic speech recognition (ASR) under multi-party meeting scenarios by extracting single-speaker signals from overlapped speech. Despite the success of self-supervised learning models in single-channel…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-04 Yuang Li , Xianrui Zheng , Philip C. Woodland

Audio-visual speech recognition (AVSR) aims to transcribe human speech using both audio and video modalities. In practical environments with noise-corrupted audio, the role of video information becomes crucial. However, prior works have…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-15 Sungnyun Kim , Kangwook Jang , Sangmin Bae , Hoirin Kim , Se-Young Yun

Audio-visual speech contains synchronized audio and visual information that provides cross-modal supervision to learn representations for both automatic speech recognition (ASR) and visual speech recognition (VSR). We introduce continuous…

Machine Learning · Computer Science 2023-10-02 Andrew Rouditchenko , Ronan Collobert , Tatiana Likhomanenko

This paper describes the University of Sydney& JD's joint submission of the IWSLT 2021 low resource speech translation task. We participated in the Swahili-English direction and got the best scareBLEU (25.3) score among all the…

Computation and Language · Computer Science 2021-07-27 Liang Ding , Di Wu , Dacheng Tao

This article concerns comparative studies on the Automatic Speech Recognition (ASR) model incorporated with the Large Language Model (LLM) used for medical interviews. The proposed solution is tested on polish language benchmarks and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-04 Marcin Pietroń , Szymon Piórkowski , Kamil Faber , Dominik Żurek , Michał Karwatowski , Jerzy Duda , Hubert Zieliński , Piotr Lipnicki , Mikołaj Leszczuk

This paper describes multichannel speech enhancement for improving automatic speech recognition (ASR) in noisy environments. Recently, the minimum variance distortionless response (MVDR) beamforming has widely been used because it works…

End-to-end transformer-based models epitomize the cutting-edge in Automatic Speech Recognition (ASR) systems. Despite their substantial benefits, these models demand extensive training data to perform optimally, presenting a significant…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-10 Abdulhady Abas Abdullah , Hadi Veisi , Tarik Rashid