中文
相关论文

相关论文: Multitask-Based Joint Learning Approach To Robust …

200 篇论文

End-to-end modeling (E2E) of automatic speech recognition (ASR) blends all the components of a traditional speech recognition system into a unified model. Although it simplifies training and decoding pipelines, the unified model is hard to…

计算与语言 · 计算机科学 2018-12-06 Zhehuai Chen , Mahaveer Jain , Yongqiang Wang , Michael L. Seltzer , Christian Fuegen

End-to-end (E2E) models fold the acoustic, pronunciation and language models of a conventional speech recognition model into one neural network with a much smaller number of parameters than a conventional ASR system, thus making it suitable…

音频与语音处理 · 电气工程与系统科学 2020-05-14 Bo Li , Shuo-yiin Chang , Tara N. Sainath , Ruoming Pang , Yanzhang He , Trevor Strohman , Yonghui Wu

This paper presents an audio visual automatic speech recognition (AV-ASR) system using a Transformer-based architecture. We particularly focus on the scene context provided by the visual information, to ground the ASR. We extract…

音频与语音处理 · 电气工程与系统科学 2020-05-01 Georgios Paraskevopoulos , Srinivas Parthasarathy , Aparna Khare , Shiva Sundaram

Recently, connectionist temporal classification (CTC)-based end-to-end (E2E) automatic speech recognition (ASR) models have achieved impressive results, especially with the development of self-supervised learning. However, E2E ASR models…

音频与语音处理 · 电气工程与系统科学 2023-12-15 Keqi Deng , Philip C. Woodland

Joint optimization of multi-channel front-end and automatic speech recognition (ASR) has attracted much interest. While promising results have been reported for various tasks, past studies on its meeting transcription application were…

音频与语音处理 · 电气工程与系统科学 2020-11-30 Xiaofei Wang , Naoyuki Kanda , Yashesh Gaur , Zhuo Chen , Zhong Meng , Takuya Yoshioka

This paper describes our RoyalFlush system for the track of multi-speaker automatic speech recognition (ASR) in the M2MeT challenge. We adopted the serialized output training (SOT) based multi-speakers ASR system with large-scale simulation…

声音 · 计算机科学 2022-02-25 Shuaishuai Ye , Peiyao Wang , Shunfei Chen , Xinhui Hu , Xinkang Xu

Although great progresses have been made in automatic speech recognition (ASR), significant performance degradation is still observed when recognizing multi-talker mixed speech. In this paper, we propose and evaluate several architectures…

声音 · 计算机科学 2018-12-06 Yanmin Qian , Xuankai Chang , Dong Yu

All-neural, end-to-end ASR systems gained rapid interest from the speech recognition community. Such systems convert speech input to text units using a single trainable neural network model. E2E models require large amounts of paired speech…

计算与语言 · 计算机科学 2021-10-08 Rongqing Huang

Self-supervised training has shown promising gains in pretraining models and facilitating the downstream finetuning for speech recognition, like multilingual ASR. Most existing methods adopt a 2-stage scheme where the self-supervised loss…

计算与语言 · 计算机科学 2021-11-17 Junwen Bai , Bo Li , Yu Zhang , Ankur Bapna , Nikhil Siddhartha , Khe Chai Sim , Tara N. Sainath

This paper describes the GMU systems for the IWSLT 2025 low-resource speech translation shared task. We trained systems for all language pairs, except for Levantine Arabic. We fine-tuned SeamlessM4T-v2 for automatic speech recognition…

计算与语言 · 计算机科学 2025-05-29 Chutong Meng , Antonios Anastasopoulos

Compared to hybrid automatic speech recognition (ASR) systems that use a modular architecture in which each component can be independently adapted to a new domain, recent end-to-end (E2E) ASR system are harder to customize due to their…

计算与语言 · 计算机科学 2022-03-01 Samuel Thomas , Brian Kingsbury , George Saon , Hong-Kwang J. Kuo

End-to-end (E2E) automatic speech recognition (ASR) with sequence-to-sequence models has gained attention because of its simple model training compared with conventional hidden Markov model based ASR. Recently, several studies report the…

音频与语音处理 · 电气工程与系统科学 2020-02-21 Yuya Fujita , Aswin Shanmugam Subramanian , Motoi Omachi , Shinji Watanabe

Confidence scores are very useful for downstream applications of automatic speech recognition (ASR) systems. Recent works have proposed using neural networks to learn word or utterance confidence scores for end-to-end ASR. In those studies,…

音频与语音处理 · 电气工程与系统科学 2021-04-28 David Qiu , Yanzhang He , Qiujia Li , Yu Zhang , Liangliang Cao , Ian McGraw

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement algorithms. However, speech enhancement has not been established as an effective frontend for robust automatic speech recognition (ASR) in…

音频与语音处理 · 电气工程与系统科学 2023-06-22 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

The combination of a deep neural network (DNN) -based speech enhancement (SE) front-end and an automatic speech recognition (ASR) back-end is a widely used approach to implement overlapping speech recognition. However, the SE front-end…

音频与语音处理 · 电气工程与系统科学 2022-06-17 Hiroshi Sato , Tsubasa Ochiai , Marc Delcroix , Keisuke Kinoshita , Naoyuki Kamo , Takafumi Moriya

This paper proposes the use of two task-aware warping factors in mask-based speech enhancement (SE). One controls the balance between speech-maintenance and noise-removal in training phases, while the other controls SE power applied to…

声音 · 计算机科学 2021-08-30 Qiongqiong Wang , Kong Aik Lee , Takafumi Koshinaka , Koji Okabe , Hitoshi Yamamoto

Text injection for automatic speech recognition (ASR), wherein unpaired text-only data is used to supplement paired audio-text data, has shown promising improvements for word error rate. This study examines the use of text injection for…

计算与语言 · 计算机科学 2023-08-16 Shaan Bijwadia , Shuo-yiin Chang , Weiran Wang , Zhong Meng , Hao Zhang , Tara N. Sainath

As automatic speech recognition (ASR) systems are now being widely deployed in the wild, the increasing threat of adversarial attacks raises serious questions about the security and reliability of using such systems. On the other hand,…

音频与语音处理 · 电气工程与系统科学 2022-04-06 Nilaksh Das , Duen Horng Chau

Recently, end-to-end (E2E) automatic speech recognition (ASR) systems have garnered tremendous attention because of their great success and unified modeling paradigms in comparison to conventional hybrid DNN-HMM ASR systems. Despite the…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Tien-Hong Lo , Shi-Yan Weng , Hsiu-Jui Chang , Berlin Chen

Acoustic echo degrades the user experience in voice communication systems thus needs to be suppressed completely. We propose a real-time residual acoustic echo suppression (RAES) method using an efficient convolutional neural network. The…

声音 · 计算机科学 2020-11-09 Xinquan Zhou , Yanhong Leng