中文
相关论文

相关论文: Deliberation Model Based Two-Pass End-to-End Speec…

200 篇论文

In this paper, we present Adaptive Computation Steps (ACS) algo-rithm, which enables end-to-end speech recognition models to dy-namically decide how many frames should be processed to predict a linguistic output. The model that applies ACS…

音频与语音处理 · 电气工程与系统科学 2018-09-27 Mohan Li , Min Liu , Masanori Hattori

The existing fake audio detection systems often rely on expert experience to design the acoustic features or manually design the hyperparameters of the network structure. However, artificial adjustment of the parameters can have a…

Automatic speech recognition (ASR) systems degrade significantly under noisy conditions. Recently, speech enhancement (SE) is introduced as front-end to reduce noise for ASR, but it also suppresses some important speech information, i.e.,…

音频与语音处理 · 电气工程与系统科学 2023-05-30 Yuchen Hu , Nana Hou , Chen Chen , Eng Siong Chng

The accuracy of end-to-end (E2E) automatic speech recognition (ASR) models continues to improve as they are scaled to larger sizes, with some now reaching billions of parameters. Widespread deployment and adoption of these models, however,…

Fast inference speed is an important goal towards real-world deployment of speech translation (ST) systems. End-to-end (E2E) models based on the encoder-decoder architecture are more suitable for this goal than traditional cascaded systems,…

计算与语言 · 计算机科学 2021-02-19 Hirofumi Inaguma , Yosuke Higuchi , Kevin Duh , Tatsuya Kawahara , Shinji Watanabe

Modern speaker verification systems primarily rely on speaker embeddings, followed by verification based on cosine similarity between the embedding vectors of the enrollment and test utterances. While effective, these methods struggle with…

声音 · 计算机科学 2025-07-04 Wan Lin , Junhui Chen , Tianhao Wang , Zhenyu Zhou , Lantian Li , Dong Wang

End-to-end (E2E) neural modeling has emerged as one predominant school of thought to develop computer-assisted language training (CAPT) systems, showing competitive performance to conventional pronunciation-scoring based methods. However,…

计算与语言 · 计算机科学 2022-02-23 Hsin-Wei Wang , Bi-Cheng Yan , Hsuan-Sheng Chiu , Yung-Chang Hsu , Berlin Chen

Recently, the end-to-end approach has been successfully applied to multi-speaker speech separation and recognition in both single-channel and multichannel conditions. However, severe performance degradation is still observed in the…

Voice Assistants such as Alexa, Siri, and Google Assistant typically use a two-stage Spoken Language Understanding pipeline; first, an Automatic Speech Recognition (ASR) component to process customer speech and generate text transcriptions,…

计算与语言 · 计算机科学 2020-12-17 Subendhu Rongali , Beiye Liu , Liwei Cai , Konstantine Arkoudas , Chengwei Su , Wael Hamza

In this paper we propose a novel data augmentation method for attention-based end-to-end automatic speech recognition (E2E-ASR), utilizing a large amount of text which is not paired with speech signals. Inspired by the back-translation…

计算与语言 · 计算机科学 2018-07-31 Tomoki Hayashi , Shinji Watanabe , Yu Zhang , Tomoki Toda , Takaaki Hori , Ramon Astudillo , Kazuya Takeda

In voice-enabled applications, a predetermined hotword isusually used to activate a device in order to attend to the query.However, speaking queries followed by a hotword each timeintroduces a cognitive burden in continued conversations.…

Streaming voice conversion has become increasingly popular for its potential in real-time applications. The recently proposed DualVC 2 has achieved robust and high-quality streaming voice conversion with a latency of about 180ms.…

音频与语音处理 · 电气工程与系统科学 2024-06-13 Ziqian Ning , Shuai Wang , Pengcheng Zhu , Zhichao Wang , Jixun Yao , Lei Xie , Mengxiao Bi

The Listen, Attend and Spell (LAS) model and other attention-based automatic speech recognition (ASR) models have known limitations when operated in a fully online mode. In this paper, we analyze the online operation of LAS models to…

音频与语音处理 · 电气工程与系统科学 2020-12-02 Roger Hsiao , Dogan Can , Tim Ng , Ruchir Travadi , Arnab Ghoshal

Training a high performance end-to-end speech (E2E) processing model requires an enormous amount of labeled speech data, especially in the era of data-centric artificial intelligence. However, labeled speech data are usually scarcer and…

计算与语言 · 计算机科学 2023-10-25 Jianqiao Lu , Wenyong Huang , Nianzu Zheng , Xingshan Zeng , Yu Ting Yeung , Xiao Chen

On-device end-to-end (E2E) models have shown improvements over a conventional model on English Voice Search tasks in both quality and latency. E2E models have also shown promising results for multilingual automatic speech recognition (ASR).…

音频与语音处理 · 电气工程与系统科学 2022-08-31 Bo Li , Tara N. Sainath , Ruoming Pang , Shuo-yiin Chang , Qiumin Xu , Trevor Strohman , Vince Chen , Qiao Liang , Heguang Liu , Yanzhang He , Parisa Haghani , Sameer Bidichandani

This paper addresses end-to-end automatic speech recognition (ASR) for long audio recordings such as lecture and conversational speeches. Most end-to-end ASR models are designed to recognize independent utterances, but contextual…

计算与语言 · 计算机科学 2021-04-20 Takaaki Hori , Niko Moritz , Chiori Hori , Jonathan Le Roux

Spoken Language Understanding (SLU) is a critical component of voice assistants; it consists of converting speech to semantic parses for task execution. Previous works have explored end-to-end models to improve the quality and robustness of…

计算与语言 · 计算机科学 2024-06-13 Trang Le , Daniel Lazar , Suyoun Kim , Shan Jiang , Duc Le , Adithya Sagar , Aleksandr Livshits , Ahmed Aly , Akshat Shrivastava

End-to-end (E2E) systems have played a more and more important role in automatic speech recognition (ASR) and achieved great performance. However, E2E systems recognize output word sequences directly with the input acoustic feature, which…

音频与语音处理 · 电气工程与系统科学 2020-08-04 Qi Liu , Zhehuai Chen , Hao Li , Mingkun Huang , Yizhou Lu , Kai Yu

In this paper, we propose a single multi-task learning framework to perform End-to-End (E2E) speech recognition (ASR) and accent recognition (AR) simultaneously. The proposed framework is not only more compact but can also yield comparable…

音频与语音处理 · 电气工程与系统科学 2021-06-16 Jicheng Zhang , Yizhou Peng , Pham Van Tung , Haihua Xu , Hao Huang , Eng Siong Chng

Language identification is critical for many downstream tasks in automatic speech recognition (ASR), and is beneficial to integrate into multilingual end-to-end ASR as an additional task. In this paper, we propose to modify the structure of…

音频与语音处理 · 电气工程与系统科学 2022-09-14 Chao Zhang , Bo Li , Tara Sainath , Trevor Strohman , Sepand Mavandadi , Shuo-yiin Chang , Parisa Haghani