中文
相关论文

相关论文: Toward Streaming ASR with Non-Autoregressive Inser…

200 篇论文

In automatic speech recognition (ASR) what a user says depends on the particular context she is in. Typically, this context is represented as a set of word n-grams. In this work, we present a novel, all-neural, end-to-end (E2E) ASR sys- tem…

音频与语音处理 · 电气工程与系统科学 2018-08-09 Golan Pundak , Tara N. Sainath , Rohit Prabhavalkar , Anjuli Kannan , Ding Zhao

This paper addresses end-to-end automatic speech recognition (ASR) for long audio recordings such as lecture and conversational speeches. Most end-to-end ASR models are designed to recognize independent utterances, but contextual…

计算与语言 · 计算机科学 2021-04-20 Takaaki Hori , Niko Moritz , Chiori Hori , Jonathan Le Roux

Joint modeling of multi-speaker ASR and speaker diarization has recently shown promising results in speaker-attributed automatic speech recognition (SA-ASR).Although being able to obtain state-of-the-art (SOTA) performance, most of the…

声音 · 计算机科学 2023-10-10 Yangze Li , Fan Yu , Yuhao Liang , Pengcheng Guo , Mohan Shi , Zhihao Du , Shiliang Zhang , Lei Xie

Bootstrapping speech recognition on limited data resources has been an area of active research for long. The recent transition to all-neural models and end-to-end (E2E) training brought along particular challenges as these models are known…

音频与语音处理 · 电气工程与系统科学 2021-06-21 Manuel Giollo , Deniz Gunceler , Yulan Liu , Daniel Willett

Monaural multi-speaker automatic speech recognition (ASR) remains challenging due to data scarcity and the intrinsic difficulty of recognizing and attributing words to individual speakers, particularly in overlapping speech. Recent advances…

计算与语言 · 计算机科学 2026-05-29 Xinlu He , Jacob Whitehill

Although end-to-end (E2E) trainable automatic speech recognition (ASR) has shown great success by jointly learning acoustic and linguistic information, it still suffers from the effect of domain shifts, thus limiting potential applications.…

音频与语音处理 · 电气工程与系统科学 2023-08-28 Keqi Deng , Philip C. Woodland

Conventional automatic speech recognition (ASR) typically performs multi-level pattern recognition tasks that map the acoustic speech waveform into a hierarchy of speech units. But, it is widely known that information loss in the earlier…

计算与语言 · 计算机科学 2017-09-25 Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

This paper proposes a novel automatic speech recognition (ASR) system that can transcribe individual speaker's speech while identifying whether they are target or non-target speakers from multi-talker overlapped speech. Target-speaker ASR…

We present a novel large-context end-to-end automatic speech recognition (E2E-ASR) model and its effective training method based on knowledge distillation. Common E2E-ASR models have mainly focused on utterance-level processing in which…

计算与语言 · 计算机科学 2021-02-17 Ryo Masumura , Naoki Makishima , Mana Ihori , Akihiko Takashima , Tomohiro Tanaka , Shota Orihashi

While generative models have set new benchmarks for Target Speaker Extraction (TSE), their inherent reliance on global context precludes deployment in real-time applications. Direct adaptation to streaming scenarios often leads to…

This article describes an efficient end-to-end speech translation (E2E-ST) framework based on non-autoregressive (NAR) models. End-to-end speech translation models have several advantages over traditional cascade systems such as inference…

音频与语音处理 · 电气工程与系统科学 2021-09-10 Hirofumi Inaguma , Yosuke Higuchi , Kevin Duh , Tatsuya Kawahara , Shinji Watanabe

Despite the significant progress in end-to-end (E2E) automatic speech recognition (ASR), E2E ASR for low resourced code-switching (CS) speech has not been well studied. In this work, we describe an E2E ASR pipeline for the recognition of CS…

计算与语言 · 计算机科学 2019-10-01 Xianghu Yue , Grandee Lee , Emre Yılmaz , Fang Deng , Haizhou Li

Multilingual end-to-end (E2E) models have shown great promise in expansion of automatic speech recognition (ASR) coverage of the world's languages. They have shown improvement over monolingual systems, and have simplified training and…

音频与语音处理 · 电气工程与系统科学 2019-09-13 Anjuli Kannan , Arindrima Datta , Tara N. Sainath , Eugene Weinstein , Bhuvana Ramabhadran , Yonghui Wu , Ankur Bapna , Zhifeng Chen , Seungji Lee

The attention-based end-to-end (E2E) automatic speech recognition (ASR) architecture allows for joint optimization of acoustic and language models within a single network. However, in a vanilla E2E ASR architecture, the decoder sub-network…

计算与语言 · 计算机科学 2019-12-03 Van Tung Pham , Haihua Xu , Yerbolat Khassanov , Zhiping Zeng , Eng Siong Chng , Chongjia Ni , Bin Ma , Haizhou Li

Automatic speech recognition (ASR) systems are primarily evaluated on transcription accuracy. However, in some use cases such as subtitling, verbatim transcription would reduce output readability given limited screen size and reading time.…

计算与语言 · 计算机科学 2020-05-26 Danni Liu , Jan Niehues , Gerasimos Spanakis

Transformer-based models have led to significant innovation in classical and practical subjects as varied as speech processing, natural language processing, and computer vision. On top of the Transformer, attention-based end-to-end…

计算与语言 · 计算机科学 2022-05-19 Fu-Hao Yu , Kuan-Yu Chen

Recently, end-to-end (E2E) automatic speech recognition (ASR) systems have garnered tremendous attention because of their great success and unified modeling paradigms in comparison to conventional hybrid DNN-HMM ASR systems. Despite the…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Tien-Hong Lo , Shi-Yan Weng , Hsiu-Jui Chang , Berlin Chen

Fast inference speed is an important goal towards real-world deployment of speech translation (ST) systems. End-to-end (E2E) models based on the encoder-decoder architecture are more suitable for this goal than traditional cascaded systems,…

计算与语言 · 计算机科学 2021-02-19 Hirofumi Inaguma , Yosuke Higuchi , Kevin Duh , Tatsuya Kawahara , Shinji Watanabe

In this paper, we propose a single multi-task learning framework to perform End-to-End (E2E) speech recognition (ASR) and accent recognition (AR) simultaneously. The proposed framework is not only more compact but can also yield comparable…

音频与语音处理 · 电气工程与系统科学 2021-06-16 Jicheng Zhang , Yizhou Peng , Pham Van Tung , Haihua Xu , Hao Huang , Eng Siong Chng

Automatic Speech Recognition (ASR) using multiple microphone arrays has achieved great success in the far-field robustness. Taking advantage of all the information that each array shares and contributes is crucial in this task. Motivated by…

计算与语言 · 计算机科学 2019-02-20 Xiaofei Wang , Ruizhi Li , Sri Harish Mallid , Takaaki Hori , Shinji Watanabe , Hynek Hermansky