中文
相关论文

相关论文: CUSIDE-array: A Streaming Multi-Channel End-to-End…

200 篇论文

This work proposes a frame-wise online/streaming end-to-end neural diarization (EEND) method, which detects speaker activities in a frame-in-frame-out fashion. The proposed model mainly consists of a causal embedding encoder and an online…

音频与语音处理 · 电气工程与系统科学 2025-09-09 Di Liang , Xiaofei Li

There is growing interest in unifying the streaming and full-context automatic speech recognition (ASR) networks into a single end-to-end ASR model to simplify the model training and deployment for both use cases. While in real-world ASR…

音频与语音处理 · 电气工程与系统科学 2022-10-10 Chunxi Liu , Yuan Shangguan , Haichuan Yang , Yangyang Shi , Raghuraman Krishnamoorthi , Ozlem Kalinli

Multi-access edge computing (MEC) is viewed as an integral part of future wireless networks to support new applications with stringent service reliability and latency requirements. However, guaranteeing ultra-reliable and low-latency MEC…

系统与控制 · 电气工程与系统科学 2022-01-26 Arian Ahmadi , Omid Semiari , Mehdi Bennis , Merouane Debbah

End-to-end (E2E) automatic speech recognition (ASR) systems directly map acoustics to words using a unified model. Previous works mostly focus on E2E training a single model which integrates acoustic and language model into a whole.…

计算与语言 · 计算机科学 2018-03-06 Zhehuai Chen , Qi Liu , Hao Li , Kai Yu

The Transformer self-attention network has recently shown promising performance as an alternative to recurrent neural networks in end-to-end (E2E) automatic speech recognition (ASR) systems. However, Transformer has a drawback in that the…

音频与语音处理 · 电气工程与系统科学 2019-10-29 Emiru Tsunoo , Yosuke Kashiwagi , Toshiyuki Kumakura , Shinji Watanabe

Mispronunciation detection and diagnosis (MDD) is a core component of computer-assisted pronunciation training (CAPT). Most of the existing MDD approaches focus on dealing with categorical errors (viz. one canonical phone is substituted by…

音频与语音处理 · 电气工程与系统科学 2020-08-31 Bi-Cheng Yan , Meng-Che Wu , Hsiao-Tsung Hung , Berlin Chen

Recent advances in Automatic Speech Recognition (ASR) demonstrated how end-to-end systems are able to achieve state-of-the-art performance. There is a trend towards deeper neural networks, however those ASR models are also more complex and…

音频与语音处理 · 电气工程与系统科学 2020-07-22 Ludwig Kürzinger , Edgar Ricardo Chavez Rosas , Lujun Li , Tobias Watzel , Gerhard Rigoll

Using end-to-end models for speech translation (ST) has increasingly been the focus of the ST community. These models condense the previously cascaded systems by directly converting sound waves into translated text. However, cascaded models…

计算与语言 · 计算机科学 2021-01-25 Orion Weller , Matthias Sperber , Christian Gollan , Joris Kluivers

This paper presents a novel framework for joint speaker diarization (SD) and automatic speech recognition (ASR), named SLIDAR (sliding-window diarization-augmented recognition). SLIDAR can process arbitrary length inputs and can handle any…

音频与语音处理 · 电气工程与系统科学 2023-10-04 Samuele Cornell , Jee-weon Jung , Shinji Watanabe , Stefano Squartini

We propose a novel deliberation-based approach to end-to-end (E2E) spoken language understanding (SLU), where a streaming automatic speech recognition (ASR) model produces the first-pass hypothesis and a second-pass natural language…

计算与语言 · 计算机科学 2022-09-08 Duc Le , Akshat Shrivastava , Paden Tomasello , Suyoun Kim , Aleksandr Livshits , Ozlem Kalinli , Michael L. Seltzer

End-to-end (E2E) multi-channel ASR systems show state-of-the-art performance in far-field ASR tasks by joint training of a multi-channel front-end along with the ASR model. The main limitation of such systems is that they are usually…

音频与语音处理 · 电气工程与系统科学 2021-09-24 Marco Gaudesi , Felix Weninger , Dushyant Sharma , Puming Zhan

The Automated Speech Recognition (ASR) community experiences a major turning point with the rise of the fully-neural (End-to-End, E2E) approaches. At the same time, the conventional hybrid model remains the standard choice for the practical…

音频与语音处理 · 电气工程与系统科学 2022-10-24 Valentin Vielzeuf , Grigory Antipov

There is often a trade-off between performance and latency in streaming automatic speech recognition (ASR). Traditional methods such as look-ahead and chunk-based methods, usually require information from future frames to advance…

音频与语音处理 · 电气工程与系统科学 2022-07-07 Zehan Li , Haoran Miao , Keqi Deng , Gaofeng Cheng , Sanli Tian , Ta Li , Yonghong Yan

In this paper, we present a streaming end-to-end speech recognition model based on Monotonic Chunkwise Attention (MoCha) jointly trained with enhancement layers. Even though the MoCha attention enables streaming speech recognition with…

声音 · 计算机科学 2021-05-05 Chanwoo Kim , Abhinav Garg , Dhananjaya Gowda , Seongkyu Mun , Changwoo Han

The rising interest in single-channel multi-speaker speech separation sparked development of End-to-End (E2E) approaches to multi-speaker speech recognition. However, up until now, state-of-the-art neural network-based time domain source…

音频与语音处理 · 电气工程与系统科学 2020-04-14 Thilo von Neumann , Keisuke Kinoshita , Lukas Drude , Christoph Boeddeker , Marc Delcroix , Tomohiro Nakatani , Reinhold Haeb-Umbach

This paper proposes a new paradigm for handling far-field multi-speaker data in an end-to-end neural network manner, called directional automatic speech recognition (D-ASR), which explicitly models source speaker locations. In D-ASR, the…

音频与语音处理 · 电气工程与系统科学 2020-11-03 Aswin Shanmugam Subramanian , Chao Weng , Shinji Watanabe , Meng Yu , Yong Xu , Shi-Xiong Zhang , Dong Yu

We propose an unsupervised speaker adaptation method inspired by the neural Turing machine for end-to-end (E2E) automatic speech recognition (ASR). The proposed model contains a memory block that holds speaker i-vectors extracted from the…

音频与语音处理 · 电气工程与系统科学 2020-02-17 Leda Sarı , Niko Moritz , Takaaki Hori , Jonathan Le Roux

In this paper we propose a novel data augmentation method for attention-based end-to-end automatic speech recognition (E2E-ASR), utilizing a large amount of text which is not paired with speech signals. Inspired by the back-translation…

计算与语言 · 计算机科学 2018-07-31 Tomoki Hayashi , Shinji Watanabe , Yu Zhang , Tomoki Toda , Takaaki Hori , Ramon Astudillo , Kazuya Takeda

End-to-end automatic speech recognition (E2E-ASR) can be classified by its decoder architectures, such as connectionist temporal classification (CTC), recurrent neural network transducer (RNN-T), attention-based encoder-decoder, and…

音频与语音处理 · 电气工程与系统科学 2025-01-15 Yui Sudo , Muhammad Shakeel , Yosuke Fukumoto , Brian Yan , Jiatong Shi , Yifan Peng , Shinji Watanabe

End-to-end (E2E) systems have achieved competitive results compared to conventional hybrid hidden Markov model (HMM)-deep neural network based automatic speech recognition (ASR) systems. Such E2E systems are attractive due to the lack of…

计算与语言 · 计算机科学 2018-02-14 Kartik Audhkhasi , Andrew Rosenberg , Abhinav Sethy , Bhuvana Ramabhadran , Brian Kingsbury