中文
相关论文

相关论文: Exploiting Single-Channel Speech For Multi-channel…

200 篇论文

Multilingual end-to-end(E2E) models have shown a great potential in the expansion of the language coverage in the realm of automatic speech recognition(ASR). In this paper, we aim to enhance the multilingual ASR performance in two ways,…

计算与语言 · 计算机科学 2021-10-18 Rimita Lahiri , Kenichi Kumatani , Eric Sun , Yao Qian

This paper addresses end-to-end automatic speech recognition (ASR) for long audio recordings such as lecture and conversational speeches. Most end-to-end ASR models are designed to recognize independent utterances, but contextual…

计算与语言 · 计算机科学 2021-04-20 Takaaki Hori , Niko Moritz , Chiori Hori , Jonathan Le Roux

The multi-stream paradigm of audio processing, in which several sources are simultaneously considered, has been an active research area for information fusion. Our previous study offered a promising direction within end-to-end automatic…

计算与语言 · 计算机科学 2019-10-24 Ruizhi Li , Gregory Sell , Xiaofei Wang , Shinji Watanabe , Hynek Hermansky

Although end-to-end automatic speech recognition (E2E ASR) has achieved great performance in tasks that have numerous paired data, it is still challenging to make E2E ASR robust against noisy and low-resource conditions. In this study, we…

音频与语音处理 · 电气工程与系统科学 2021-06-08 Emiru Tsunoo , Kentaro Shibata , Chaitanya Narisetty , Yosuke Kashiwagi , Shinji Watanabe

Whereas conventional spoken language understanding (SLU) systems map speech to text, and then text to intent, end-to-end SLU systems map speech directly to intent through a single trainable model. Achieving high accuracy with these…

音频与语音处理 · 电气工程与系统科学 2019-07-26 Loren Lugosch , Mirco Ravanelli , Patrick Ignoto , Vikrant Singh Tomar , Yoshua Bengio

Although fully end-to-end speaker diarization systems have made significant progress in recent years, modular systems often achieve superior results in real-world scenarios due to their greater adaptability and robustness. Historically,…

音频与语音处理 · 电气工程与系统科学 2024-09-26 Ruoyu Wang , Shutong Niu , Gaobin Yang , Jun Du , Shuangqing Qian , Tian Gao , Jia Pan

Transformer models have been introduced into end-to-end speech recognition with state-of-the-art performance on various tasks owing to their superiority in modeling long-term dependencies. However, such improvements are usually obtained…

声音 · 计算机科学 2020-11-18 Haoneng Luo , Shiliang Zhang , Ming Lei , Lei Xie

Automatic speech recognition (ASR) systems typically rely on an external endpointer (EP) model to identify speech boundaries. In this work, we propose a method to jointly train the ASR and EP tasks in a single end-to-end (E2E) multitask…

声音 · 计算机科学 2023-02-16 Shaan Bijwadia , Shuo-yiin Chang , Bo Li , Tara Sainath , Chao Zhang , Yanzhang He

End-to-end speech recognition has become popular in recent years, since it can integrate the acoustic, pronunciation and language models into a single neural network. Among end-to-end approaches, attention-based methods have emerged as…

声音 · 计算机科学 2020-06-03 Zhifu Gao , Shiliang Zhang , Ming Lei , Ian McLoughlin

We present our experiments in training robust to noise an end-to-end automatic speech recognition (ASR) model using intensive data augmentation. We explore the efficacy of fine-tuning a pre-trained model to improve noise robustness, and we…

音频与语音处理 · 电气工程与系统科学 2020-10-27 Jagadeesh Balam , Jocelyn Huang , Vitaly Lavrukhin , Slyne Deng , Somshubra Majumdar , Boris Ginsburg

All-neural end-to-end (E2E) automatic speech recognition (ASR) systems that use a single neural network to transduce audio to word sequences have been shown to achieve state-of-the-art results on several tasks. In this work, we examine the…

音频与语音处理 · 电气工程与系统科学 2019-10-28 Arun Narayanan , Rohit Prabhavalkar , Chung-Cheng Chiu , David Rybach , Tara N. Sainath , Trevor Strohman

End-to-end models have gradually become the preferred option for automatic speech recognition (ASR) applications. During the training of end-to-end ASR, data augmentation is a quite effective technique for regularizing the neural networks.…

音频与语音处理 · 电气工程与系统科学 2021-04-27 Jianwei Sun , Zhiyuan Tang , Hengxin Yin , Wei Wang , Xi Zhao , Shuaijiang Zhao , Xiaoning Lei , Wei Zou , Xiangang Li

This work presents our end-to-end (E2E) automatic speech recognition (ASR) model targetting at robust speech recognition, called Integraded speech Recognition with enhanced speech Input for Self-supervised learning representation (IRIS).…

声音 · 计算机科学 2022-04-04 Xuankai Chang , Takashi Maekaku , Yuya Fujita , Shinji Watanabe

In this paper, we present a novel modeling method for single-channel multi-talker overlapped automatic speech recognition (ASR) systems. Fully neural network based end-to-end models have dramatically improved the performance of multi-taker…

计算与语言 · 计算机科学 2021-07-06 Ryo Masumura , Daiki Okamura , Naoki Makishima , Mana Ihori , Akihiko Takashima , Tomohiro Tanaka , Shota Orihashi

In this paper, we propose to use pre-trained features from end-to-end ASR models to solve speech sentiment analysis as a down-stream task. We show that end-to-end ASR features, which integrate both acoustic and text information from speech,…

计算与语言 · 计算机科学 2020-03-06 Zhiyun Lu , Liangliang Cao , Yu Zhang , Chung-Cheng Chiu , James Fan

The lack of code-switch training data is one of the major concerns in the development of end-to-end code-switching automatic speech recognition (ASR) models. In this work, we propose a method to train an improved end-to-end code-switching…

计算与语言 · 计算机科学 2021-01-14 Yerbolat Khassanov , Haihua Xu , Van Tung Pham , Zhiping Zeng , Eng Siong Chng , Chongjia Ni , Bin Ma

End-to-end (E2E) multi-channel ASR systems show state-of-the-art performance in far-field ASR tasks by joint training of a multi-channel front-end along with the ASR model. The main limitation of such systems is that they are usually…

音频与语音处理 · 电气工程与系统科学 2021-09-24 Marco Gaudesi , Felix Weninger , Dushyant Sharma , Puming Zhan

This paper presents a method to train end-to-end automatic speech recognition (ASR) models using unpaired data. Although the end-to-end approach can eliminate the need for expert knowledge such as pronunciation dictionaries to build ASR…

计算与语言 · 计算机科学 2019-05-24 Takaaki Hori , Ramon Astudillo , Tomoki Hayashi , Yu Zhang , Shinji Watanabe , Jonathan Le Roux

Multi-channel acoustic signal processing is a well-established and powerful tool to exploit the spatial diversity between a target signal and non-target or noise sources for signal enhancement. However, the textbook solutions for optimal…

音频与语音处理 · 电气工程与系统科学 2025-01-14 Reinhold Haeb-Umbach , Tomohiro Nakatani , Marc Delcroix , Christoph Boeddeker , Tsubasa Ochiai

A key desiderata for inclusive and accessible speech recognition technology is ensuring its robust performance to children's speech. Notably, this includes the rapidly advancing neural network based end-to-end speech recognition systems.…

音频与语音处理 · 电气工程与系统科学 2021-02-22 Prashanth Gurunath Shivakumar , Shrikanth Narayanan