English
Related papers

Related papers: Spatial Processing Front-End For Distant ASR Explo…

200 papers

Recently, end-to-end (E2E) automatic speech recognition (ASR) systems have garnered tremendous attention because of their great success and unified modeling paradigms in comparison to conventional hybrid DNN-HMM ASR systems. Despite the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Tien-Hong Lo , Shi-Yan Weng , Hsiu-Jui Chang , Berlin Chen

In this paper, we introduce spatial attention for refining the information in multi-direction neural beamformer for far-field automatic speech recognition. Previous approaches of neural beamformers with multiple look directions, such as the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-10 Weipeng He , Lu Lu , Biqiao Zhang , Jay Mahadeokar , Kaustubh Kalgaonkar , Christian Fuegen

Humans are capable of processing speech by making use of multiple sensory modalities. For example, the environment where a conversation takes place generally provides semantic and/or acoustic context that helps us to resolve ambiguities or…

Computation and Language · Computer Science 2019-02-21 Ozan Caglayan , Ramon Sanabria , Shruti Palaskar , Loïc Barrault , Florian Metze

Automatic speech recognition (ASR) in multichannel, multi-speaker scenarios remains challenging due to ambient noise, reverberation and overlapping speakers. In this paper, we propose a beamforming approach that processes specific angular…

Sound · Computer Science 2025-09-15 Can Cui , Paul Magron , Mostafa Sadeghi , Emmanuel Vincent

Recently, the end-to-end training approach for neural beamformer-supported multi-channel ASR has shown its effectiveness in multi-channel speech recognition. However, the integration of multiple modules makes it more difficult to perform…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-07 Keyu An , Zhijian Ou

Multilingual end-to-end(E2E) models have shown a great potential in the expansion of the language coverage in the realm of automatic speech recognition(ASR). In this paper, we aim to enhance the multilingual ASR performance in two ways,…

Computation and Language · Computer Science 2021-10-18 Rimita Lahiri , Kenichi Kumatani , Eric Sun , Yao Qian

Attention-based contextual biasing approaches have shown significant improvements in the recognition of generic and/or personal rare-words in End-to-End Automatic Speech Recognition (E2E ASR) systems like neural transducers. These…

Computation and Language · Computer Science 2023-05-10 Xuandi Fu , Kanthashree Mysore Sathyendra , Ankur Gandhe , Jing Liu , Grant P. Strimel , Ross McGowan , Athanasios Mouchtaris

This paper aims at eliminating the interfering speakers' speech, additive noise, and reverberation from the noisy multi-talker speech mixture that benefits automatic speech recognition (ASR) backend. While the recently proposed Weighted…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-19 Zhaoheng Ni , Yong Xu , Meng Yu , Bo Wu , Shixiong Zhang , Dong Yu , Michael I Mandel

The computing power of mobile devices limits the end-user applications in terms of storage size, processing, memory and energy consumption. These limitations motivate researchers for the design of more efficient deep models. On the other…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-05 Pooyan Safari , Miquel India , Javier Hernando

In this paper, we propose a single multi-task learning framework to perform End-to-End (E2E) speech recognition (ASR) and accent recognition (AR) simultaneously. The proposed framework is not only more compact but can also yield comparable…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-16 Jicheng Zhang , Yizhou Peng , Pham Van Tung , Haihua Xu , Hao Huang , Eng Siong Chng

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement (SE) algorithms. However, monaural SE has not been established as an effective frontend for automatic speech recognition (ASR) in noisy…

Sound · Computer Science 2024-03-12 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

Previous studies have confirmed that by augmenting acoustic features with the place/manner of articulatory features, the speech enhancement (SE) process can be guided to consider the broad phonetic properties of the input speech when…

Sound · Computer Science 2023-06-21 Yen-Ju Lu , Chia-Yu Chang , Cheng Yu , Ching-Feng Liu , Jeih-weih Hung , Shinji Watanabe , Yu Tsao

Transformers, originally proposed for natural language processing (NLP) tasks, have recently achieved great success in automatic speech recognition (ASR). However, adjacent acoustic units (i.e., frames) are highly correlated, and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-20 Yangyang Shi , Yongqiang Wang , Chunyang Wu , Christian Fuegen , Frank Zhang , Duc Le , Ching-Feng Yeh , Michael L. Seltzer

Recently, self-supervised pretraining has achieved impressive results in end-to-end (E2E) automatic speech recognition (ASR). However, the dominant sequence-to-sequence (S2S) E2E model is still hard to fully utilize the self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-15 Keqi Deng , Songjun Cao , Yike Zhang , Long Ma

We propose an unsupervised speaker adaptation method inspired by the neural Turing machine for end-to-end (E2E) automatic speech recognition (ASR). The proposed model contains a memory block that holds speaker i-vectors extracted from the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-17 Leda Sarı , Niko Moritz , Takaaki Hori , Jonathan Le Roux

Reverberations are unavoidable in enclosures, resulting in reduced intelligibility for hearing impaired and non native listeners and even for the normal hearing listeners in noisy circumstances. It also degrades the performance of machine…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-11 Sania Gul , Muhammad Salman Khan , Syed Waqar Shah

Automatic speech recognition (ASR) in the cloud allows the use of larger models and more powerful multi-channel signal processing front-ends compared to on-device processing. However, it also adds an inherent latency due to the transmission…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-16 Lukas Drude , Jahn Heymann , Andreas Schwarz , Jean-Marc Valin

Transformer-based end-to-end (E2E) automatic speech recognition (ASR) systems have recently gained wide popularity, and are shown to outperform E2E models based on recurrent structures on a number of ASR tasks. However, like other E2E…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-30 Mohan Li , Catalin Zorila , Rama Doddipatla

Efficient Reduce and AllReduce communication collectives are a critical cornerstone of high-performance computing (HPC) applications. We present the first systematic investigation of Reduce and AllReduce on the Cerebras Wafer-Scale Engine…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-04 Piotr Luczynski , Lukas Gianinazzi , Patrick Iff , Leighton Wilson , Daniele De Sensi , Torsten Hoefler

Recently, Transformer has gained success in automatic speech recognition (ASR) field. However, it is challenging to deploy a Transformer-based end-to-end (E2E) model for online speech recognition. In this paper, we propose the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-12 Haoran Miao , Gaofeng Cheng , Changfeng Gao , Pengyuan Zhang , Yonghong Yan