English
Related papers

Related papers: Squeezeformer: An Efficient Transformer for Automa…

200 papers

The Conformer has become the most popular encoder model for automatic speech recognition (ASR). It adds convolution modules to a transformer to learn both local and global dependencies. In this work we describe a faster, more…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-11 Zengwei Yao , Liyong Guo , Xiaoyu Yang , Wei Kang , Fangjun Kuang , Yifan Yang , Zengrui Jin , Long Lin , Daniel Povey

The recently proposed Conformer architecture has shown state-of-the-art performances in Automatic Speech Recognition by combining convolution with attention to model both local and global dependencies. In this paper, we study how to reduce…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-09 Maxime Burchi , Valentin Vielzeuf

SqueezeFormer has recently shown impressive performance in automatic speech recognition (ASR). However, its inference speed suffers from the quadratic complexity of softmax-attention (SA). In addition, limited by the large convolution…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-16 Yuguang Yang , Yu Pan , Jingjing Yin , Jiangyu Han , Lei Ma , Heng Lu

Conformer-based attention models have become the de facto backbone model for Automatic Speech Recognition tasks. A blank symbol is usually introduced to align the input and output sequences for CTC or RNN-T models. Unfortunately, the long…

Computation and Language · Computer Science 2024-05-22 Wenjing Zhu , Sining Sun , Changhao Shan , Peng Fan , Qing Yang

Conformer-based models have become the dominant end-to-end architecture for speech processing tasks. With the objective of enhancing the conformer architecture for efficient training and inference, we carefully redesigned Conformer with a…

Recently Transformer and Convolution neural network (CNN) based models have shown promising results in Automatic Speech Recognition (ASR), outperforming Recurrent neural networks (RNNs). Transformer models are good at capturing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Anmol Gulati , James Qin , Chung-Cheng Chiu , Niki Parmar , Yu Zhang , Jiahui Yu , Wei Han , Shibo Wang , Zhengdong Zhang , Yonghui Wu , Ruoming Pang

Transformer has achieved extraordinary performance in Natural Language Processing and Computer Vision tasks thanks to its powerful self-attention mechanism, and its variant Conformer has become a state-of-the-art architecture in the field…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-18 Dexin Liao , Tao Jiang , Feng Wang , Lin Li , Qingyang Hong

State-of-the-art ASR systems have achieved promising results by modeling local and global interactions separately. While the former can be computed efficiently, global interactions are usually modeled via attention mechanisms, which are…

Computation and Language · Computer Science 2023-05-30 Florian Mai , Juan Zuluaga-Gomez , Titouan Parcollet , Petr Motlicek

This study addresses robust automatic speech recognition (ASR) by introducing a Conformer-based acoustic model. The proposed model builds on the wide residual bi-directional long short-term memory network (WRBN) with utterance-wise dropout…

Sound · Computer Science 2022-10-21 Yufeng Yang , Peidong Wang , DeLiang Wang

Conformer, combining convolution and self-attention sequentially to capture both local and global information, has shown remarkable performance and is currently regarded as the state-of-the-art for automatic speech recognition (ASR).…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-18 Kwangyoun Kim , Felix Wu , Yifan Peng , Jing Pan , Prashant Sridhar , Kyu J. Han , Shinji Watanabe

The Transformer architecture has been well adopted as a dominant architecture in most sequence transduction tasks including automatic speech recognition (ASR), since its attention mechanism excels in capturing long-range dependencies. While…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-13 Jing Pan , Tao Lei , Kwangyoun Kim , Kyu Han , Shinji Watanabe

Transformer has obtained promising results on cognitive speech signal processing field, which is of interest in various applications ranging from emotion to neurocognitive disorder analysis. However, most works treat speech signal as a…

Sound · Computer Science 2022-03-11 Weidong Chen , Xiaofen Xing , Xiangmin Xu , Jianxin Pang , Lan Du

Conformer, a convolution-augmented Transformer variant, has become the de facto encoder architecture for speech processing due to its superior performance in various tasks, including automatic speech recognition (ASR), speech translation…

Computation and Language · Computer Science 2023-05-19 Yifan Peng , Kwangyoun Kim , Felix Wu , Brian Yan , Siddhant Arora , William Chen , Jiyang Tang , Suwon Shon , Prashant Sridhar , Shinji Watanabe

Transformer has achieved competitive performance against state-of-the-art end-to-end models in automatic speech recognition (ASR), and requires significantly less training time than RNN-based models. The original Transformer, with…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-14 Wenyong Huang , Wenchao Hu , Yu Ting Yeung , Xiao Chen

Transformer-based models have gained increasing popularity achieving state-of-the-art performance in many research fields including speech translation. However, Transformer's quadratic complexity with respect to the input sequence length…

Computation and Language · Computer Science 2023-10-19 Sara Papi , Marco Gaido , Matteo Negri , Marco Turchi

Conformer has proven to be effective in many speech processing tasks. It combines the benefits of extracting local dependencies using convolutions and global dependencies using self-attention. Inspired by this, we propose a more flexible,…

Computation and Language · Computer Science 2022-07-08 Yifan Peng , Siddharth Dalmia , Ian Lane , Shinji Watanabe

Optimization of modern ASR architectures is among the highest priority tasks since it saves many computational resources for model training and inference. The work proposes a new Uconv-Conformer architecture based on the standard Conformer…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Andrei Andrusenko , Rauf Nasretdinov , Aleksei Romanenko

In our previous work we demonstrated that a single headed attention encoder-decoder model is able to reach state-of-the-art results in conversational speech recognition. In this paper, we further improve the results for both Switchboard 300…

Computation and Language · Computer Science 2021-05-04 Zoltán Tüske , George Saon , Brian Kingsbury

Spiking Neural Networks have attracted significant attention in recent years due to their distinctive low-power characteristics. Meanwhile, Transformer models, known for their powerful self-attention mechanisms and parallel processing…

Neural and Evolutionary Computing · Computer Science 2024-12-19 Hangming Zhang , Alexander Sboev , Roman Rybka , Qiang Yu

End-to-end models are favored in automatic speech recognition (ASR) because of their simplified system structure and superior performance. Among these models, Transformer and Conformer have achieved state-of-the-art recognition accuracy in…

Sound · Computer Science 2021-06-18 Xiong Wang , Sining Sun , Lei Xie , Long Ma
‹ Prev 1 2 3 10 Next ›