English
Related papers

Related papers: DeFormer: Decomposing Pre-trained Transformers for…

200 papers

Transformer is a powerful model for text understanding. However, it is inefficient due to its quadratic complexity to input sequence length. Although there are many methods on Transformer acceleration, they are still either inefficient on…

Computation and Language · Computer Science 2021-09-07 Chuhan Wu , Fangzhao Wu , Tao Qi , Yongfeng Huang , Xing Xie

Transformers have revolutionized deep learning in numerous fields, including natural language processing, computer vision, and audio processing. Their strength lies in their attention mechanism, which allows for the discovering of complex…

Machine Learning · Computer Science 2024-04-02 Uladzislau Yorsh , Martin Holeňa , Ondřej Bojar , David Herel

Transformers, renowned for their self-attention mechanism, have achieved state-of-the-art performance across various tasks in natural language processing, computer vision, time-series modeling, etc. However, one of the challenges with deep…

Machine Learning · Computer Science 2024-11-04 Jeongwhan Choi , Hyowon Wi , Jayoung Kim , Yehjin Shin , Kookjin Lee , Nathaniel Trask , Noseong Park

We propose Beat Transformer, a novel Transformer encoder architecture for joint beat and downbeat tracking. Different from previous models that track beats solely based on the spectrogram of an audio mixture, our model deals with demixed…

Sound · Computer Science 2022-09-16 Jingwei Zhao , Gus Xia , Ye Wang

We present a High-Resolution Transformer (HRFormer) that learns high-resolution representations for dense prediction tasks, in contrast to the original Vision Transformer that produces low-resolution representations and has high memory and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Yuhui Yuan , Rao Fu , Lang Huang , Weihong Lin , Chao Zhang , Xilin Chen , Jingdong Wang

Transformers have shown great potential in computer vision tasks. A common belief is their attention-based token mixer module contributes most to their competence. However, recent works show the attention-based module in Transformers can be…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Weihao Yu , Mi Luo , Pan Zhou , Chenyang Si , Yichen Zhou , Xinchao Wang , Jiashi Feng , Shuicheng Yan

It is a challenging task to learn discriminative representation from images and videos, due to large local redundancy and complex global dependency in these visual data. Convolution neural networks (CNNs) and vision transformers (ViTs) have…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Kunchang Li , Yali Wang , Junhao Zhang , Peng Gao , Guanglu Song , Yu Liu , Hongsheng Li , Yu Qiao

Transformers are successfully applied to computer vision due to their powerful modeling capacity with self-attention. However, the excellent performance of transformers heavily depends on enormous training images. Thus, a data-efficient…

Computer Vision and Pattern Recognition · Computer Science 2022-04-29 Xianing Chen , Qiong Cao , Yujie Zhong , Jing Zhang , Shenghua Gao , Dacheng Tao

Transformers have been matching deep convolutional networks for vision architectures in recent works. Most work is focused on getting the best results on large-scale benchmarks, and scaling laws seem to be the most successful strategy:…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Corentin Dancette , Matthieu Cord

Transformer networks have lead to important progress in language modeling and machine translation. These models include two consecutive modules, a feed-forward layer and a self-attention layer. The latter allows the network to capture long…

Machine Learning · Computer Science 2019-07-03 Sainbayar Sukhbaatar , Edouard Grave , Guillaume Lample , Herve Jegou , Armand Joulin

In this paper, we introduce the prior knowledge, multi-scale structure, into self-attention modules. We propose a Multi-Scale Transformer which uses multi-scale multi-head self-attention to capture features from different scales. Based on…

Computation and Language · Computer Science 2019-12-03 Qipeng Guo , Xipeng Qiu , Pengfei Liu , Xiangyang Xue , Zheng Zhang

Pre-trained Transformer language models (LM) have become go-to text representation encoders. Prior research fine-tunes deep LMs to encode text sequences such as sentences and passages into single dense vector representations for efficient…

Computation and Language · Computer Science 2021-09-22 Luyu Gao , Jamie Callan

Large-scale pre-trained language models such as BERT have brought significant improvements to NLP applications. However, they are also notorious for being slow in inference, which makes them difficult to deploy in real-time applications. We…

Computation and Language · Computer Science 2020-04-28 Ji Xin , Raphael Tang , Jaejun Lee , Yaoliang Yu , Jimmy Lin

Existing semantic segmentation works have been mainly focused on designing effective decoders; however, the computational load introduced by the overall structure has long been ignored, which hinders their applications on…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Bo Dong , Pichao Wang , Fan Wang

Recent algebraic analysis shows that in decoder-only and encoder-only transformers, the Query projection $W_Q$ may be set to identity without noticeable performance deterioration. This is possible because attention depends on $X$ only…

Machine Learning · Computer Science 2026-05-27 Marko Karbevski

Improving the efficiency of Transformer-based language pre-training is an important task in NLP, especially for the self-attention module, which is computationally expensive. In this paper, we propose a simple but effective solution, called…

Computation and Language · Computer Science 2021-02-26 Chengxuan Ying , Guolin Ke , Di He , Tie-Yan Liu

Transformer architectures deliver state-of-the-art accuracy via dense full-attention, but their quadratic time and memory complexity with respect to sequence length limits practical deployment. Linear attention mechanisms offer linear or…

Machine Learning · Computer Science 2026-01-21 Xiaojie Xia , Huigang Zhang , Chaoliang Zhong , Jun Sun , Yusuke Oishi

Large Transformer models routinely achieve state-of-the-art results on a number of tasks but training these models can be prohibitively costly, especially on long sequences. We introduce two techniques to improve the efficiency of…

Machine Learning · Computer Science 2020-02-19 Nikita Kitaev , Łukasz Kaiser , Anselm Levskaya

Transformer language models have driven significant progress across various fields, including natural language processing and computer vision. A central component of these models is the self-attention (SA) mechanism, which learns rich…

Machine Learning · Computer Science 2025-05-22 Suvadeep Hajra

Large-scale transformer-based models like the Bidirectional Encoder Representations from Transformers (BERT) are widely used for Natural Language Processing (NLP) applications, wherein these models are initially pre-trained with a large…

Computation and Language · Computer Science 2023-10-09 Mohammad Wali Ur Rahman , Murad Mehrab Abrar , Hunter Gibbons Copening , Salim Hariri , Sicong Shao , Pratik Satam , Soheil Salehi