English
Related papers

Related papers: Unified Visual Transformer Compression

200 papers

Vision Transformers (ViTs) have emerged as powerful models in the field of computer vision, delivering superior performance across various vision tasks. However, the high computational complexity poses a significant barrier to their…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Xinjian Wu , Fanhu Zeng , Xiudong Wang , Xinghao Chen

Vision transformers (ViTs) have recently received explosive popularity, but their enormous model sizes and training costs remain daunting. Conventional post-training pruning often incurs higher training budgets. In contrast, this paper aims…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Tianlong Chen , Yu Cheng , Zhe Gan , Lu Yuan , Lei Zhang , Zhangyang Wang

Although vision transformers (ViTs) have shown promising results in various computer vision tasks recently, their high computational cost limits their practical applications. Previous approaches that prune redundant tokens have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Siyuan Wei , Tianzhu Ye , Shen Zhang , Yao Tang , Jiajun Liang

Vision Transformers (ViTs) have emerged as the fundamental architecture for most computer vision fields, but the considerable memory and computation costs hinders their application on resource-limited devices. As one of the most powerful…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Junrui Xiao , Zhikai Li , Lianwei Yang , Qingyi Gu

Vision transformers (ViTs) have recently obtained success in many applications, but their intensive computation and heavy memory usage at both training and inference time limit their generalization. Previous compression algorithms usually…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Zhenglun Kong , Haoyu Ma , Geng Yuan , Mengshu Sun , Yanyue Xie , Peiyan Dong , Xin Meng , Xuan Shen , Hao Tang , Minghai Qin , Tianlong Chen , Xiaolong Ma , Xiaohui Xie , Zhangyang Wang , Yanzhi Wang

Token compression techniques have recently emerged as powerful tools for accelerating Vision Transformer (ViT) inference in computer vision. Due to the quadratic computational complexity with respect to the token sequence length, these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Phat Nguyen , Ngai-Man Cheung

Vision Transformer (ViT) has achieved impressive results across various vision tasks, yet its high computational cost limits practical applications. Recent methods have aimed to reduce ViT's $O(n^2)$ complexity by pruning unimportant…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Yi-Kuan Hsieh , Jun-Wei Hsieh , Xin Li , Yu-Ming Chang , Yu-Chee Tseng

Vision Transformers (ViT)s have recently become popular due to their outstanding modeling capabilities, in particular for capturing long-range information, and scalability to dataset and model sizes which has led to state-of-the-art…

Image and Video Processing · Electrical Eng. & Systems 2022-04-06 Ali Hatamizadeh , Ziyue Xu , Dong Yang , Wenqi Li , Holger Roth , Daguang Xu

Vision transformers have been widely explored in various vision tasks. Due to heavy computational cost, much interest has aroused for compressing vision transformer dynamically in the aspect of tokens. Current methods mainly pay attention…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Fanhu Zeng , Deli Yu , Zhenglun Kong , Hao Tang

Vision transformers (ViTs) have been successfully applied in image classification tasks recently. In this paper, we show that, unlike convolution neural networks (CNNs)that can be improved by stacking more convolutional layers, the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Daquan Zhou , Bingyi Kang , Xiaojie Jin , Linjie Yang , Xiaochen Lian , Zihang Jiang , Qibin Hou , Jiashi Feng

The recently proposed Vision transformers (ViTs) have shown very impressive empirical performance in various computer vision tasks, and they are viewed as an important type of foundation model. However, ViTs are typically constructed with…

Artificial Intelligence · Computer Science 2023-02-08 Miao Yin , Burak Uzkent , Yilin Shen , Hongxia Jin , Bo Yuan

Multi-scale Vision Transformer (ViT) has emerged as a powerful backbone for computer vision tasks, while the self-attention computation in Transformer scales quadratically w.r.t. the input patch number. Thus, existing solutions commonly…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Ting Yao , Yingwei Pan , Yehao Li , Chong-Wah Ngo , Tao Mei

With the rapid development of computer vision, Vision Transformers (ViTs) offer the tantalising prospect of unified information processing across visual and textual domains due to the lack of inherent inductive biases in ViTs. ViTs require…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Gousia Habib , Tausifa Jan Saleem , Ishfaq Ahmad Malik , Brejesh Lall

Vision transformers have emerged as a promising alternative to convolutional neural networks for various image analysis tasks, offering comparable or superior performance. However, one significant drawback of ViTs is their…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Kaixin Xu , Zhe Wang , Chunyun Chen , Xue Geng , Jie Lin , Mohamed M. Sabry Aly , Xulei Yang , Min Wu , Xiaoli Li , Weisi Lin

Since its inception, Vision Transformer (ViT) has emerged as a prevalent model in the computer vision domain. Nonetheless, the multi-head self-attention (MHSA) mechanism in ViT is computationally expensive due to its calculation of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Zhe Bian , Zhe Wang , Wenqiang Han , Kangping Wang

Vision Transformers (ViTs) deliver state-of-the-art accuracy but their quadratic attention cost and redundant computations severely hinder deployment on latency and resource-constrained platforms. Existing pruning approaches treat either…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Mohammad Helal Uddin , Liam Seymour , Sabur Baidya

In the past few years, transformers have achieved promising performances on various computer vision tasks. Unfortunately, the immense inference overhead of most existing vision transformers withholds their from being deployed on edge…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Zhiwei Hao , Jianyuan Guo , Ding Jia , Kai Han , Yehui Tang , Chao Zhang , Han Hu , Yunhe Wang

Vision transformer (ViT) and its variants have swept through visual learning leaderboards and offer state-of-the-art accuracy in tasks such as image classification, object detection, and semantic segmentation by attending to different parts…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Eric Youn , Sai Mitheran J , Sanjana Prabhu , Siyuan Chen

Vision Transformers (ViT) have emerged as the de-facto choice for numerous industry grade vision solutions. But their inference cost can be prohibitive for many settings, as they compute self-attention in each layer which suffers from…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Rajat Koner , Gagan Jain , Prateek Jain , Volker Tresp , Sujoy Paul

Vision Transformers (ViTs) have demonstrated strong performance across a wide range of vision tasks, yet their substantial computational and memory demands hinder efficient deployment on resource-constrained mobile and edge devices. Pruning…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Zhibo Wang , Zuoyuan Zhang , Xiaoyi Pang , Qile Zhang , Xuanyi Hao , Shuguo Zhuo , Peng Sun