English
Related papers

Related papers: Energy-Efficient Vision Transformer Inference for …

200 papers

Vision transformers have emerged as a promising alternative to convolutional neural networks for various image analysis tasks, offering comparable or superior performance. However, one significant drawback of ViTs is their…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Kaixin Xu , Zhe Wang , Chunyun Chen , Xue Geng , Jie Lin , Mohamed M. Sabry Aly , Xulei Yang , Min Wu , Xiaoli Li , Weisi Lin

Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) have led to significant progress in 2D body pose estimation. However, achieving a good balance between accuracy, efficiency, and robustness remains a challenge. For…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Kaleab A. Kinfu , René Vidal

Transformers have recently demonstrated strong performance in computer vision, with Vision Transformers (ViTs) leveraging self-attention to capture both low-level and high-level image features. However, standard ViTs remain computationally…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Ali El Bellaj , Mohammed-Amine Cheddadi , Rhassan Berber

The transformer model has gained widespread adoption in computer vision tasks in recent times. However, due to the quadratic time and memory complexity of self-attention, which is proportional to the number of input tokens, most existing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Wei Tan , Yifeng Geng , Xuansong Xie

Vision transformers (ViTs) have recently obtained success in many applications, but their intensive computation and heavy memory usage at both training and inference time limit their generalization. Previous compression algorithms usually…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Zhenglun Kong , Haoyu Ma , Geng Yuan , Mengshu Sun , Yanyue Xie , Peiyan Dong , Xin Meng , Xuan Shen , Hao Tang , Minghai Qin , Tianlong Chen , Xiaolong Ma , Xiaohui Xie , Zhangyang Wang , Yanzhi Wang

Recently, Vision Transformer (ViT) has achieved promising performance in image recognition and gradually serves as a powerful backbone in various vision tasks. To satisfy the sequential input of Transformer, the tail of ViT first splits…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yunke Wang , Bo Du , Wenyuan Wang , Chang Xu

Existing computer vision research in categorization struggles with fine-grained attributes recognition due to the inherently high intra-class variances and low inter-class variances. SOTA methods tackle this challenge by locating the most…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Marcos V. Conde , Kerem Turgutlu

Recent state-of-the-art performances of Vision Transformers (ViT) in computer vision tasks demonstrate that a general-purpose architecture, which implements long-range self-attention, could replace the local feature learning operations of…

This paper introduces an efficient Vision-Language Model (VLM) pipeline specifically optimized for deployment on embedded devices, such as those used in robotics and autonomous driving. The pipeline significantly reduces the computational…

Machine Learning · Computer Science 2025-11-04 Jin Huang , Yuchao Jin , Le An , Josh Park

Diffusion Transformers (DiT) have established a new state-of-the-art in high-fidelity image synthesis; however, their massive computational complexity and memory requirements hinder local deployment on resource-constrained edge devices. In…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Sravanth Kodavanti , Manjunath Arveti , Sowmya Vajrala , Srinivas Miriyala , Vikram N R

In computer vision, Single Image Super-Resolution (SISR) is still a difficult problem. We present ViT-SR, a new technique to improve the performance of a Vision Transformer (ViT) employing a two-stage training strategy. In our method, the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Aditya Chaudhary , Prachet Dev Singh , Ankit Jha

Face Image Quality Assessment (FIQA) aims to predict the utility of a face image for face recognition (FR) systems. State-of-the-art FIQA methods mainly rely on convolutional neural networks (CNNs), leaving the potential of Vision…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Andrea Atzori , Fadi Boutros , Naser Damer

Vision Transformers (ViTs) have demonstrated impressive performance across a range of applications, including many safety-critical tasks. However, their unique architectural properties raise new challenges and opportunities in adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Jiani Liu , Zhiyuan Wang , Zeliang Zhang , Chao Huang , Susan Liang , Yunlong Tang , Chenliang Xu

Vision transformers have recently made a breakthrough in computer vision showing excellent performance in terms of precision for numerous applications. However, their computational cost is very high compared to alternative approaches such…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Martial Guidez , Stefan Duffner , Christophe Garcia

Vision Transformers (ViTs) take all the image patches as tokens and construct multi-head self-attention (MHSA) among them. Complete leverage of these image tokens brings redundant computations since not all the tokens are attentive in MHSA.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Youwei Liang , Chongjian Ge , Zhan Tong , Yibing Song , Jue Wang , Pengtao Xie

Transformer has been applied in the field of computer vision due to its excellent performance in natural language processing, surpassing traditional convolutional neural networks and achieving new state-of-the-art. ViT divides an image into…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yuang Liu , Zhiheng Qiu , Xiaokai Qin

Diffusion models with their powerful expressivity and high sample quality have achieved State-Of-The-Art (SOTA) performance in the generative domain. The pioneering Vision Transformer (ViT) has also demonstrated strong modeling capabilities…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Ali Hatamizadeh , Jiaming Song , Guilin Liu , Jan Kautz , Arash Vahdat

While Convolutional Neural Networks (CNNs) have been widely successful in 2D human pose estimation, Vision Transformers (ViTs) have emerged as a promising alternative to CNNs, boosting state-of-the-art performance. However, the quadratic…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Kaleab A. Kinfu , Rene Vidal

Vision transformers (ViTs) have dominated computer vision in recent years. However, ViTs are computationally expensive and not well suited for mobile devices; this led to the prevalence of convolutional neural network (CNN) and ViT-based…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Mustafa Munir , Md Mostafijur Rahman , Radu Marculescu

Crack segmentation on edge devices can support continuous infrastructure monitoring and maintenance and thereby help to preserve public safety. Furthermore, autonomous infrastructure monitoring by using Unmanned Aerial Vehicles (UAVs) can…

Signal Processing · Electrical Eng. & Systems 2026-05-07 Matthias Tschope , Mohamed Moursi , Vladimir Rybalkin , Bo Zhou , Norbert Wehn , Paul Lukowicz