English
Related papers

Related papers: Nested-TNT: Hierarchical Vision Transformers with …

200 papers

Humans see low spatial frequency components before high spatial frequency components. Drawing on this neuroscientific inspiration, we investigate the effect of introducing patches from different spatial frequencies into Vision Transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Yuyang Shu , Michael E. Bain

Vision transformers (ViTs) have been trending in image classification tasks due to their promising performance when compared to convolutional neural networks (CNNs). As a result, many researchers have tried to incorporate ViTs in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Swalpa Kumar Roy , Ankur Deria , Danfeng Hong , Behnood Rasti , Antonio Plaza , Jocelyn Chanussot

Vision Transformers (ViTs) have redefined image classification by leveraging self-attention to capture complex patterns and long-range dependencies between image patches. However, a key challenge for ViTs is efficiently incorporating…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Shravan Venkatraman , Jaskaran Singh Walia , Joe Dhanith P R

Recently, Vision Transformer (ViT) has achieved promising performance in image recognition and gradually serves as a powerful backbone in various vision tasks. To satisfy the sequential input of Transformer, the tail of ViT first splits…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yunke Wang , Bo Du , Wenyuan Wang , Chang Xu

Vision transformers (ViTs) encoding an image as a sequence of patches bring new paradigms for semantic segmentation.We present an efficient framework of representation separation in local-patch level and global-region level for semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Yuanduo Hong , Huihui Pan , Weichao Sun , Xinghu Yu , Huijun Gao

Our review explores the comparative analysis between Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) in the domain of image classification, with a particular focus on clothing classification within the e-commerce sector.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Sonia Bbouzidi , Ghazala Hcini , Imen Jdey , Fadoua Drira

In the evolving landscape of 6G networks, semantic communications are poised to revolutionize data transmission by prioritizing the transmission of semantic meaning over raw data accuracy. This paper presents a Vision Transformer…

Image and Video Processing · Electrical Eng. & Systems 2025-03-24 Muhammad Ahmed Mohsin , Muhammad Jazib , Zeeshan Alam , Muhmmad Farhan Khan , Muhammad Saad , Muhammad Ali Jamshed

Self-attention-based vision transformers (ViTs) have emerged as a highly competitive architecture in computer vision. Unlike convolutional neural networks (CNNs), ViTs are capable of global information sharing. With the development of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Zhenzhen Chu , Jiayu Chen , Cen Chen , Chengyu Wang , Ziheng Wu , Jun Huang , Weining Qian

As Vision Transformers (ViTs) are increasingly adopted in sensitive vision applications, there is a growing demand for improved interpretability. This has led to efforts to forward-align these models with carefully annotated abstract,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Sanchit Sinha , Guangzhi Xiong , Aidong Zhang

Vision Transformers (ViTs) have become prominent models for solving various vision tasks. However, the interpretability of ViTs has not kept pace with their promising performance. While there has been a surge of interest in developing {\it…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Yao Qiang , Chengyin Li , Prashant Khanduri , Dongxiao Zhu

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev

Vision transformers have been applied successfully for image recognition tasks. There have been either multi-headed self-attention based (ViT \cite{dosovitskiy2020image}, DeIT, \cite{touvron2021training}) similar to the original work in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Badri N. Patro , Vinay P. Namboodiri , Vijay Srinivas Agneeswaran

As a de facto solution, the vanilla Vision Transformers (ViTs) are encouraged to model long-range dependencies between arbitrary image patches while the global attended receptive field leads to quadratic computational cost. Another branch…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Jiayu Jiao , Yu-Ming Tang , Kun-Yu Lin , Yipeng Gao , Jinhua Ma , Yaowei Wang , Wei-Shi Zheng

Convolutional neural networks (CNNs) and vision transformers (ViTs) are widely employed for medical image segmentation, but they are still challenged by their intrinsic characteristics. CNNs are limited from capturing varying-scaled…

Image and Video Processing · Electrical Eng. & Systems 2025-11-25 Jin Yang , Daniel S. Marcus , Aristeidis Sotiras

This paper studies a text classification algorithm based on an improved Transformer to improve the performance and efficiency of the model in text classification tasks. Aiming at the shortcomings of the traditional Transformer model in…

Computation and Language · Computer Science 2025-01-24 Jia Gao , Guiran Liu , Binrong Zhu , Shicheng Zhou , Hongye Zheng , Xiaoxuan Liao

Vision Transformer (ViT) has prevailed in computer vision tasks due to its strong long-range dependency modelling ability. \textcolor{blue}{However, its large model size and weak local feature modeling ability hinder its application in real…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Yi Zhang , Lingxiao Wei , Bowei Zhang , Ziwei Liu , Kai Yi , Shu Hu

Vision Transformers (ViT) have recently brought a new wave of research in the field of computer vision. These models have performed particularly well in image classification and segmentation. Research on semantic and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Ashim Dahal , Saydul Akbar Murad , Nick Rahimi

Recent advancements in attention mechanisms have replaced recurrent neural networks and its variants for machine translation tasks. Transformer using attention mechanism solely achieved state-of-the-art results in sequence modeling. Neural…

Computation and Language · Computer Science 2020-04-02 Prakhar Thapak , Prodip Hore

Convolutional neural networks (CNNs) and vision transformers (ViTs) have become essential in computer vision for local and global feature extraction. However, aggregating these architectures in existing methods often results in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Chunlei Meng , Jiacheng Yang , Wei Lin , Bowen Liu , Hongda Zhang , chun ouyang , Zhongxue Gan

The combination of Spiking Neural Networks (SNNs) with Vision Transformer architectures has garnered significant attention due to their potential for energy-efficient and high-performance computing paradigms. However, a substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Wei Hua , Chenlin Zhou , Jibin Wu , Yansong Chua , Yangyang Shu