English
Related papers

Related papers: Bridging the Gap Between Vision Transformers and C…

200 papers

Remote sensing imagery plays a crucial role in many applications and requires accurate computerized classification techniques. Reliable classification is essential for transforming raw imagery into structured and usable information. While…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Niful Islam , Md. Rayhan Ahmed , Nur Mohammad Fahad , Salekul Islam , A. K. M. Muzahidul Islam , Saddam Mukta , Swakkhar Shatabda

Vision Transformers (ViTs) outperforms convolutional neural networks (CNNs) in several vision tasks with its global modeling capabilities. However, ViT lacks the inductive bias inherent to convolution making it require a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Jiawei Mao , Honggu Zhou , Xuesong Yin , Yuanqi Chang. Binling Nie. Rui Xu

Vision Transformer (ViT) has emerged as a prominent architecture for various computer vision tasks. In ViT, we divide the input image into patch tokens and process them through a stack of self attention blocks. However, unlike Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Harsh Rangwani , Pradipto Mondal , Mayank Mishra , Ashish Ramayee Asokan , R. Venkatesh Babu

Vision transformers have attracted much attention from computer vision researchers as they are not restricted to the spatial inductive bias of ConvNets. However, although Transformer-based backbones have achieved much progress on ImageNet…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Hong-Yu Zhou , Chixiang Lu , Sibei Yang , Yizhou Yu

Although certain vision transformer (ViT) and CNN architectures generalize well on vision tasks, it is often impractical to use them on green, edge, or desktop computing due to their computational requirements for training and even testing.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Pranav Jeevan , Amit Sethi

Detecting plant diseases is a crucial aspect of modern agriculture, as it plays a key role in maintaining crop health and increasing overall yield. Traditional approaches, though still valuable, often rely on manual inspection or…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Saber Mehdipour , Seyed Abolghasem Mirroshandel , Seyed Amirhossein Tabatabaei

Recently, vision transformers (ViTs) have superseded convolutional neural networks in numerous applications, including classification, detection, and segmentation. However, the high computational requirements of ViTs hinder their widespread…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Jemin Lee , Yongin Kwon , Sihyeong Park , Misun Yu , Jeman Park , Hwanjun Song

The large pre-trained vision transformers (ViTs) have demonstrated remarkable performance on various visual tasks, but suffer from expensive computational and memory cost problems when deployed on resource-constrained devices. Among the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Yanjing Li , Sheng Xu , Baochang Zhang , Xianbin Cao , Peng Gao , Guodong Guo

Convolutional Neural Networks (CNNs) have dominated computer vision for years, due to its ability in capturing locality and translation invariance. Recently, many vision transformer architectures have been proposed and they show promising…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Pichao Wang , Xue Wang , Fan Wang , Ming Lin , Shuning Chang , Hao Li , Rong Jin

In the recent past, several domain generalization (DG) methods have been proposed, showing encouraging performance, however, almost all of them build on convolutional neural networks (CNNs). There is little to no progress on studying the DG…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Maryam Sultana , Muzammal Naseer , Muhammad Haris Khan , Salman Khan , Fahad Shahbaz Khan

The hybrid architecture of convolution neural networks (CNN) and Transformer has been the most popular method for medical image segmentation. However, the existing networks based on the hybrid architecture suffer from two problems. First,…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Rui Sun , Tao Lei , Weichuan Zhang , Yong Wan , Yong Xia , Asoke K. Nandi

Machine learning researchers strive to develop better and better algorithms to solve computer vision problems, such as image classification. In recent years, the classification of micro-Doppler spectrograms has also benefited from these…

Signal Processing · Electrical Eng. & Systems 2025-12-02 Arkadiusz Czuba

Since their inception, Vision Transformers (ViTs) have emerged as a compelling alternative to Convolutional Neural Networks (CNNs) across a wide spectrum of tasks. ViTs exhibit notable characteristics, including global attention, resilience…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Hanan Gani , Nada Saadi , Noor Hussein , Karthik Nandakumar

Vision Transformers (ViTs) have shown impressive performance but still require a high computation cost as compared to convolutional neural networks (CNNs), one reason is that ViTs' attention measures global similarities and thus has a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Haoran You , Yunyang Xiong , Xiaoliang Dai , Bichen Wu , Peizhao Zhang , Haoqi Fan , Peter Vajda , Yingyan Celine Lin

Vision Transformer (ViT) has achieved remarkable success due to its large-scale pretraining on general domains, but it still faces challenges when applying it to downstream distant domains that have only scarce training data, which gives…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Shuai Yi , Yixiong Zou , Yuhua Li , Ruixuan Li

The recursive quad-tree partitioning in High Efficiency Video Coding (HEVC) incurs considerable computational overhead, with exhaustive rate-distortion optimization for CTU partition prediction consuming the dominant share of encoding time.…

Image and Video Processing · Electrical Eng. & Systems 2026-05-29 Krishna Kumar Sharma , Somdyuti Paul

Vision Transformers (ViTs) have recently garnered considerable attention, emerging as a promising alternative to convolutional neural networks (CNNs) in several vision-related applications. However, their large model sizes and high…

Machine Learning · Computer Science 2024-05-02 Dayou Du , Gu Gong , Xiaowen Chu

Vision Transformer (ViT), as a powerful alternative to Convolutional Neural Network (CNN), has received much attention. Recent work showed that ViTs are also vulnerable to adversarial examples like CNNs. To build robust ViTs, an intuitive…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Boxi Wu , Jindong Gu , Zhifeng Li , Deng Cai , Xiaofei He , Wei Liu

A clear understanding of where humans move in a scenario, their usual paths and speeds, and where they stop, is very important for different applications, such as mobility studies in urban areas or robot navigation tasks within…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Placido Falqueto , Alberto Sanfeliu , Luigi Palopoli , Daniele Fontanelli

Vision Transformers (ViTs) have achieved impressive performance on various vision tasks, yet their generalization under distribution shifts (DS) is rarely understood. In this work, we comprehensively study the out-of-distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Chongzhi Zhang , Mingyuan Zhang , Shanghang Zhang , Daisheng Jin , Qiang Zhou , Zhongang Cai , Haiyu Zhao , Xianglong Liu , Ziwei Liu