English
Related papers

Related papers: Transformed CNNs: recasting pre-trained convolutio…

200 papers

Vision transformers (ViTs) have significantly changed the computer vision landscape and have periodically exhibited superior performance in vision tasks compared to convolutional neural networks (CNNs). Although the jury is still out on…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Ariel N. Lee , Sarah Adel Bargal , Janavi Kasera , Stan Sclaroff , Kate Saenko , Nataniel Ruiz

The hybrid of Convolutional Neural Network (CNN) and Vision Transformers (ViT) architectures has emerged as a groundbreaking approach, pushing the boundaries of computer vision (CV). This comprehensive review provides a thorough examination…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Haruna Yunusa , Shiyin Qin , Abdulrahman Hamman Adama Chukkol , Abdulganiyu Abdu Yusuf , Isah Bello , Adamu Lawan

Recent advances of Transformers have brought new trust to computer vision tasks. However, on small dataset, Transformers is hard to train and has lower performance than convolutional neural networks. We make vision transformers as…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Bin Chen , Ran Wang , Di Ming , Xin Feng

Since being introduced in 2020, Vision Transformers (ViT) has been steadily breaking the record for many vision tasks and are often described as ``all-you-need" to replace ConvNet. Despite that, ViTs are generally computational,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Chuong H. Nguyen , Su Huynh , Vinh Nguyen , Ngoc Nguyen

Model binarization has made significant progress in enabling real-time and energy-efficient computation for convolutional neural networks (CNN), offering a potential solution to the deployment challenges faced by Vision Transformers (ViTs)…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Tian Gao , Zhiyuan Zhang , Yu Zhang , Huajun Liu , Kaijie Yin , Chengzhong Xu , Hui Kong

The Vision Transformer (ViT) leverages the Transformer's encoder to capture global information by dividing images into patches and achieves superior performance across various computer vision tasks. However, the self-attention mechanism of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Tianxiao Zhang , Wenju Xu , Bo Luo , Guanghui Wang

The transformer models have shown promising effectiveness in dealing with various vision tasks. However, compared with training Convolutional Neural Network (CNN) models, training Vision Transformer (ViT) models is more difficult and relies…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Jiawang Bai , Li Yuan , Shu-Tao Xia , Shuicheng Yan , Zhifeng Li , Wei Liu

Convolutional neural networks (CNNs) evaluate short-range correlations in input images which progress along the layers, whereas vision transformer (ViT) architectures evaluate long-range correlations, using repeated transformer encoders…

Machine Learning · Computer Science 2025-04-10 Ella Koresh , Ronit D. Gross , Yuval Meir , Yarden Tzach , Tal Halevi , Ido Kanter

Can a lightweight Vision Transformer (ViT) match or exceed the performance of Convolutional Neural Networks (CNNs) like ResNet on small datasets with small image resolutions? This report demonstrates that a pure ViT can indeed achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Jen Hong Tan

The hybrid architecture of convolution neural networks (CNN) and Transformer has been the most popular method for medical image segmentation. However, the existing networks based on the hybrid architecture suffer from two problems. First,…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Rui Sun , Tao Lei , Weichuan Zhang , Yong Wan , Yong Xia , Asoke K. Nandi

Vision Transformers (ViTs) have achieved comparable or superior performance than Convolutional Neural Networks (CNNs) in computer vision. This empirical breakthrough is even more remarkable since, in contrast to CNNs, ViTs do not embed any…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Samy Jelassi , Michael E. Sander , Yuanzhi Li

Extracting robust feature representation is critical for object re-identification to accurately identify objects across non-overlapping cameras. Although having a strong representation ability, the Vision Transformer (ViT) tends to overfit…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Lei Tan , Pingyang Dai , Jie Chen , Liujuan Cao , Yongjian Wu , Rongrong Ji

Vision Transformers have excelled in computer vision but their attention mechanisms operate independently across layers, limiting information flow and feature learning. We propose an effective cross-layer attention propagation method that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Swarnendu Banik , Manish Das , Shiv Ram Dubey , Satish Kumar Singh

With the increasing popularity and the increasing size of vision transformers (ViTs), there has been an increasing interest in making them more efficient and less computationally costly for deployment on edge devices with limited computing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Phuoc-Hoan Charles Le , Xinlin Li

Vision Transformer (ViT), a radically different architecture than convolutional neural networks offers multiple advantages including design simplicity, robustness and state-of-the-art performance on many vision tasks. However, in contrast…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Hanan Gani , Muzammal Naseer , Mohammad Yaqub

Vision Transformer (ViT) extends the application range of transformers from language processing to computer vision tasks as being an alternative architecture against the existing convolutional neural networks (CNN). Since the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Byeongho Heo , Sangdoo Yun , Dongyoon Han , Sanghyuk Chun , Junsuk Choe , Seong Joon Oh

Vision transformers have been successfully applied to image recognition tasks due to their ability to capture long-range dependencies within an image. However, there are still gaps in both performance and computational cost between…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Jianyuan Guo , Kai Han , Han Wu , Yehui Tang , Xinghao Chen , Yunhe Wang , Chang Xu

Recently, the Vision Transformer (ViT) model has replaced the classical Convolutional Neural Network (ConvNet) in various computer vision tasks due to its superior performance. Even in hyperspectral image (HSI) classification field,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Haizhao Jing , Liuwei Wan , Xizhe Xue , Haokui Zhang , Ying Li

Vision Transformers (ViTs) are increasingly utilized in various computer vision tasks due to their powerful representation capabilities. However, it remains understudied how ViTs process information layer by layer. Numerous studies have…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Teresa Dorszewski , Lenka Tětková , Robert Jenssen , Lars Kai Hansen , Kristoffer Knutsen Wickstrøm

While models derived from Vision Transformers (ViTs) have been phonemically surging, pre-trained models cannot seamlessly adapt to arbitrary resolution images without altering the architecture and configuration, such as sampling the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Song Zhang , Qingzhong Wang , Jiang Bian , Haoyi Xiong
‹ Prev 1 3 4 5 6 7 10 Next ›