English
Related papers

Related papers: A Comparative Survey of Vision Transformers for Fe…

200 papers

Vision Transformer (ViT) has demonstrated significant potential in various vision tasks due to its strong ability in modelling long-range dependencies. However, such success is largely fueled by training on massive samples. In real…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Bowei Zhang , Yi Zhang

In the last decade, convolutional neural networks (ConvNets) have dominated and achieved state-of-the-art performances in a variety of medical imaging applications. However, the performances of ConvNets are still limited by lacking the…

Image and Video Processing · Electrical Eng. & Systems 2021-04-15 Junyu Chen , Yufan He , Eric C. Frey , Ye Li , Yong Du

Vision Transformers (ViT) have marked a paradigm shift in computer vision, outperforming state-of-the-art models across diverse tasks. However, their practical deployment is hampered by high computational and memory demands. This study…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Feiyang Chen , Ziqian Luo , Lisang Zhou , Xueting Pan , Ying Jiang

Vision Transformers (ViTs) have demonstrated state-of-the-art performance on many Computer Vision Tasks. Unfortunately, deploying these large-scale ViTs is resource-consuming and impossible for many mobile devices. While most in the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Nahid Alam , Steven Kolawole , Simardeep Sethi , Nishant Bansali , Karina Nguyen

Extracting robust feature representation is critical for object re-identification to accurately identify objects across non-overlapping cameras. Although having a strong representation ability, the Vision Transformer (ViT) tends to overfit…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Lei Tan , Pingyang Dai , Jie Chen , Liujuan Cao , Yongjian Wu , Rongrong Ji

Vision transformers have emerged as a promising alternative to convolutional neural networks for various image analysis tasks, offering comparable or superior performance. However, one significant drawback of ViTs is their…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Kaixin Xu , Zhe Wang , Chunyun Chen , Xue Geng , Jie Lin , Mohamed M. Sabry Aly , Xulei Yang , Min Wu , Xiaoli Li , Weisi Lin

Pretraining Vision Transformers (ViTs) has achieved great success in visual recognition. A following scenario is to adapt a ViT to various image and video recognition tasks. The adaptation is challenging because of heavy computation and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Shoufa Chen , Chongjian Ge , Zhan Tong , Jiangliu Wang , Yibing Song , Jue Wang , Ping Luo

Vision transformer (ViT) is an attention neural network architecture that is shown to be effective for computer vision tasks. However, compared to ResNet-18 with a similar number of parameters, ViT has a significantly lower evaluation…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Haoran Zhu , Boyuan Chen , Carter Yang

This paper discusses four facets of the Knowledge Distillation (KD) process for Convolutional Neural Networks (CNNs) and Vision Transformer (ViT) architectures, particularly when executed on edge devices with constrained processing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 John Violos , Symeon Papadopoulos , Ioannis Kompatsiaris

Skin cancer is a common and fast rising malignancy worldwide. Early detection is critical for improving outcomes. Deep learning models trained on dermoscopic and clinical images can support automated and fast triage. However, many studies…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Durjoy Dey , Yuhong Yan , Hassan Hajjdiab

Although convolutional neural networks (CNNs) showed remarkable results in many vision tasks, they are still strained by simple yet challenging visual reasoning problems. Inspired by the recent success of the Transformer network in computer…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Nicola Messina , Giuseppe Amato , Fabio Carrara , Claudio Gennaro , Fabrizio Falchi

Vision transformers (ViTs) process input images as sequences of patches via self-attention; a radically different architecture than convolutional neural networks (CNNs). This makes it interesting to study the adversarial feature space of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Muzammal Naseer , Kanchana Ranasinghe , Salman Khan , Fahad Shahbaz Khan , Fatih Porikli

Vision Transformers (ViTs) have proven to be effective, in solving 2D image understanding tasks by training over large-scale image datasets; and meanwhile as a somehow separate track, in modeling the 3D visual world too such as voxels or…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yi Wang , Zhiwen Fan , Tianlong Chen , Hehe Fan , Zhangyang Wang

Vision transformers (ViTs) have significantly changed the computer vision landscape and have periodically exhibited superior performance in vision tasks compared to convolutional neural networks (CNNs). Although the jury is still out on…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Ariel N. Lee , Sarah Adel Bargal , Janavi Kasera , Stan Sclaroff , Kate Saenko , Nataniel Ruiz

Vision transformers (ViTs) are usually considered to be less light-weight than convolutional neural networks (CNNs) due to the lack of inductive bias. Recent works thus resort to convolutions as a plug-and-play module and embed them in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Tao Huang , Lang Huang , Shan You , Fei Wang , Chen Qian , Chang Xu

This study explores human action recognition using a three-class subset of the COCO image corpus, benchmarking models from simple fully connected networks to transformer architectures. The binary Vision Transformer (ViT) achieved 90% mean…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 MingZe Tang , Madiha Kazi

This paper presents a study on improving human action recognition through the utilization of knowledge distillation, and the combination of CNN and ViT models. The research aims to enhance the performance and efficiency of smaller student…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Hamid Ahmadabadi , Omid Nejati Manzari , Ahmad Ayatollahi

The Transformer architecture has gained significant popularity in computer vision tasks due to its capacity to generalize and capture long-range dependencies. This characteristic makes it well-suited for generating spatiotemporal tokens…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Rachid Reda Dokkar , Faten Chaieb , Hassen Drira , Arezki Aberkane

The vision transformer (ViT) has advanced to the cutting edge in the visual recognition task. Transformers are more robust than CNN, according to the latest research. ViT's self-attention mechanism, according to the claim, makes it more…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Salman Rahman , Wonkwon Lee

Weak gravitational lensing is a powerful probe of the universe's growth history. While traditional two-point statistics capture only the Gaussian features of the convergence field, deep learning methods such as convolutional neural networks…

Cosmology and Nongalactic Astrophysics · Physics 2025-12-09 Jash Kakadia , Shubh Agrawal , Kunhao Zhong , Bhuvnesh Jain