English
Related papers

Related papers: Self-Ensembling Vision Transformer (SEViT) for Rob…

200 papers

Since their inception, Vision Transformers (ViTs) have emerged as a compelling alternative to Convolutional Neural Networks (CNNs) across a wide spectrum of tasks. ViTs exhibit notable characteristics, including global attention, resilience…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Hanan Gani , Nada Saadi , Noor Hussein , Karthik Nandakumar

Vision transformers (ViTs) have recently set off a new wave in neural architecture design thanks to their record-breaking performance in various vision tasks. In parallel, to fulfill the goal of deploying ViTs into real-world vision…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yonggan Fu , Shunyao Zhang , Shang Wu , Cheng Wan , Yingyan Celine Lin

Vision Transformer (ViT) has demonstrated promising performance in computer vision tasks, comparable to state-of-the-art neural networks. Yet, this new type of deep neural network architecture is vulnerable to adversarial attacks limiting…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Shashank Kotyan , Danilo Vasconcellos Vargas

While transformer-based models dominate NLP and vision applications, their underlying mechanisms to map the input space to the label space semantically are not well understood. In this paper, we study the sources of known representation…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Chashi Mahiul Islam , Samuel Jacob Chacko , Mao Nishino , Xiuwen Liu

Recent advances in attention-based networks have shown that Vision Transformers can achieve state-of-the-art or near state-of-the-art results on many image classification tasks. This puts transformers in the unique position of being a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Kaleel Mahmood , Rigel Mahmood , Marten van Dijk

The ability of deep neural networks (DNNs) come from extracting and interpreting features from the data provided. By exploiting intermediate features in DNNs instead of relying on hard labels, we craft adversarial perturbation that…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Shangbo Wu , Yu-an Tan , Ruinan Ma , Wencong Ma , Dehua Zhu , Yuanzhang Li

Transformers are popular neural network models that use layers of self-attention and fully-connected nodes with embedded tokens. Vision Transformers (ViT) adapt transformers for image recognition tasks. In order to do this, the images are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Brian Kenji Iwana , Akihiro Kusuda

Vision Transformers (ViTs) are becoming more popular and dominating technique for various vision tasks, compare to Convolutional Neural Networks (CNNs). As a demanding technique in computer vision, ViTs have been successfully solved various…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Khawar Islam

Despite the remarkable success of Vision Transformers (ViTs) across a wide range of vision tasks, recent studies have revealed that they remain vulnerable to adversarial examples, much like Convolutional Neural Networks (CNNs). A common…

Machine Learning · Computer Science 2026-04-22 Jiaming Zhang , Meng Ding , Shaopeng Fu , Jingfeng Zhang , Di Wang

Semantic segmentation has a broad range of applications in a variety of domains including land coverage analysis, autonomous driving, and medical image analysis. Convolutional neural networks (CNN) and Vision Transformers (ViTs) provide the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Hans Thisanke , Chamli Deshan , Kavindu Chamith , Sachith Seneviratne , Rajith Vidanaarachchi , Damayanthi Herath

Vision Transformers (ViTs) have a radically different architecture with significantly less inductive bias than Convolutional Neural Networks. Along with the improvement in performance, security and robustness of ViTs are also of great…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Khoa D. Doan , Yingjie Lao , Peng Yang , Ping Li

Our review explores the comparative analysis between Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) in the domain of image classification, with a particular focus on clothing classification within the e-commerce sector.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Sonia Bbouzidi , Ghazala Hcini , Imen Jdey , Fadoua Drira

The use of transformers for vision tasks has challenged the traditional dominant role of convolutional neural networks (CNN) in computer vision (CV). For image classification tasks, Vision Transformer (ViT) effectively establishes spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Shihua Sun , Kenechukwu Nwodo , Shridatt Sugrim , Angelos Stavrou , Haining Wang

Vision Transformers (ViTs) have revolutionized computer vision by leveraging self-attention to model long-range dependencies. However, ViTs face challenges such as high computational costs due to the quadratic scaling of self-attention and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Zhoujie Qian

Convolutional Neural Networks (CNNs) have become the de facto gold standard in computer vision applications in the past years. Recently, however, new model architectures have been proposed challenging the status quo. The Vision Transformer…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Philipp Benz , Soomin Ham , Chaoning Zhang , Adil Karjauv , In So Kweon

Label noise in medical image classification datasets significantly hampers the training of supervised deep learning methods, undermining their generalizability. The test performance of a model tends to decrease as the label noise rate…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Bidur Khanal , Prashant Shrestha , Sanskar Amgain , Bishesh Khanal , Binod Bhattarai , Cristian A. Linte

The emergence of vision transformers (ViTs) in image classification has shifted the methodologies for visual representation learning. In particular, ViTs learn visual representation at full receptive field per layer across all the image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Li Zhang , Jiachen Lu , Sixiao Zheng , Xinxuan Zhao , Xiatian Zhu , Yanwei Fu , Tao Xiang , Jianfeng Feng , Philip H. S. Torr

Vision Transformer (ViT) is becoming widely popular in automating accurate disease diagnosis in medical imaging owing to its robust self-attention mechanism. However, ViTs remain vulnerable to adversarial attacks that may thwart the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Neha A S , Vivek Chaturvedi , Muhammad Shafique

Deep learning vision systems are increasingly deployed in safety-critical domains such as healthcare, yet they remain vulnerable to small adversarial patches that can trigger misclassifications. Most existing defenses assume a single patch…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Aja Khanal , Ahmed Faid , Apurva Narayan

With Vision Transformers (ViTs) making great advances in a variety of computer vision tasks, recent literature have proposed various variants of vanilla ViTs to achieve better efficiency and efficacy. However, it remains unclear how their…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Rui Tian , Zuxuan Wu , Qi Dai , Han Hu , Yu-Gang Jiang