English
Related papers

Related papers: Optimizer Sensitivity In Vision Transformerbased I…

200 papers

This paper tackles a significant challenge faced by Vision Transformers (ViTs): their constrained scalability across different image resolutions. Typically, ViTs experience a performance decline when processing resolutions different from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Qihang Fan , Quanzeng You , Xiaotian Han , Yongfei Liu , Yunzhe Tao , Huaibo Huang , Ran He , Hongxia Yang

Vision Transformers (ViTs) have emerged as the fundamental architecture for most computer vision fields, but the considerable memory and computation costs hinders their application on resource-limited devices. As one of the most powerful…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Junrui Xiao , Zhikai Li , Lianwei Yang , Qingyi Gu

Biometric authentication is becoming more prevalent for secured authentication systems. However, the biometric substances can be deceived by the imposters in several ways. Among other imposter attacks, print attacks, mask attacks, and…

Cryptography and Security · Computer Science 2023-12-04 Prosenjit Chatterjee , Alex Yalchin , Joseph Shelton , Kaushik Roy , Xiaohong Yuan , Kossi D. Edoh

Biometric face authentication is crucial in computer vision, but ensuring fairness and generalization across demographic groups remains a big challenge. Therefore, we investigated whether Vision Transformer (ViT) and ResNet, leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Abu Sufian , Marco Leo , Cosimo Distante , Anirudha Ghosh , Debaditya Barman

The Vision Transformer (ViT) architecture has become widely recognized in computer vision, leveraging its self-attention mechanism to achieve remarkable success across various tasks. Despite its strengths, ViT's optimization remains…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Haoyu Yun , Hamid Krim

Adversarial training (AT) can help improve the robustness of Vision Transformers (ViT) against adversarial attacks by intentionally injecting adversarial examples into the training data. However, this way of adversarial injection inevitably…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fudong Lin , Jiadong Lou , Xu Yuan , Nian-Feng Tzeng

Iris pattern recognition has significantly improved the biometric authentication field due to its high stability and uniqueness. Such physical characteristics have played an essential role in security and other related areas. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Juan Tapia , Sebastian Gonzalez , Christoph Busch

Biometrics is the science of identifying an individual based on their intrinsic anatomical or behavioural characteristics, such as fingerprints, face, iris, gait, and voice. Iris recognition is one of the most successful methods because it…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Daniel P. Benalcazar , David A. Benalcazar , Andres Valenzuela

The use of vision transformers (ViT) in computer vision is increasing due to limited inductive biases (e.g., locality, weight sharing, etc.) and increased scalability compared to other deep learning methods. This has led to some initial…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Steven A. Grosz , Anil K. Jain

Transformers have recently gained increasing attention in computer vision. However, existing studies mostly use Transformers for feature representation learning, e.g. for image classification and dense predictions, and the generalizability…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Shengcai Liao , Ling Shao

Recent developments in hardware, computer graphics, and AI may soon enable AR/VR head-mounted displays (HMDs) to become everyday devices like smartphones and tablets. Eye trackers within HMDs provide a special opportunity for such setups as…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Mengdi Wang , Efe Bozkir , Enkelejda Kasneci

Biometrics on mobile devices has attracted a lot of attention in recent years as it is considered a user-friendly authentication method. This interest has also been motivated by the success of Deep Learning (DL). Architectures based on…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Paula Delgado-Santos , Ruben Tolosana , Richard Guest , Farzin Deravi , Ruben Vera-Rodriguez

Visual attention mechanisms play a crucial role in human perception and aesthetic evaluation. Recent advances in Vision Transformers (ViTs) have demonstrated remarkable capabilities in computer vision tasks, yet their alignment with human…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Miguel Carrasco , César González-Martín , José Aranda , Luis Oliveros

Personal identification and authentication is very crucial in the current scenario. Biometrics plays an important role in this area. Biometric based authentication has proved superior compared to traditional password based authentication.…

Cryptography and Security · Computer Science 2011-02-19 V. S. Meenakshi , G. Padmavathi

Vision Transformers (ViTs) have become ubiquitous in computer vision. Despite their success, ViTs lack inductive biases, which can make it difficult to train them with limited data. To address this challenge, prior studies suggest training…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Srijan Das , Tanmay Jain , Dominick Reilly , Pranav Balaji , Soumyajit Karmakar , Shyam Marjit , Xiang Li , Abhijit Das , Michael S. Ryoo

Vision Transformer (ViT) self-attention mechanism is characterized by feature collapse in deeper layers, resulting in the vanishing of low-level visual features. However, such features can be helpful to accurately represent and identify…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Anxhelo Diko , Danilo Avola , Marco Cascio , Luigi Cinque

Databases play an important role in cyber world. It provides authenticity across the globe to the legitimate user. Biometrics is another important tool which recognizes humans using their physical statistics. Biometrics system requires…

Computer Science and Game Theory · Computer Science 2012-07-13 Adnan Alam Khan , Safeeullah Soomro , Irfan Hyder

Vision Transformers (ViT) have been shown to attain highly competitive performance for a wide range of vision applications, such as image classification, object detection and semantic image segmentation. In comparison to convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Andreas Steiner , Alexander Kolesnikov , Xiaohua Zhai , Ross Wightman , Jakob Uszkoreit , Lucas Beyer

Neuroimaging of large populations is valuable to identify factors that promote or resist brain disease, and to assist diagnosis, subtyping, and prognosis. Data-driven models such as convolutional neural networks (CNNs) have increasingly…

Image and Video Processing · Electrical Eng. & Systems 2023-03-16 Nikhil J. Dhinagar , Sophia I. Thomopoulos , Emily Laltoo , Paul M. Thompson

Recent advances on Vision Transformer (ViT) and its improved variants have shown that self-attention-based networks surpass traditional Convolutional Neural Networks (CNNs) in most vision tasks. However, existing ViTs focus on the standard…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Xiaofeng Mao , Gege Qi , Yuefeng Chen , Xiaodan Li , Ranjie Duan , Shaokai Ye , Yuan He , Hui Xue