English
Related papers

Related papers: Transformers with Joint Tokens and Local-Global At…

200 papers

Our review explores the comparative analysis between Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) in the domain of image classification, with a particular focus on clothing classification within the e-commerce sector.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Sonia Bbouzidi , Ghazala Hcini , Imen Jdey , Fadoua Drira

The emergence of vision transformers (ViTs) in image classification has shifted the methodologies for visual representation learning. In particular, ViTs learn visual representation at full receptive field per layer across all the image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Li Zhang , Jiachen Lu , Sixiao Zheng , Xinxuan Zhao , Xiatian Zhu , Yanwei Fu , Tao Xiang , Jianfeng Feng , Philip H. S. Torr

Following the success in advancing natural language processing and understanding, transformers are expected to bring revolutionary changes to computer vision. This work provides a comprehensive study on the robustness of vision transformers…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Rulin Shao , Zhouxing Shi , Jinfeng Yi , Pin-Yu Chen , Cho-Jui Hsieh

Although Vision Transformers (ViTs) have recently demonstrated superior performance in medical imaging problems, they face explainability issues similar to previous architectures such as convolutional neural networks. Recent research…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Minjae Chung , Jong Bum Won , Ganghyun Kim , Yujin Kim , Utku Ozbulak

Visual Place Recognition (VPR) aims to match a query image to reference images of the same place in a large-scale database. Recent state-of-the-art methods employ Vision Transformers (ViTs) as backbone foundation models to extract…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Zichao Zeng , June Moh Goo , Junwei Zheng , Weijia Fan , Jiaming Zhang , Rainer Stiefelhagen , Jan Boehm

Vision Transformers (ViT)s have recently become popular due to their outstanding modeling capabilities, in particular for capturing long-range information, and scalability to dataset and model sizes which has led to state-of-the-art…

Image and Video Processing · Electrical Eng. & Systems 2022-04-06 Ali Hatamizadeh , Ziyue Xu , Dong Yang , Wenqi Li , Holger Roth , Daguang Xu

With the success of Vision Transformers (ViTs) in computer vision tasks, recent arts try to optimize the performance and complexity of ViTs to enable efficient deployment on mobile devices. Multiple approaches are proposed to accelerate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yanyu Li , Ju Hu , Yang Wen , Georgios Evangelidis , Kamyar Salahi , Yanzhi Wang , Sergey Tulyakov , Jian Ren

General mammal pose estimation is an important and challenging task in computer vision, which is essential for understanding mammal behaviour in real-world applications. However, existing studies are at their preliminary research stage,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Tianyang Xu , Jiyong Rao , Xiaoning Song , Zhenhua Feng , Xiao-Jun Wu

Medical image segmentation plays a crucial role in various healthcare applications, enabling accurate diagnosis, treatment planning, and disease monitoring. Traditionally, convolutional neural networks (CNNs) dominated this domain,…

The groundbreaking performance of transformers in Natural Language Processing (NLP) tasks has led to their replacement of traditional Convolutional Neural Networks (CNNs), owing to the efficiency and accuracy achieved through the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Gousia Habib , Damandeep Singh , Ishfaq Ahmad Malik , Brejesh Lall

This paper addresses the challenge of 3D human pose estimation from a single color image. Despite the general success of the end-to-end learning paradigm, top performing approaches employ a two-step solution consisting of a Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-07-27 Georgios Pavlakos , Xiaowei Zhou , Konstantinos G. Derpanis , Kostas Daniilidis

Vision Transformers (ViTs) is emerging as an alternative to convolutional neural networks (CNNs) for visual recognition. They achieve competitive results with CNNs but the lack of the typical convolutional inductive bias makes them more…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Yun-Hao Cao , Hao Yu , Jianxin Wu

Vision transformers (ViTs) inherited the success of NLP but their structures have not been sufficiently investigated and optimized for visual tasks. One of the simplest solutions is to directly search the optimal one via the widely used…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Xiu Su , Shan You , Jiyang Xie , Mingkai Zheng , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Attention-based vision models, such as Vision Transformer (ViT) and its variants, have shown promising performance in various computer vision tasks. However, these emerging architectures suffer from large model sizes and high computational…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Jinqi Xiao , Miao Yin , Yu Gong , Xiao Zang , Jian Ren , Bo Yuan

The design of more complex and powerful neural network models has significantly advanced the state-of-the-art in visual object tracking. These advances can be attributed to deeper networks, or the introduction of new building blocks, such…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Philippe Blatter , Menelaos Kanakis , Martin Danelljan , Luc Van Gool

Radiographs are a versatile diagnostic tool for the detection and assessment of pathologies, for treatment planning or for navigation and localization purposes in clinical interventions. However, their interpretation and assessment by…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Finn Behrendt , Debayan Bhattacharya , Julia Krüger , Roland Opfer , Alexander Schlaefer

Object pose estimation is important for object manipulation and scene understanding. In order to improve the general applicability of pose estimators, recent research focuses on providing estimates for novel objects, that is objects unseen…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Stefan Thalhammer , Jean-Baptiste Weibel , Markus Vincze , Jose Garcia-Rodriguez

Owing to advancements in deep learning technology, Vision Transformers (ViTs) have demonstrated impressive performance in various computer vision tasks. Nonetheless, ViTs still face some challenges, such as high computational complexity and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yulong Shi , Mingwei Sun , Yongshuai Wang , Jiahao Ma , Zengqiang Chen

In this research, we address the challenge faced by existing deep learning-based human mesh reconstruction methods in balancing accuracy and computational efficiency. These methods typically prioritize accuracy, resulting in large network…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Ayman Ali , Ekkasit Pinyoanuntapong , Pu Wang , Mohsen Dorodchi

The quadratic computational complexity to the number of tokens limits the practical applications of Vision Transformers (ViTs). Several works propose to prune redundant tokens to achieve efficient ViTs. However, these methods generally…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Shuning Chang , Pichao Wang , Ming Lin , Fan Wang , David Junhao Zhang , Rong Jin , Mike Zheng Shou