English
Related papers

Related papers: On Vision Transformers for Classification Tasks in…

200 papers

In this paper, we aim to redesign the vision Transformer (ViT) as a new backbone to realize semantic image transmission, termed wireless image transmission transformer (WITT). Previous works build upon convolutional neural networks (CNNs),…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Ke Yang , Sixian Wang , Jincheng Dai , Kailin Tan , Kai Niu , Ping Zhang

Vision transformers (ViTs) encoding an image as a sequence of patches bring new paradigms for semantic segmentation.We present an efficient framework of representation separation in local-patch level and global-region level for semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Yuanduo Hong , Huihui Pan , Weichao Sun , Xinghu Yu , Huijun Gao

Deep learning technology can be used as an assistive technology to help doctors quickly and accurately identify COVID-19 infections. Recently, Vision Transformer (ViT) has shown great potential towards image classification due to its global…

Image and Video Processing · Electrical Eng. & Systems 2022-07-06 Hongyan Xu , Xiu Su , Dadong Wang

In recent years, Transformers have achieved remarkable progress in computer vision tasks. However, their global modeling often comes with substantial computational overhead, in stark contrast to the human eye's efficient information…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Yuguang Zhang , Qihang Fan , Huaibo Huang

Transformers, which are popular for language modeling, have been explored for solving vision tasks recently, e.g., the Vision Transformer (ViT) for image classification. The ViT model splits each image into a sequence of tokens with fixed…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Li Yuan , Yunpeng Chen , Tao Wang , Weihao Yu , Yujun Shi , Zihang Jiang , Francis EH Tay , Jiashi Feng , Shuicheng Yan

The Vision Transformer (ViT) leverages the Transformer's encoder to capture global information by dividing images into patches and achieves superior performance across various computer vision tasks. However, the self-attention mechanism of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Tianxiao Zhang , Wenju Xu , Bo Luo , Guanghui Wang

The detection and analysis of transient astronomical sources is of great importance to understand their time evolution. Traditional pipelines identify transient sources from difference (D) images derived by subtracting prior-observed…

Instrumentation and Methods for Astrophysics · Physics 2023-09-19 Zhuoyang Chen , Wenjie Zhou , Guoyou Sun , Mi Zhang , Jiangao Ruan , Jingyuan Zhao

Vision transformers (ViTs) have been trending in image classification tasks due to their promising performance when compared to convolutional neural networks (CNNs). As a result, many researchers have tried to incorporate ViTs in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Swalpa Kumar Roy , Ankur Deria , Danfeng Hong , Behnood Rasti , Antonio Plaza , Jocelyn Chanussot

As deep learning models increasingly find applications in critical domains such as medical imaging, the need for transparent and trustworthy decision-making becomes paramount. Many explainability methods provide insights into how these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Piotr Komorowski , Hubert Baniecki , Przemysław Biecek

Vision transformers (ViTs) inherited the success of NLP but their structures have not been sufficiently investigated and optimized for visual tasks. One of the simplest solutions is to directly search the optimal one via the widely used…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Xiu Su , Shan You , Jiyang Xie , Mingkai Zheng , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Recently, the Vision Transformer (ViT), which applied the transformer structure to the image classification task, has outperformed convolutional neural networks. However, the high performance of the ViT results from pre-training using a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Seung Hoon Lee , Seunghyun Lee , Byung Cheol Song

This paper proposes a working recipe of using Vision Transformer (ViT) in class incremental learning. Although this recipe only combines existing techniques, developing the combination is not trivial. Firstly, naive application of ViT to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Pei Yu , Yinpeng Chen , Ying Jin , Zicheng Liu

Deep models based on vision transformer (ViT) and convolutional neural network (CNN) have demonstrated remarkable performance on natural datasets. However, these models may not be similar in medical imaging, where abnormal regions cover…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Ahmad Chaddad , Yihang Wu , Xianrui Chen

Vision transformers have become popular as a possible substitute to convolutional neural networks (CNNs) for a variety of computer vision applications. These transformers, with their ability to focus on global relationships in images, offer…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Asifullah Khan , Zunaira Rauf , Anabia Sohail , Abdul Rehman , Hifsa Asif , Aqsa Asif , Umair Farooq

Recently, vision Transformers (ViTs) are developing rapidly and starting to challenge the domination of convolutional neural networks (CNNs) in the realm of computer vision (CV). With the general-purpose Transformer architecture replacing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Haofei Zhang , Jiarui Duan , Mengqi Xue , Jie Song , Li Sun , Mingli Song

Following the success in advancing natural language processing and understanding, transformers are expected to bring revolutionary changes to computer vision. This work provides a comprehensive study on the robustness of vision transformers…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Rulin Shao , Zhouxing Shi , Jinfeng Yi , Pin-Yu Chen , Cho-Jui Hsieh

Vision transformers (ViTs) have recently demonstrated state-of-the-art performance in a variety of vision tasks, replacing convolutional neural networks (CNNs). Meanwhile, since ViT has a different architecture than CNN, it may behave…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Bum Jun Kim , Hyeyeon Choi , Hyeonah Jang , Dong Gu Lee , Wonseok Jeong , Sang Woo Kim

The seabed characterization from sonar images is a very hard task because of the produced data and the unknown environment, even for an human expert. In this work we propose an original approach in order to combine binary classifiers…

Artificial Intelligence · Computer Science 2008-12-18 Arnaud Martin , Isabelle Quidu

Self-attention-based vision transformers (ViTs) have emerged as a highly competitive architecture in computer vision. Unlike convolutional neural networks (CNNs), ViTs are capable of global information sharing. With the development of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Zhenzhen Chu , Jiayu Chen , Cen Chen , Chengyu Wang , Ziheng Wu , Jun Huang , Weining Qian

Plant phenology-the study of recurrent life cycle events-is essential for understanding ecosystem dynamics and their responses to climate change impacts. While Unmanned Aerial Vehicles (UAVs) and near-surface cameras enable high-resolution…