English
Related papers

Related papers: GSB: Group Superposition Binarization for Vision T…

200 papers

Vision transformers (ViTs) have gained popularity recently. Even without customized image operators such as convolutions, ViTs can yield competitive performance when properly trained on massive data. However, the computational overhead of…

Machine Learning · Computer Science 2022-03-17 Shixing Yu , Tianlong Chen , Jiayi Shen , Huan Yuan , Jianchao Tan , Sen Yang , Ji Liu , Zhangyang Wang

Vision transformer (ViT) recently has drawn great attention in computer vision due to its remarkable model capability. However, most prevailing ViT models suffer from huge number of parameters, restricting their applicability on devices…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Kan Wu , Jinnian Zhang , Houwen Peng , Mengchen Liu , Bin Xiao , Jianlong Fu , Lu Yuan

Side-scan sonar (SSS) imagery presents unique challenges in the classification of man-made objects on the seafloor due to the complex and varied underwater environments. Historically, experts have manually interpreted SSS images, relying on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 BW Sheffield , Jeffrey Ellen , Ben Whitmore

Vision transformers (ViTs) have demonstrated great potential in various visual tasks, but suffer from expensive computational and memory cost problems when deployed on resource-constrained devices. In this paper, we introduce a ternary…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Sheng Xu , Yanjing Li , Teli Ma , Bohan Zeng , Baochang Zhang , Peng Gao , Jinhu Lv

Developing lightweight Deep Convolutional Neural Networks (DCNNs) and Vision Transformers (ViTs) has become one of the focuses in vision research since the low computational cost is essential for deploying vision models on edge devices.…

Image and Video Processing · Electrical Eng. & Systems 2022-11-11 Jiehua Zhang , Xueyang Zhang , Zhuo Su , Zitong Yu , Yanghe Feng , Xin Lu , Matti Pietikäinen , Li Liu

Vision Transformers (ViTs) have delivered remarkable progress through global self-attention, yet their quadratic complexity can become prohibitive for high-resolution inputs. In this work, we present ViT-Linearizer, a cross-architecture…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Guoyizhe Wei , Rama Chellappa

The most recent year has witnessed the success of applying the Vision Transformer (ViT) for image classification. However, there are still evidences indicating that ViT often suffers following two aspects, i) the high computation and the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Xian Wei , Bin Wang , Mingsong Chen , Ji Yuan , Hai Lan , Jiehuang Shi , Xuan Tang , Bo Jin , Guozhang Chen , Dongping Yang

In Natural Language Processing (NLP), Transformers have already revolutionized the field by utilizing an attention-based encoder-decoder model. Recently, some pioneering works have employed Transformer-like architectures in Computer Vision…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Gousia Habib , Tausifa Jan Saleem , Brejesh Lall

The ubiquity of vision transformers (ViTs) for various edge applications, including personalized learning, has created the demand for on-device fine-tuning. However, training with the limited memory and computation power of edge devices…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Sreetama Sarkar , Souvik Kundu , Kai Zheng , Peter A. Beerel

Recently, Vision Transformers (ViTs) have shown competitive performance on image recognition while requiring less vision-specific inductive biases. In this paper, we investigate if such performance can be extended to image generation. To…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Kwonjoon Lee , Huiwen Chang , Lu Jiang , Han Zhang , Zhuowen Tu , Ce Liu

Vision Transformers (ViTs) are built by stacking independently parameterized blocks, but it remains unclear how much of this depth requires layer specific transformations and how much can be realized through recurrent computation. We study…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Michal Byra , Pawel Olszowiec , Grzegorz Stefanski , Grzegorz Gruszczynski , Alberto Presta

Recently, vision transformers (ViTs) have superseded convolutional neural networks in numerous applications, including classification, detection, and segmentation. However, the high computational requirements of ViTs hinder their widespread…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Jemin Lee , Yongin Kwon , Sihyeong Park , Misun Yu , Jeman Park , Hwanjun Song

The large pre-trained vision transformers (ViTs) have demonstrated remarkable performance on various visual tasks, but suffer from expensive computational and memory cost problems when deployed on resource-constrained devices. Among the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Yanjing Li , Sheng Xu , Baochang Zhang , Xianbin Cao , Peng Gao , Guodong Guo

Vision Transformer (ViT) has emerged as a powerful architecture in the realm of modern computer vision. However, its application in certain imaging fields, such as microscopy and satellite imaging, presents unique challenges. In these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yujia Bao , Srinivasan Sivanandan , Theofanis Karaletsos

Motivated by the huge success of Transformers in the field of natural language processing (NLP), Vision Transformers (ViTs) have been rapidly developed and achieved remarkable performance in various computer vision tasks. However, their…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Huihong Shi , Haikuo Shao , Wendong Mao , Zhongfeng Wang

Although deep learning models have had great success in natural language processing and computer vision, we do not observe comparable improvements in the case of tabular data, which is still the most common data type used in biological,…

Machine Learning · Computer Science 2025-04-28 Witold Wydmański , Ulvi Movsum-zada , Jacek Tabor , Marek Śmieja

Vision Transformers (ViT) have been shown to attain highly competitive performance for a wide range of vision applications, such as image classification, object detection and semantic image segmentation. In comparison to convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Andreas Steiner , Alexander Kolesnikov , Xiaohua Zhai , Ross Wightman , Jakob Uszkoreit , Lucas Beyer

Binary neural networks (BNNs), where both weights and activations are binarized into 1 bit, have been widely studied in recent years due to its great benefit of highly accelerated computation and substantially reduced memory footprint that…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Zhuo Su , Linpu Fang , Deke Guo , Dewen Hu , Matti Pietikäinen , Li Liu

Standard deep learning models such as convolutional neural networks (CNNs) lack the ability of generalizing to domains which have not been seen during training. This problem is mainly due to the common but often wrong assumption of such…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Gustavo A. Vargas Hakim , David Osowiechi , Ismail Ben Ayed , Christian Desrosiers

Recently, plain vision Transformers (ViTs) have shown impressive performance on various computer vision tasks, thanks to their strong modeling capacity and large-scale pretraining. However, they have not yet conquered the problem of image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Jingfeng Yao , Xinggang Wang , Shusheng Yang , Baoyuan Wang