English
Related papers

Related papers: Model Quantization and Hardware Acceleration for V…

200 papers

Vision transformers (ViTs) have become the popular structures and outperformed convolutional neural networks (CNNs) on various vision tasks. However, such powerful transformers bring a huge computation burden, because of the exhausting…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Zhuofan Zong , Kunchang Li , Guanglu Song , Yali Wang , Yu Qiao , Biao Leng , Yu Liu

Learning efficient and expressive visual representation has long been the pursuit of computer vision research. While Vision Transformers (ViTs) gradually replace traditional Convolutional Neural Networks (CNNs) as more scalable vision…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Quan Kong , Yanru Xiao , Yuhao Shen , Cong Wang

Vision Transformers (ViTs) have emerged as powerful models in the field of computer vision, delivering superior performance across various vision tasks. However, the high computational complexity poses a significant barrier to their…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Xinjian Wu , Fanhu Zeng , Xiudong Wang , Xinghao Chen

Vision Transformers (ViTs) have recently become the state-of-the-art across many computer vision tasks. In contrast to convolutional networks (CNNs), ViTs enable global information sharing even within shallow layers of a network, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Jongwoo Park , Kumara Kahatapitiya , Donghyun Kim , Shivchander Sudalairaj , Quanfu Fan , Michael S. Ryoo

Although transformers have become the neural architectures of choice for natural language processing, they require orders of magnitude more training data, GPU memory, and computations in order to compete with convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Pranav Jeevan , Amit Sethi

Standard deep learning models such as convolutional neural networks (CNNs) lack the ability of generalizing to domains which have not been seen during training. This problem is mainly due to the common but often wrong assumption of such…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Gustavo A. Vargas Hakim , David Osowiechi , Ismail Ben Ayed , Christian Desrosiers

Vision Transformers (ViTs) have gained significant attention, but their high computing cost limits the practical applications. While post-training quantization (PTQ) reduces model size and speeds up inference, it often degrades performance,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Lianwei Yang , Haisong Gong , Haokun Lin , Yichen Wu , Zhenan Sun , Qingyi Gu

Recent advances on Vision Transformer (ViT) and its improved variants have shown that self-attention-based networks surpass traditional Convolutional Neural Networks (CNNs) in most vision tasks. However, existing ViTs focus on the standard…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Xiaofeng Mao , Gege Qi , Yuefeng Chen , Xiaodan Li , Ranjie Duan , Shaokai Ye , Yuan He , Hui Xue

Recently, Vision Transformer (ViT) has continuously established new milestones in the computer vision field, while the high computation and memory cost makes its propagation in industrial production difficult. Pruning, a traditional model…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Zhenglun Kong , Peiyan Dong , Xiaolong Ma , Xin Meng , Mengshu Sun , Wei Niu , Xuan Shen , Geng Yuan , Bin Ren , Minghai Qin , Hao Tang , Yanzhi Wang

Vision Transformer (ViT) has performed remarkably in various computer vision tasks. Nonetheless, affected by the massive amount of parameters, ViT usually suffers from serious overfitting problems with a relatively limited number of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Tian Gao , Cheng-Zhong Xu , Le Zhang , Hui Kong

Vision Transformers (ViTs) have emerged with superior performance on computer vision tasks compared to convolutional neural network (CNN)-based models. However, ViTs are mainly designed for image classification that generate single-scale…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Jiaqi Gu , Hyoukjun Kwon , Dilin Wang , Wei Ye , Meng Li , Yu-Hsin Chen , Liangzhen Lai , Vikas Chandra , David Z. Pan

Vision Transformers (ViTs) have achieved strong performance in visual recognition, yet their deployment in resource-constrained industrial environments remains limited. Some main challenges are their high computational cost, memory…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Phat Nguyen , Xue Geng , Kaixin Xu , Wang Zhe , Xulei Yang , Ngai-Man Cheung

Vision Transformers (ViTs) have proven to be effective, in solving 2D image understanding tasks by training over large-scale image datasets; and meanwhile as a somehow separate track, in modeling the 3D visual world too such as voxels or…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yi Wang , Zhiwen Fan , Tianlong Chen , Hehe Fan , Zhangyang Wang

Vision Transformer (ViT) has demonstrated promising performance in computer vision tasks, comparable to state-of-the-art neural networks. Yet, this new type of deep neural network architecture is vulnerable to adversarial attacks limiting…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Shashank Kotyan , Danilo Vasconcellos Vargas

Vision Transformer (ViT), a radically different architecture than convolutional neural networks offers multiple advantages including design simplicity, robustness and state-of-the-art performance on many vision tasks. However, in contrast…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Hanan Gani , Muzammal Naseer , Mohammad Yaqub

Deploying Vision Transformers (ViTs) on near-sensor analog accelerators demands training pipelines that are explicitly aligned with device-level noise and energy constraints. We introduce a compact framework for silicon-photonic execution…

Emerging Technologies · Computer Science 2026-04-07 Xuming Chen , Deniz Najafi , Chengwei Zhou , Pietro Mercati , Arman Roohi , Mohsen Imani , Mahdi Nikdast , Shaahin Angizi , Gourav Datta

Vision Transformers (ViTs) have exhibited exceptional performance across diverse computer vision tasks, while their substantial parameter size incurs significantly increased memory and computational demands, impeding effective inference on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Yanfeng Jiang , Ning Sun , Xueshuo Xie , Fei Yang , Tao Li

We explore the application of Vision Transformer (ViT) for handwritten text recognition. The limited availability of labeled data in this domain poses challenges for achieving high performance solely relying on ViT. Previous…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Yuting Li , Dexiong Chen , Tinglong Tang , Xi Shen

With the advancement of deep learning technologies, specialized neural processing hardware such as Brain Processing Units (BPUs) have emerged as dedicated platforms for CNN acceleration, offering optimized INT8 computation capabilities for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Jinchi Tang , Yan Guo

Vision Transformers (ViTs) have demonstrated superior performance over Convolutional Neural Networks (CNNs) in various vision-related tasks such as classification, object detection, and segmentation due to their use of self-attention…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Fereshteh Baradaran , Mohsen Raji , Azadeh Baradaran , Arezoo Baradaran , Reihaneh Akbarifard