English
Related papers

Related papers: Quasar-ViT: Hardware-Oriented Quantization-Aware A…

200 papers

Vision Transformers (ViTs) have recently garnered considerable attention, emerging as a promising alternative to convolutional neural networks (CNNs) in several vision-related applications. However, their large model sizes and high…

Machine Learning · Computer Science 2024-05-02 Dayou Du , Gu Gong , Xiaowen Chu

Vision transformers (ViTs) are emerging with significantly improved accuracy in computer vision tasks. However, their complex architecture and enormous computation/storage demand impose urgent needs for new hardware accelerator design…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Zhengang Li , Mengshu Sun , Alec Lu , Haoyu Ma , Geng Yuan , Yanyue Xie , Hao Tang , Yanyu Li , Miriam Leeser , Zhangyang Wang , Xue Lin , Zhenman Fang

The large pre-trained vision transformers (ViTs) have demonstrated remarkable performance on various visual tasks, but suffer from expensive computational and memory cost problems when deployed on resource-constrained devices. Among the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Yanjing Li , Sheng Xu , Baochang Zhang , Xianbin Cao , Peng Gao , Guodong Guo

Vision transformers (ViTs) inherited the success of NLP but their structures have not been sufficiently investigated and optimized for visual tasks. One of the simplest solutions is to directly search the optimal one via the widely used…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Xiu Su , Shan You , Jiyang Xie , Mingkai Zheng , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Although Vision Transformers (ViTs) have achieved significant success, their intensive computations and substantial memory overheads challenge their deployment on edge devices. To address this, efficient ViTs have emerged, typically…

Hardware Architecture · Computer Science 2024-10-15 Yanbiao Liang , Huihong Shi , Zhongfeng Wang

Vision Transformers (ViTs) leverage the transformer architecture to effectively capture global context, demonstrating strong performance in computer vision tasks. A major challenge in ViT hardware acceleration is that the model family…

Hardware Architecture · Computer Science 2025-06-17 Can Xiao , Jianyi Cheng , Aaron Zhao

Vision Transformer (ViT) architectures are becoming increasingly popular and widely employed to tackle computer vision applications. Their main feature is the capacity to extract global information through the self-attention mechanism,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Lorenzo Papa , Paolo Russo , Irene Amerini , Luping Zhou

Vision Transformers (ViTs) have achieved significant success in computer vision. However, their intensive computations and massive memory footprint challenge ViTs' deployment on embedded devices, calling for efficient ViTs. Among them,…

Hardware Architecture · Computer Science 2024-04-01 Haikuo Shao , Huihong Shi , Wendong Mao , Zhongfeng Wang

With the success of Vision Transformers (ViTs) in computer vision tasks, recent arts try to optimize the performance and complexity of ViTs to enable efficient deployment on mobile devices. Multiple approaches are proposed to accelerate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yanyu Li , Ju Hu , Yang Wen , Georgios Evangelidis , Kamyar Salahi , Yanzhi Wang , Sergey Tulyakov , Jian Ren

Vision Transformer (ViT)-based models have shown state-of-the-art performance (e.g., accuracy) in vision-based AI tasks. However, realizing their capability in resource-constrained embedded AI systems is challenging due to their inherent…

Neural and Evolutionary Computing · Computer Science 2026-01-06 Rachmad Vidya Wicaksana Putra , Saad Iftikhar , Muhammad Shafique

Vision Transformers (ViTs) have underpinned the recent breakthroughs in computer vision. However, designing the architectures of ViTs is laborious and heavily relies on expert knowledge. To automate the design process and incorporate…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Jing Liu , Jianfei Cai , Bohan Zhuang

Vision Transformers (ViTs) represent a groundbreaking shift in machine learning approaches to computer vision. Unlike traditional approaches, ViTs employ the self-attention mechanism, which has been widely used in natural language…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Mohammad Erfan Sadeghi , Arash Fayyazi , Suhas Somashekar , Armin Abdollahi , Massoud Pedram

The transformer architectures with attention mechanisms have obtained success in Nature Language Processing (NLP), and Vision Transformers (ViTs) have recently extended the application domains to various vision tasks. While achieving high…

Machine Learning · Computer Science 2022-02-21 Mengshu Sun , Haoyu Ma , Guoliang Kang , Yifan Jiang , Tianlong Chen , Xiaolong Ma , Zhangyang Wang , Yanzhi Wang

Vision Transformer (ViT) demonstrates that Transformer for natural language processing can be applied to computer vision tasks and result in comparable performance to convolutional neural networks (CNN), which have been studied and adopted…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yi-Lun Liao , Sertac Karaman , Vivienne Sze

We revisit the existing excellent Transformers from the perspective of practical application. Most of them are not even as efficient as the basic ResNets series and deviate from the realistic deployment scenario. It may be due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Xin Xia , Jiashi Li , Jie Wu , Xing Wang , Xuefeng Xiao , Min Zheng , Rui Wang

Vision Transformer models, such as ViT, Swin Transformer, and Transformer-in-Transformer, have recently gained significant traction in computer vision tasks due to their ability to capture the global relation between features which leads to…

Hardware Architecture · Computer Science 2023-09-13 Shashank Nag , Gourav Datta , Souvik Kundu , Nitin Chandrachoodan , Peter A. Beerel

In recent years, vision transformers (ViTs) have emerged as powerful and promising techniques for computer vision tasks such as image classification, object detection, and segmentation. Unlike convolutional neural networks (CNNs), which…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shaibal Saha , Lanyu Xu

Vision transformer (ViT) and its variants have swept through visual learning leaderboards and offer state-of-the-art accuracy in tasks such as image classification, object detection, and semantic segmentation by attending to different parts…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Eric Youn , Sai Mitheran J , Sanjana Prabhu , Siyuan Chen

Vision transformers (ViTs) have found only limited practical use in processing images, in spite of their state-of-the-art accuracy on certain benchmarks. The reason for their limited use include their need for larger training datasets and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-26 Pranav Jeevan , Amit sethi

While vision transformers (ViTs) have continuously achieved new milestones in the field of computer vision, their sophisticated network architectures with high computation and memory costs have impeded their deployment on resource-limited…

Hardware Architecture · Computer Science 2023-02-28 Peiyan Dong , Mengshu Sun , Alec Lu , Yanyue Xie , Kenneth Liu , Zhenglun Kong , Xin Meng , Zhengang Li , Xue Lin , Zhenman Fang , Yanzhi Wang
‹ Prev 1 2 3 10 Next ›