English
Related papers

Related papers: TurboViT: Generating Fast Vision Transformers via …

200 papers

The recent explosive interest on transformers has suggested their potential to become powerful "universal" models for computer vision tasks, such as classification, detection, and segmentation. While those attempts mainly study the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Yifan Jiang , Shiyu Chang , Zhangyang Wang

Vision Transformers (ViTs) have recently become the state-of-the-art across many computer vision tasks. In contrast to convolutional networks (CNNs), ViTs enable global information sharing even within shallow layers of a network, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Jongwoo Park , Kumara Kahatapitiya , Donghyun Kim , Shivchander Sudalairaj , Quanfu Fan , Michael S. Ryoo

Vision Transformers (ViTs) have demonstrated strong potential in medical imaging; however, their high computational demands and tendency to overfit on small datasets limit their applicability in real-world clinical scenarios. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Aon Safdar , Mohamed Saadeldin

The transformer model has gained widespread adoption in computer vision tasks in recent times. However, due to the quadratic time and memory complexity of self-attention, which is proportional to the number of input tokens, most existing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Wei Tan , Yifeng Geng , Xuansong Xie

The paper proposes an efficient structure for enhancing the performance of mobile-friendly vision transformer with small computational overhead. The vision transformer (ViT) is very attractive in that it reaches outperforming results in…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Gyeongdong Yang , Yungwook Kwon , Hyunjin Kim

Wide-parameter-space searches for continuous gravitational waves using semi-coherent matched-filter methods require enormous computing power, which limits their achievable sensitivity. Here we explore an alternative search method based on…

General Relativity and Quantum Cosmology · Physics 2026-01-22 Prasanna. M. Joshi , Reinhard Prix

Vision Transformer (ViT) architectures are becoming increasingly popular and widely employed to tackle computer vision applications. Their main feature is the capacity to extract global information through the self-attention mechanism,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Lorenzo Papa , Paolo Russo , Irene Amerini , Luping Zhou

High-resolution images enable neural networks to learn richer visual representations. However, this improved performance comes at the cost of growing computational complexity, hindering their usage in latency-sensitive applications. As not…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Xuanyao Chen , Zhijian Liu , Haotian Tang , Li Yi , Hang Zhao , Song Han

Vision transformers have shown great success due to their high model capabilities. However, their remarkable performance is accompanied by heavy computation costs, which makes them unsuitable for real-time applications. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Xinyu Liu , Houwen Peng , Ningxin Zheng , Yuqing Yang , Han Hu , Yixuan Yuan

Vision Transformers (ViT) have emerged as the de-facto choice for numerous industry grade vision solutions. But their inference cost can be prohibitive for many settings, as they compute self-attention in each layer which suffers from…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Rajat Koner , Gagan Jain , Prateek Jain , Volker Tresp , Sujoy Paul

Many mission-critical systems are based on GPU for inference. It requires not only high recognition accuracy but also low latency in responding time. Although many studies are devoted to optimizing the structure of deep models for efficient…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Ming Lin , Hesen Chen , Xiuyu Sun , Qi Qian , Hao Li , Rong Jin

Vision Transformers have witnessed prevailing success in a series of vision tasks. However, these Transformers often rely on extensive computational costs to achieve high performance, which is burdensome to deploy on resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Wei Li , Xing Wang , Xin Xia , Jie Wu , Jiashi Li , Xuefeng Xiao , Min Zheng , Shiping Wen

Transformers exhibit great advantages in handling computer vision tasks. They model image classification tasks by utilizing a multi-head attention mechanism to process a series of patches consisting of split images. However, for complex…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Haichao Zhang , Kuangrong Hao , Witold Pedrycz , Lei Gao , Xuesong Tang , Bing Wei

Neural Architecture Search (NAS) has shown promising performance in the automatic design of vision transformers (ViT) exceeding 1G FLOPs. However, designing lightweight and low-latency ViT models for diverse mobile devices remains a big…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Chen Tang , Li Lyna Zhang , Huiqiang Jiang , Jiahang Xu , Ting Cao , Quanlu Zhang , Yuqing Yang , Zhi Wang , Mao Yang

Recently, Vision Transformer (ViT) has achieved remarkable success in several computer vision tasks. The progresses are highly relevant to the architecture design, then it is worthwhile to propose Transformer Architecture Search (TAS) to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Qinqin Zhou , Kekai Sheng , Xiawu Zheng , Ke Li , Xing Sun , Yonghong Tian , Jie Chen , Rongrong Ji

The efficient, automated search for well-performing neural architectures (NAS) has drawn increasing attention in the recent past. Thereby, the predominant research objective is to reduce the necessity of costly evaluations of neural…

Machine Learning · Computer Science 2022-08-02 Jovita Lukasik , Steffen Jung , Margret Keuper

Vision Transformers (ViT) have shown rapid progress in computer vision tasks, achieving promising results on various benchmarks. However, due to the massive number of parameters and model design, \textit{e.g.}, attention mechanism,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Yanyu Li , Geng Yuan , Yang Wen , Ju Hu , Georgios Evangelidis , Sergey Tulyakov , Yanzhi Wang , Jian Ren

Transformers have recently gained significant attention in the computer vision community. However, the lack of scalability of self-attention mechanisms with respect to image size has limited their wide adoption in state-of-the-art vision…

Computer Vision and Pattern Recognition · Computer Science 2022-09-12 Zhengzhong Tu , Hossein Talebi , Han Zhang , Feng Yang , Peyman Milanfar , Alan Bovik , Yinxiao Li

Learning efficient and expressive visual representation has long been the pursuit of computer vision research. While Vision Transformers (ViTs) gradually replace traditional Convolutional Neural Networks (CNNs) as more scalable vision…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Quan Kong , Yanru Xiao , Yuhao Shen , Cong Wang

This paper presents the Large Vision Diffusion Transformer (LaVin-DiT), a scalable and unified foundation model designed to tackle over 20 computer vision tasks in a generative framework. Unlike existing large vision models directly adapted…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Zhaoqing Wang , Xiaobo Xia , Runnan Chen , Dongdong Yu , Changhu Wang , Mingming Gong , Tongliang Liu