English
Related papers

Related papers: Lightweight Vision Transformer with Bidirectional …

200 papers

In recent year, tremendous strides have been made in face detection thanks to deep learning. However, most published face detectors deteriorate dramatically as the faces become smaller. In this paper, we present the Small Faces Attention…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Shi Luo , Xiongfei Li , Rui Zhu , Xiaoli Zhang

Transformers have become one of the dominant architectures in deep learning, particularly as a powerful alternative to convolutional neural networks (CNNs) in computer vision. However, Transformer training and inference in previous works…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Zizheng Pan , Bohan Zhuang , Haoyu He , Jing Liu , Jianfei Cai

Recently, Transformer-based architecture has been introduced into single image deraining task due to its advantage in modeling non-local information. However, existing approaches tend to integrate global features based on a dense…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Zhentao Fan , Hongming Chen , Yufeng Li

Pretraining Vision Transformers (ViTs) has achieved great success in visual recognition. A following scenario is to adapt a ViT to various image and video recognition tasks. The adaptation is challenging because of heavy computation and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Shoufa Chen , Chongjian Ge , Zhan Tong , Jiangliu Wang , Yibing Song , Jue Wang , Ping Luo

Source-free domain adaptation (SFDA) involves training a model on source domain and then applying it to a related target domain without access to the source data and labels during adaptation. The complexity of scene information and lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Renrong Shao , Wei Zhang , Jun Wang

The versatility of self-attention mechanism earned transformers great success in almost all data modalities, with limitations on the quadratic complexity and difficulty of training. Efficient transformers, on the other hand, often rely on…

Machine Learning · Computer Science 2024-08-20 Minh Lenhat , Viet Anh Nguyen , Khoa Nguyen , Duong Duc Hieu , Dao Huu Hung , Truong Son Hy

Adversarial training (AT) can help improve the robustness of Vision Transformers (ViT) against adversarial attacks by intentionally injecting adversarial examples into the training data. However, this way of adversarial injection inevitably…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fudong Lin , Jiadong Lou , Xu Yuan , Nian-Feng Tzeng

Vision transformers have achieved encouraging progress in various computer vision tasks. A common belief is that this is attributed to the capability of self-attention in modeling the global dependencies among feature tokens. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Yulong Shi , Mingwei Sun , Yongshuai Wang , Zengqiang Chen

In recent years, transformer-based methods have achieved remarkable progress in medical image segmentation due to their superior ability to capture long-range dependencies. However, these methods typically suffer from two major limitations.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zunhui Xia , Hongxing Li , Libin Lan

While Transformer architecture excel at modeling long-range dependencies contributing to its widespread adoption in vision tasks the quadratic complexity of softmax-based attention mechanisms imposes a major bottleneck, particularly when…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yuan Cao , Dong Wang

We present a novel method that extends the self-attention mechanism of a vision transformer (ViT) for more accurate object detection across diverse datasets. ViTs show strong capability for image understanding tasks such as object…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Tan Nguyen , Coy D. Heldermon , Corey Toler-Franklin

Deep learning technology has made great progress in multi-view 3D reconstruction tasks. At present, most mainstream solutions establish the mapping between views and shape of an object by assembling the networks of 2D encoder and 3D decoder…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Zhenwei Zhu , Liying Yang , Xuxin Lin , Chaohao Jiang , Ning Li , Lin Yang , Yanyan Liang

Vision Transformers (ViTs) have shown significant promise in computer vision applications. However, their performance in few-shot learning is limited by challenges in refining token-level interactions, struggling with limited training data,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Mohammed Al-Habib , Zuping Zhang , Abdulrahman Noman

Vision transformer (ViT) has been widely applied in many areas due to its self-attention mechanism that help obtain the global receptive field since the first layer. It even achieves surprising performance exceeding CNN in some vision…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Hanting Li , Mingzhe Sui , Zhaoqing Zhu , Feng Zhao

Transformers and Mamba, initially invented for natural language processing, have inspired backbone architectures for visual recognition. Recent studies integrated Local Attention Transformers with Mamba to capture both local details and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Meng Lou , Yunxiang Fu , Yizhou Yu

Lightweight retinal vessel segmentation is important for the early diagnosis of vision-threatening and systemic diseases, especially in a real-world clinical environment with limited computational resources. Although segmentation methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Mehwish Mehmood , Ivor Spence , Muhammad Fahim

Transformers have achieved success in both language and vision domains. However, it is prohibitively expensive to scale them to long sequences such as long documents or high-resolution images, because self-attention mechanism has quadratic…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Chen Zhu , Wei Ping , Chaowei Xiao , Mohammad Shoeybi , Tom Goldstein , Anima Anandkumar , Bryan Catanzaro

Vision Transformers (ViTs) have recently taken computer vision by storm. However, the softmax attention underlying ViTs comes with a quadratic complexity in time and memory, hindering the application of ViTs to high-resolution images. We…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Chuanyang Zheng

Vision Transformer (ViT) has recently gained significant attention in solving computer vision (CV) problems due to its capability of extracting informative features and modeling long-range dependencies through the attention mechanism.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yao Qiang , Chengyin Li , Prashant Khanduri , Dongxiao Zhu

Relying entirely on an attention mechanism, the Transformer introduced by Vaswani et al. (2017) achieves state-of-the-art results for machine translation. In contrast to recurrent and convolutional neural networks, it does not explicitly…

Computation and Language · Computer Science 2018-04-16 Peter Shaw , Jakob Uszkoreit , Ashish Vaswani