English
Related papers

Related papers: Feature Fusion Vision Transformer for Fine-Grained…

200 papers

Change detection in remote sensing images is essential for tracking environmental changes on the Earth's surface. Despite the success of vision transformers (ViTs) as backbones in numerous computer vision applications, they remain…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Duowang Zhu , Xiaohu Huang , Haiyan Huang , Zhenfeng Shao , Qimin Cheng

Vision transformers have shown great success on numerous computer vision tasks. However, its central component, softmax attention, prohibits vision transformers from scaling up to high-resolution images, due to both the computational…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Weixuan Sun , Zhen Qin , Hui Deng , Jianyuan Wang , Yi Zhang , Kaihao Zhang , Nick Barnes , Stan Birchfield , Lingpeng Kong , Yiran Zhong

Vision Transformers (ViTs) are built on the assumption of treating image patches as ``visual tokens" and learn patch-to-patch attention. The patch embedding based tokenizer has a semantic gap with respect to its counterpart, the textual…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Ryan Grainger , Thomas Paniagua , Xi Song , Naresh Cuntoor , Mun Wai Lee , Tianfu Wu

One critical challenge in 6D object pose estimation from a single RGBD image is efficient integration of two different modalities, i.e., color and depth. In this work, we tackle this problem by a novel Deep Fusion Transformer~(DFTr) block…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Jun Zhou , Kai Chen , Linlin Xu , Qi Dou , Jing Qin

Features play a crucial role in computer vision. Initially designed to detect salient elements by means of handcrafted algorithms, features are now often learned by different layers in Convolutional Neural Networks (CNNs). This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Loris Nanni , Stefano Ghidoni , Sheryl Brahnam

Learning to recognize novel visual categories from a few examples is a challenging task for machines in real-world industrial applications. In contrast, humans have the ability to discriminate even similar objects with little supervision.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Xin Sun , Hongwei Xv , Junyu Dong , Qiong Li , Changrui Chen

The computational expense of redundant vision tokens in Large Vision-Language Models (LVLMs) has led many existing methods to compress them via a vision projector. However, this compression may lose visual information that is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Ze Feng , Jiang-jiang Liu , Sen Yang , Lingyu Xiao , Zhibin Quan , Zhenhua Feng , Wankou Yang , Jingdong Wang

Multi-focus is a technique of focusing on different aspects of a particular object or scene. Wireless Visual Sensor Networks (WVSN) use multi-focus image fusion, which combines two or more images to create a more accurate output image that…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Krishnendu K. S.

The challenges of high intra-class variance yet low inter-class fluctuations in fine-grained visual categorization are more severe with few labeled samples, \textit{i.e.,} Fine-Grained categorization problems under the Few-Shot setting…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Huaxi Huang , Junjie Zhang , Jian Zhang , Qiang Wu , Chang Xu

Recent state-of-the-art performances of Vision Transformers (ViT) in computer vision tasks demonstrate that a general-purpose architecture, which implements long-range self-attention, could replace the local feature learning operations of…

Transformer has been very successful in various computer vision tasks and understanding the working mechanism of transformer is important. As touchstones, weakly-supervised semantic segmentation (WSSS) and class activation map (CAM) are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Lianghui Zhu , Yingyue Li , Jiemin Fang , Yan Liu , Hao Xin , Wenyu Liu , Xinggang Wang

This work addresses the task of weakly-supervised object localization. The goal is to learn object localization using only image-level class labels, which are much easier to obtain compared to bounding box annotations. This task is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 David Kim , Sinhae Cha , Byeongkeun Kang

Vision transformers (ViTs) have been trending in image classification tasks due to their promising performance when compared to convolutional neural networks (CNNs). As a result, many researchers have tried to incorporate ViTs in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Swalpa Kumar Roy , Ankur Deria , Danfeng Hong , Behnood Rasti , Antonio Plaza , Jocelyn Chanussot

Over the past few years, a significant progress has been made in deep convolutional neural networks (CNNs)-based image recognition. This is mainly due to the strong ability of such networks in mining discriminative object pose and parts…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Asish Bera , Zachary Wharton , Yonghuai Liu , Nik Bessis , Ardhendu Behera

The fully convolutional network (FCN) has dominated salient object detection for a long period. However, the locality of CNN requires the model deep enough to have a global receptive field and such a deep model always leads to the loss of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Sucheng Ren , Qiang Wen , Nanxuan Zhao , Guoqiang Han , Shengfeng He

Exploring and mining subtle yet distinctive features between sub-categories with similar appearances is crucial for fine-grained visual categorization (FGVC). However, less effort has been devoted to assessing the quality of extracted…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Qin Xu , Sitong Li , Jiahui Wang , Bo Jiang , Jinhui Tang

Multi-scale Vision Transformer (ViT) has emerged as a powerful backbone for computer vision tasks, while the self-attention computation in Transformer scales quadratically w.r.t. the input patch number. Thus, existing solutions commonly…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Ting Yao , Yingwei Pan , Yehao Li , Chong-Wah Ngo , Tao Mei

Convolutional Neural Networks (CNNs), architectures consisting of convolutional layers, have been the standard choice in vision tasks. Recent studies have shown that Vision Transformers (VTs), architectures based on self-attention modules,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Kishaan Jeeveswaran , Senthilkumar Kathiresan , Arnav Varma , Omar Magdy , Bahram Zonooz , Elahe Arani

Recent advances on Vision Transformer (ViT) and its improved variants have shown that self-attention-based networks surpass traditional Convolutional Neural Networks (CNNs) in most vision tasks. However, existing ViTs focus on the standard…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Xiaofeng Mao , Gege Qi , Yuefeng Chen , Xiaodan Li , Ranjie Duan , Shaokai Ye , Yuan He , Hui Xue

Transformers are popular neural network models that use layers of self-attention and fully-connected nodes with embedded tokens. Vision Transformers (ViT) adapt transformers for image recognition tasks. In order to do this, the images are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Brian Kenji Iwana , Akihiro Kusuda