中文
相关论文

相关论文: Intra-task Mutual Attention based Vision Transform…

200 篇论文

Self-attention-based vision transformers (ViTs) have emerged as a highly competitive architecture in computer vision. Unlike convolutional neural networks (CNNs), ViTs are capable of global information sharing. With the development of…

计算机视觉与模式识别 · 计算机科学 2023-09-25 Zhenzhen Chu , Jiayu Chen , Cen Chen , Chengyu Wang , Ziheng Wu , Jun Huang , Weining Qian

Vision Transformers (ViT) have shown their competitive advantages performance-wise compared to convolutional neural networks (CNNs) though they often come with high computational costs. To this end, previous methods explore different…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Cong Wei , Brendan Duke , Ruowei Jiang , Parham Aarabi , Graham W. Taylor , Florian Shkurti

Few-shot classification aims to recognize unlabeled samples from unseen classes given only few labeled samples. The unseen classes and low-data problem make few-shot classification very challenging. Many existing approaches extracted…

计算机视觉与模式识别 · 计算机科学 2019-10-18 Ruibing Hou , Hong Chang , Bingpeng Ma , Shiguang Shan , Xilin Chen

The advent of Vision Transformers (ViTs) marks a substantial paradigm shift in the realm of computer vision. ViTs capture the global information of images through self-attention modules, which perform dot product computations among…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Shuoxi Zhang , Hanpeng Liu , Stephen Lin , Kun He

Few-shot classification aims to recognize unseen classes with few labeled samples from each class. Many meta-learning models for few-shot classification elaborately design various task-shared inductive bias (meta-knowledge) to solve such…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Haoqing Wang , Zhi-Hong Deng

Few-shot learning (FSL) aims to learn a classifier that can be easily adapted to accommodate new tasks not seen during training, given only a few examples. To handle the limited-data problem in few-shot regimes, recent methods tend to…

计算机视觉与模式识别 · 计算机科学 2022-03-21 Yang Liu , Weifeng Zhang , Chao Xiang , Tu Zheng , Deng Cai , Xiaofei He

Metric-based meta-learning techniques have successfully been applied to few-shot classification problems. In this paper, we propose to leverage cross-modal information to enhance metric-based few-shot learning methods. Visual and semantic…

机器学习 · 计算机科学 2020-02-19 Chen Xing , Negar Rostamzadeh , Boris N. Oreshkin , Pedro O. Pinheiro

Vision Transformers (ViTs) take all the image patches as tokens and construct multi-head self-attention (MHSA) among them. Complete leverage of these image tokens brings redundant computations since not all the tokens are attentive in MHSA.…

计算机视觉与模式识别 · 计算机科学 2022-04-15 Youwei Liang , Chongjian Ge , Zhan Tong , Yibing Song , Jue Wang , Pengtao Xie

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu

Few-shot learning (FSL) has attracted considerable attention recently. Among existing approaches, the metric-based method aims to train an embedding network that can make similar samples close while dissimilar samples as far as possible and…

计算机视觉与模式识别 · 计算机科学 2022-10-13 Bin Xiao , Chien-Liang Liu , Wen-Hoar Hsaio

Since their inception, Vision Transformers (ViTs) have emerged as a compelling alternative to Convolutional Neural Networks (CNNs) across a wide spectrum of tasks. ViTs exhibit notable characteristics, including global attention, resilience…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Hanan Gani , Nada Saadi , Noor Hussein , Karthik Nandakumar

Multimodal few-shot learning is challenging due to the large domain gap between vision and language modalities. Existing methods are trying to communicate visual concepts as prompts to frozen language models, but rely on hand-engineered…

计算机视觉与模式识别 · 计算机科学 2023-03-01 Ivona Najdenkoska , Xiantong Zhen , Marcel Worring

The existing contrastive learning methods widely adopt one-hot instance discrimination as pretext task for self-supervised learning, which inevitably neglects rich inter-instance similarities among natural images, then leading to potential…

计算机视觉与模式识别 · 计算机科学 2023-06-30 Chengchao Shen , Dawei Liu , Hao Tang , Zhe Qu , Jianxin Wang

We introduce Mixture-based Feature Space Learning (MixtFSL) for obtaining a rich and robust feature representation in the context of few-shot image classification. Previous works have proposed to model each base class either with a single…

计算机视觉与模式识别 · 计算机科学 2021-08-18 Arman Afrasiyabi , Jean-François Lalonde , Christian Gagné

Transformer has been applied in the field of computer vision due to its excellent performance in natural language processing, surpassing traditional convolutional neural networks and achieving new state-of-the-art. ViT divides an image into…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Yuang Liu , Zhiheng Qiu , Xiaokai Qin

Few-shot segmentation aims to segment unseen-class objects given only a handful of densely labeled samples. Prototype learning, where the support feature yields a singleor several prototypes by averaging global and local object information,…

计算机视觉与模式识别 · 计算机科学 2022-06-22 Ehtesham Iqbal , Sirojbek Safarov , Seongdeok Bang

Few-shot learning allows machines to classify novel classes using only a few labeled samples. Recently, few-shot segmentation aiming at semantic segmentation on low sample data has also seen great interest. In this paper, we propose a…

计算机视觉与模式识别 · 计算机科学 2022-02-17 Jun Seo , Young-Hyun Park , Sung Whan Yoon , Jaekyun Moon

Recently, plain vision Transformers (ViTs) have shown impressive performance on various computer vision tasks, thanks to their strong modeling capacity and large-scale pretraining. However, they have not yet conquered the problem of image…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Jingfeng Yao , Xinggang Wang , Shusheng Yang , Baoyuan Wang

Current few-shot action recognition involves two primary sources of information for classification:(1) intra-video information, determined by frame content within a single video clip, and (2) inter-video information, measured by…

计算机视觉与模式识别 · 计算机科学 2023-05-11 Huabin Liu , Weiyao Lin , Tieyuan Chen , Yuxi Li , Shuyuan Li , John See

Vision transformers (ViTs) have found only limited practical use in processing images, in spite of their state-of-the-art accuracy on certain benchmarks. The reason for their limited use include their need for larger training datasets and…

计算机视觉与模式识别 · 计算机科学 2022-01-26 Pranav Jeevan , Amit sethi