English
Related papers

Related papers: Applying ViT in Generalized Few-shot Semantic Segm…

200 papers

Vision Transformer (ViT) has performed remarkably in various computer vision tasks. Nonetheless, affected by the massive amount of parameters, ViT usually suffers from serious overfitting problems with a relatively limited number of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Tian Gao , Cheng-Zhong Xu , Le Zhang , Hui Kong

Recently, vision Transformers (ViTs) have been actively applied to fine-grained visual recognition (FGVR). ViT can effectively model the interdependencies between patch-divided object regions through an inherent self-attention mechanism. In…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Jiyong Moon , Junseok Lee , Yunju Lee , Seongsik Park

Vision transformers (ViT) have shown promise in various vision tasks while the U-Net based on a convolutional neural network (CNN) remains dominant in diffusion models. We design a simple and general ViT-based architecture (named U-ViT) for…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Fan Bao , Shen Nie , Kaiwen Xue , Yue Cao , Chongxuan Li , Hang Su , Jun Zhu

Can a lightweight Vision Transformer (ViT) match or exceed the performance of Convolutional Neural Networks (CNNs) like ResNet on small datasets with small image resolutions? This report demonstrates that a pure ViT can indeed achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Jen Hong Tan

In this work, the case of semantic segmentation on a small image dataset (simulated by 1000 randomly selected images from PASCAL VOC 2012), where only weak supervision signals (scribbles from user interaction) are available is studied.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Ahmadreza Jeddi

The emergence of vision transformers (ViTs) in image classification has shifted the methodologies for visual representation learning. In particular, ViTs learn visual representation at full receptive field per layer across all the image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Li Zhang , Jiachen Lu , Sixiao Zheng , Xinxuan Zhao , Xiatian Zhu , Yanwei Fu , Tao Xiang , Jianfeng Feng , Philip H. S. Torr

Few-shot class-incremental learning (FSCIL) has recently attracted extensive attention in various areas. Existing FSCIL methods highly depend on the robustness of the feature backbone pre-trained on base classes. In recent years, different…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Wenhao Qiu , Sichao Fu , Jingyi Zhang , Chengxiang Lei , Qinmu Peng

Few-shot model compression aims to compress a large model into a more compact one with only a tiny training set (even without labels). Block-level pruning has recently emerged as a leading technique in achieving high accuracy and low…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Hanxiao Zhang , Yifan Zhou , Guo-Hua Wang , Jianxin Wu

This paper introduces a generalized few-shot segmentation framework with a straightforward training process and an easy-to-optimize inference phase. In particular, we propose a simple yet effective model based on the well-known InfoMax…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Sina Hajimiri , Malik Boudiaf , Ismail Ben Ayed , Jose Dolz

This work presents a systematic investigation into modernizing Vision Transformer backbones by leveraging architectural advancements from the past five years. While preserving the canonical Attention-FFN structure, we conduct a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Feng Wang , Sucheng Ren , Tiezheng Zhang , Predrag Neskovic , Anand Bhattad , Cihang Xie , Alan Yuille

Few-shot learning (FSL) aims to recognize new concepts using a limited number of visual samples. Existing approaches attempt to incorporate semantic information into the limited visual data for category understanding. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Mushui Liu , Fangtai Wu , Bozheng Li , Ziqian Lu , Yunlong Yu , Xi Li

Recently, several Vision Transformer (ViT) based methods have been proposed for Fine-Grained Visual Classification (FGVC).These methods significantly surpass existing CNN-based ones, demonstrating the effectiveness of ViT in FGVC…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Zi-Chao Zhang , Zhen-Duo Chen , Yongxin Wang , Xin Luo , Xin-Shun Xu

The human visual system has the remarkably ability to be able to effortlessly learn novel concepts from only a few examples. Mimicking the same behavior on machine learning vision systems is an interesting and very challenging research…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Spyros Gidaris , Nikos Komodakis

Few-shot segmentation (FSS) is proposed to segment unknown class targets with just a few annotated samples. Most current FSS methods follow the paradigm of mining the semantics from the support images to guide the query image segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Hanbo Bi , Yingchao Feng , Zhiyuan Yan , Yongqiang Mao , Wenhui Diao , Hongqi Wang , Xian Sun

Despite the great progress made by deep CNNs in image semantic segmentation, they typically require a large number of densely-annotated images for training and are difficult to generalize to unseen object categories. Few-shot segmentation…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Kaixin Wang , Jun Hao Liew , Yingtian Zou , Daquan Zhou , Jiashi Feng

Few-shot learning-the ability to train models with access to limited data-has become increasingly popular in the natural language processing (NLP) domain, as large language models such as GPT and T0 have been empirically shown to achieve…

Software Engineering · Computer Science 2023-06-16 Robert Kraig Helmeczi , Mucahit Cevik , Savas Yıldırım

Few-shot segmentation is a challenging dense prediction task, which entails segmenting a novel query image given only a small annotated support set. The key problem is thus to design a method that aggregates detailed information from the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Joakim Johnander , Johan Edstedt , Michael Felsberg , Fahad Shahbaz Khan , Martin Danelljan

State-of-the-art semantic segmentation methods require sufficient labeled data to achieve good results and hardly work on unseen classes without fine-tuning. Few-shot segmentation is thus proposed to tackle this problem by learning a model…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Zhuotao Tian , Hengshuang Zhao , Michelle Shu , Zhicheng Yang , Ruiyu Li , Jiaya Jia

Few-shot segmentation~(FSS) performance has been extensively promoted by introducing episodic training and class-wise prototypes. However, the FSS problem remains challenging due to three limitations: (1) Models are distracted by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Jian-Wei Zhang , Lei Lv , Yawei Luo , Hao-Zhe Feng , Yi Yang , Wei Chen

Weakly Supervised Semantic Segmentation (WSSS) relying only on image-level supervision is a promising approach to deal with the need for Segmentation networks, especially for generating a large number of pixel-wise masks in a given dataset.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Bharath Srinivas Prabakaran , Erik Ostrowski , Muhammad Shafique