English
Related papers

Related papers: Few-Shot Semantic Segmentation Meets SAM3

200 papers

We propose SAM-IF, a novel method for incremental few-shot instance segmentation leveraging the Segment Anything Model (SAM). SAM-IF addresses the challenges of class-agnostic instance segmentation by introducing a multi-class classifier…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Xudong Zhou , Wenhao He

Generalized few-shot semantic segmentation was introduced to move beyond only evaluating few-shot segmentation models on novel classes to include testing their ability to remember base classes. While the current state-of-the-art approach is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Josh Myers-Dean , Yinan Zhao , Brian Price , Scott Cohen , Danna Gurari

The advent of foundation models signals a new era in artificial intelligence. The Segment Anything Model (SAM) is the first foundation model for image segmentation. In this study, we evaluate SAM's ability to segment features from eye…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marcus Nyström , Enkelejda Kasneci

Few-shot semantic segmentation aims to learn to segment unseen class objects with the guidance of only a few support images. Most previous methods rely on the pixel-level label of support images. In this paper, we focus on a more…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Haohan Wang , Liang Liu , Wuhao Zhang , Jiangning Zhang , Zhenye Gan , Yabiao Wang , Chengjie Wang , Haoqian Wang

Few-shot object detection (FSOD), with the aim to detect novel objects using very few training examples, has recently attracted great research interest in the community. Metric-learning based methods have been demonstrated to be effective…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Guangxing Han , Jiawei Ma , Shiyuan Huang , Long Chen , Shih-Fu Chang

Traditional semantic segmentation tasks require a large number of labels and are difficult to identify unlearned categories. Few-shot semantic segmentation (FSS) aims to use limited labeled support images to identify the segmentation of new…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xianglin Wang , Xiaoliu Luo , Taiping Zhang

While the Segment Anything Model (SAM) excels in semantic segmentation for general-purpose images, its performance significantly deteriorates when applied to medical images, primarily attributable to insufficient representation of medical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Yiming Zhang , Tianang Leng , Kun Han , Xiaohui Xie

Few-shot segmentation (FSS) aims to rapidly learn novel class concepts from limited examples to segment specific targets in unseen images, and has been widely applied in areas such as medical diagnosis and industrial inspection. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Qianyu Guo , Jingrong Wu , Jieji Ren , Weifeng Ge , Wenqiang Zhang

Few-shot learning (FSL) enables object detection models to recognize novel classes given only a few annotated examples, thereby reducing expensive manual data labeling. This survey examines recent FSL advances for video and 3D object…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Md Meftahul Ferdaus , Kendall N. Niles , Joe Tom , Mahdi Abdelguerfi , Elias Ioup

Few-shot segmentation (FSS) aims to segment objects of new categories given only a handful of annotated samples. Previous works focus their efforts on exploring the support information while paying less attention to the mining of the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Yuan Wang , Naisong Luo , Tianzhu Zhang

Few-shot semantic segmentation (FSS) aims to form class-agnostic models segmenting unseen classes with only a handful of annotations. Previous methods limited to the semantic feature and prototype representation suffer from coarse…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Bohao Peng , Zhuotao Tian , Xiaoyang Wu , Chengyao Wang , Shu Liu , Jingyong Su , Jiaya Jia

Over the past few years, we have witnessed the success of deep learning in image recognition thanks to the availability of large-scale human-annotated datasets such as PASCAL VOC, ImageNet, and COCO. Although these datasets have covered a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Xiang Li , Tianhan Wei , Yau Pun Chen , Yu-Wing Tai , Chi-Keung Tang

In-context segmentation (ICS) aims to segment arbitrary concepts, e.g., objects, parts, or personalized instances, given one annotated visual examples. Existing work relies on (i) fine-tuning vision foundation models (VFMs), which improves…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Claudia Cuttano , Gabriele Trivigno , Christoph Reich , Daniel Cremers , Carlo Masone , Stefan Roth

This work aims to leverage pre-trained foundation models, such as contrastive language-image pre-training (CLIP) and segment anything model (SAM), to address weakly supervised semantic segmentation (WSSS) using image-level labels. To this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xiaobo Yang , Xiaojin Gong

We introduce SAM3D, a new approach to semi-automatic zero-shot segmentation of 3D images building on the existing Segment Anything Model. We achieve fast and accurate segmentations in 3D images with a four-step strategy involving: user…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Trevor J. Chan , Aarush Sahni , Yijin Fang , Jie Li , Alisha Luthra , Alison Pouch , Chamith S. Rajapakse

Semantic Segmentation is one of the most challenging vision tasks, usually requiring large amounts of training data with expensive pixel level annotations. With the success of foundation models and especially vision-language models, recent…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Soroush Seifi , Daniel Olmeda Reino , Fabien Despinoy , Rahaf Aljundi

Despite the great progress made by deep CNNs in image semantic segmentation, they typically require a large number of densely-annotated images for training and are difficult to generalize to unseen object categories. Few-shot segmentation…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Kaixin Wang , Jun Hao Liew , Yingtian Zou , Daquan Zhou , Jiashi Feng

Few-shot segmentation is challenging because objects within the support and query images could significantly differ in appearance and pose. Using a single prototype acquired directly from the support image to segment the query image causes…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 Boyu Yang , Chang Liu , Bohao Li , Jianbin Jiao , Qixiang Ye

We introduce SAMPro3D for zero-shot instance segmentation of 3D scenes. Given the 3D point cloud and multiple posed RGB-D frames of 3D scenes, our approach segments 3D instances by applying the pretrained Segment Anything Model (SAM) to 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Mutian Xu , Xingyilang Yin , Lingteng Qiu , Yang Liu , Xin Tong , Xiaoguang Han

Image segmentation foundation models (SFMs) like Segment Anything Model (SAM) have achieved impressive zero-shot and interactive segmentation across diverse domains. However, they struggle to segment objects with certain structures,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Yixin Zhang , Nicholas Konz , Kevin Kramer , Maciej A. Mazurowski