English

SimPropNet: Improved Similarity Propagation for Few-shot Image Segmentation

Computer Vision and Pattern Recognition 2020-05-05 v2

Abstract

Few-shot segmentation (FSS) methods perform image segmentation for a particular object class in a target (query) image, using a small set of (support) image-mask pairs. Recent deep neural network based FSS methods leverage high-dimensional feature similarity between the foreground features of the support images and the query image features. In this work, we demonstrate gaps in the utilization of this similarity information in existing methods, and present a framework - SimPropNet, to bridge those gaps. We propose to jointly predict the support and query masks to force the support features to share characteristics with the query features. We also propose to utilize similarities in the background regions of the query and support images using a novel foreground-background attentive fusion mechanism. Our method achieves state-of-the-art results for one-shot and five-shot segmentation on the PASCAL-5i dataset. The paper includes detailed analysis and ablation studies for the proposed improvements and quantitative comparisons with contemporary methods.

Keywords

Cite

@article{arxiv.2004.15014,
  title  = {SimPropNet: Improved Similarity Propagation for Few-shot Image Segmentation},
  author = {Siddhartha Gairola and Mayur Hemani and Ayush Chopra and Balaji Krishnamurthy},
  journal= {arXiv preprint arXiv:2004.15014},
  year   = {2020}
}

Comments

An updated version of this work was accepted at IJCAI 2020

R2 v1 2026-06-23T15:13:22.752Z