English

Rethinking Saliency-Guided Weakly-Supervised Semantic Segmentation

Computer Vision and Pattern Recognition 2024-04-03 v2

Abstract

This paper presents a fresh perspective on the role of saliency maps in weakly-supervised semantic segmentation (WSSS) and offers new insights and research directions based on our empirical findings. We conduct comprehensive experiments and observe that the quality of the saliency map is a critical factor in saliency-guided WSSS approaches. Nonetheless, we find that the saliency maps used in previous works are often arbitrarily chosen, despite their significant impact on WSSS. Additionally, we observe that the choice of the threshold, which has received less attention before, is non-trivial in WSSS. To facilitate more meaningful and rigorous research for saliency-guided WSSS, we introduce \texttt{WSSS-BED}, a standardized framework for conducting research under unified conditions. \texttt{WSSS-BED} provides various saliency maps and activation maps for seven WSSS methods, as well as saliency maps from unsupervised salient object detection models.

Keywords

Cite

@article{arxiv.2404.00918,
  title  = {Rethinking Saliency-Guided Weakly-Supervised Semantic Segmentation},
  author = {Beomyoung Kim and Donghyun Kim and Sung Ju Hwang},
  journal= {arXiv preprint arXiv:2404.00918},
  year   = {2024}
}

Comments

Preprint, 17 pages, 7 figures

R2 v1 2026-06-28T15:39:56.557Z