English

Small Objects Matters in Weakly-supervised Semantic Segmentation

Computer Vision and Pattern Recognition 2023-09-26 v1 Artificial Intelligence

Abstract

Weakly-supervised semantic segmentation (WSSS) performs pixel-wise classification given only image-level labels for training. Despite the difficulty of this task, the research community has achieved promising results over the last five years. Still, current WSSS literature misses the detailed sense of how well the methods perform on different sizes of objects. Thus we propose a novel evaluation metric to provide a comprehensive assessment across different object sizes and collect a size-balanced evaluation set to complement PASCAL VOC. With these two gadgets, we reveal that the existing WSSS methods struggle in capturing small objects. Furthermore, we propose a size-balanced cross-entropy loss coupled with a proper training strategy. It generally improves existing WSSS methods as validated upon ten baselines on three different datasets.

Keywords

Cite

@article{arxiv.2309.14117,
  title  = {Small Objects Matters in Weakly-supervised Semantic Segmentation},
  author = {Cheolhyun Mun and Sanghuk Lee and Youngjung Uh and Junsuk Choe and Hyeran Byun},
  journal= {arXiv preprint arXiv:2309.14117},
  year   = {2023}
}

Comments

Accepted to WACV 2024

R2 v1 2026-06-28T12:31:34.318Z