English

Learning Hierarchical Orthogonal Prototypes for Generalized Few-Shot 3D Point Cloud Segmentation

Computer Vision and Pattern Recognition 2026-03-23 v1 Artificial Intelligence

Abstract

Generalized few-shot 3D point cloud segmentation aims to adapt to novel classes from only a few annotations while maintaining strong performance on base classes, but this remains challenging due to the inherent stability-plasticity trade-off: adapting to novel classes can interfere with shared representations and cause base-class forgetting. We present HOP3D, a unified framework that learns hierarchical orthogonal prototypes with an entropy-based few-shot regularizer to enable robust novel-class adaptation without degrading base-class performance. HOP3D introduces hierarchical orthogonalization that decouples base and novel learning at both the gradient and representation levels, effectively mitigating base-novel interference. To further enhance adaptation under sparse supervision, we incorporate an entropy-based regularizer that leverages predictive uncertainty to refine prototype learning and promote balanced predictions. Extensive experiments on ScanNet200 and ScanNet++ demonstrate that HOP3D consistently outperforms state-of-the-art baselines under both 1-shot and 5-shot settings. The code is available at https://fdueblab-hop3d.github.io/.

Keywords

Cite

@article{arxiv.2603.19788,
  title  = {Learning Hierarchical Orthogonal Prototypes for Generalized Few-Shot 3D Point Cloud Segmentation},
  author = {Yifei Zhao and Fanyu Zhao and Zhongyuan Zhang and Shengtang Wu and Yixuan Lin and Yinsheng Li},
  journal= {arXiv preprint arXiv:2603.19788},
  year   = {2026}
}

Comments

6 pages, 6 figures, 2 tables, Accepted by ICME 2026

R2 v1 2026-07-01T11:29:33.030Z