English

Unsupervised Online 3D Instance Segmentation with Synthetic Sequences and Dynamic Loss

Computer Vision and Pattern Recognition 2026-03-17 v3

Abstract

Unsupervised online 3D instance segmentation is a fundamental yet challenging task, as it requires maintaining consistent object identities across LiDAR scans without relying on annotated training data. Existing methods, such as UNIT, have made progress in this direction but remain constrained by limited training diversity, rigid temporal sampling, and heavy dependence on noisy pseudo-labels. We propose a new framework that enriches the training distribution through synthetic point cloud sequence generation, enabling greater diversity without relying on manual labels or simulation engines. To better capture temporal dynamics, our method incorporates a flexible sampling strategy that leverages both adjacent and non-adjacent frames, allowing the model to learn from long-range dependencies as well as short-term variations. In addition, a dynamic-weighting loss emphasizes confident and informative samples, guiding the network toward more robust representations. Through extensive experiments on SemanticKITTI, nuScenes, and PandaSet, our method consistently outperforms UNIT and other unsupervised baselines, achieving higher segmentation accuracy and more robust temporal associations. The code will be publicly available at github.com/Eaphan/SFT3D.

Keywords

Cite

@article{arxiv.2509.23194,
  title  = {Unsupervised Online 3D Instance Segmentation with Synthetic Sequences and Dynamic Loss},
  author = {Yifan Zhang and Wei Zhang and Chuangxin He and Zhonghua Miao and Junhui Hou},
  journal= {arXiv preprint arXiv:2509.23194},
  year   = {2026}
}

Comments

Accepted to TMM 2026

R2 v1 2026-07-01T06:00:33.432Z