English

Re-Prompting SAM 3 via Object Retrieval: 3rd of the 5th PVUW MOSE Track

Computer Vision and Pattern Recognition 2026-03-26 v1

Abstract

This technical report explores the MOSEv2 track of the PVUW 2026 Challenge, which targets complex semi-supervised video object segmentation. Built on SAM~3, we develop an automatic re-prompting framework to improve robustness under target disappearance and reappearance, severe transformation, and strong same-category distractors. Our method first applies the SAM~3 detector to later frames to identify same-category object candidates, and then performs DINOv3-based object-level matching with a transformation-aware target feature pool to retrieve reliable target anchors. These anchors are injected back into the SAM~3 tracker together with the first-frame mask, enabling multi-anchor propagation rather than relying solely on the initial prompt. This simple directly benefits several core challenges of MOSEv2. Our solution achieves a J&F of 51.17% on the test set, ranking 3rd in the MOSEv2 track.

Keywords

Cite

@article{arxiv.2603.23788,
  title  = {Re-Prompting SAM 3 via Object Retrieval: 3rd of the 5th PVUW MOSE Track},
  author = {Mingqi Gao and Sijie Li and Jungong Han},
  journal= {arXiv preprint arXiv:2603.23788},
  year   = {2026}
}