English

VideoSeg-R1:Reasoning Video Object Segmentation via Reinforcement Learning

Computer Vision and Pattern Recognition 2025-11-21 v1

Abstract

Traditional video reasoning segmentation methods rely on supervised fine-tuning, which limits generalization to out-of-distribution scenarios and lacks explicit reasoning. To address this, we propose \textbf{VideoSeg-R1}, the first framework to introduce reinforcement learning into video reasoning segmentation. It adopts a decoupled architecture that formulates the task as joint referring image segmentation and video mask propagation. It comprises three stages: (1) A hierarchical text-guided frame sampler to emulate human attention; (2) A reasoning model that produces spatial cues along with explicit reasoning chains; and (3) A segmentation-propagation stage using SAM2 and XMem. A task difficulty-aware mechanism adaptively controls reasoning length for better efficiency and accuracy. Extensive evaluations on multiple benchmarks demonstrate that VideoSeg-R1 achieves state-of-the-art performance in complex video reasoning and segmentation tasks. The code will be publicly available at https://github.com/euyis1019/VideoSeg-R1.

Keywords

Cite

@article{arxiv.2511.16077,
  title  = {VideoSeg-R1:Reasoning Video Object Segmentation via Reinforcement Learning},
  author = {Zishan Xu and Yifu Guo and Yuquan Lu and Fengyu Yang and Junxin Li},
  journal= {arXiv preprint arXiv:2511.16077},
  year   = {2025}
}
R2 v1 2026-07-01T07:46:40.683Z