English

Camera-Aware Cross-View Alignment for Referring 3D Gaussian Splatting Segmentation

Computer Vision and Pattern Recognition 2026-03-23 v2

Abstract

Referring 3D Gaussian Splatting Segmentation (R3DGS) aims to ground free-form language queries in 3D Gaussian fields. However, existing methods rely on single-view pseudo supervision, leading to viewpoint drift and inconsistent predictions across views. We propose CaRF (Camera-aware Referring Field), a camera-aware cross-view alignment framework for view-consistent referring in 3D Gaussian splatting. CaRF introduces Camera-conditioned Alignment Modulation (CAM) to inject camera geometry into Gaussian-text interactions, and Gaussian-level Cross-view Logit Alignment (GCLA) to explicitly align referring responses of the same Gaussians across calibrated views during training. By turning cross-view discrepancy into an optimizable objective, CaRF enables geometry-aware and view-consistent reasoning directly in the Gaussian space. Extensive experiments on three benchmarks demonstrate that CaRF achieves state-of-the-art performance, improving mIoU by 16.8%, 4.3%, and 2.0% on Ref-LERF, LERF-OVS, and 3D-OVS, respectively. Our code is available at https://github.com/eR3R3/CaRF.

Keywords

Cite

@article{arxiv.2511.03992,
  title  = {Camera-Aware Cross-View Alignment for Referring 3D Gaussian Splatting Segmentation},
  author = {Yuwen Tao and Kanglei Zhou and Xin Tan and Yuan Xie},
  journal= {arXiv preprint arXiv:2511.03992},
  year   = {2026}
}

Comments

Accepted to ICME 2026

R2 v1 2026-07-01T07:23:51.616Z