English

TrianguLang: Geometry-Aware Semantic Consensus for Pose-Free 3D Localization

Computer Vision and Pattern Recognition 2026-04-21 v3

Abstract

Localizing objects and parts from natural language in 3D space is essential for robotics, AR, and embodied AI, yet existing methods face a trade-off between the accuracy and geometric consistency of per-scene optimization and the efficiency of feed-forward inference. We present TrianguLang, a feed-forward framework for 3D localization that requires no camera calibration at inference. Unlike prior methods that treat views independently, we introduce Geometry-Aware Semantic Attention (GASA), which utilizes predicted geometry to gate cross-view feature correspondence, suppressing semantically-plausible but geometrically-inconsistent matches without requiring ground-truth poses. Validated on five benchmarks including ScanNet++ and uCO3D, TrianguLang achieves state-of-the-art feed-forward text-guided segmentation and localization, reducing user effort from O(N)O(N) clicks to a single text query. The model processes each frame at 1008x1008 resolution in \sim57ms (\sim18 FPS) without optimization, enabling practical deployment for interactive robotics and AR applications. Code and checkpoints are available at https://cwru-aism.github.io/triangulang/.

Keywords

Cite

@article{arxiv.2603.08096,
  title  = {TrianguLang: Geometry-Aware Semantic Consensus for Pose-Free 3D Localization},
  author = {Bryce Grant and Aryeh Rothenberg and Atri Banerjee and Peng Wang},
  journal= {arXiv preprint arXiv:2603.08096},
  year   = {2026}
}

Comments

Tables updated with current results, typographical errors fixed

R2 v1 2026-07-01T11:09:51.744Z