English

B2N3D: Progressive Learning from Binary to N-ary Relationships for 3D Object Grounding

Computer Vision and Pattern Recognition 2025-12-02 v2

Abstract

Localizing 3D objects using natural language is essential for robotic scene understanding. The descriptions often involve multiple spatial relationships to distinguish similar objects, making 3D-language alignment difficult. Current methods only model relationships for pairwise objects, ignoring the global perceptual significance of n-ary combinations in multi-modal relational understanding. To address this, we propose a novel progressive relational learning framework for 3D object grounding. We extend relational learning from binary to n-ary to identify visual relations that match the referential description globally. Given the absence of specific annotations for referred objects in the training data, we design a grouped supervision loss to facilitate n-ary relational learning. In the scene graph created with n-ary relationships, we use a multi-modal network with hybrid attention mechanisms to further localize the target within the n-ary combinations. Experiments and ablation studies on the ReferIt3D and ScanRefer benchmarks demonstrate that our method outperforms the state-of-the-art, and proves the advantages of the n-ary relational perception in 3D localization.

Keywords

Cite

@article{arxiv.2510.10194,
  title  = {B2N3D: Progressive Learning from Binary to N-ary Relationships for 3D Object Grounding},
  author = {Feng Xiao and Hongbin Xu and Hai Ci and Wenxiong Kang},
  journal= {arXiv preprint arXiv:2510.10194},
  year   = {2025}
}
R2 v1 2026-07-01T06:31:21.540Z