English

GLASS: Geometry-aware Local Alignment and Structure Synchronization Network for 2D-3D Registration

Computer Vision and Pattern Recognition 2026-03-30 v1 Machine Learning

Abstract

Image-to-point cloud registration methods typically follow a coarse-to-fine pipeline, extracting patch-level correspondences and refining them into dense pixel-to-point matches. However, in scenes with repetitive patterns, images often lack sufficient 3D structural cues and alignment with point clouds, leading to incorrect matches. Moreover, prior methods usually overlook structural consistency, limiting the full exploitation of correspondences. To address these issues, we propose two novel modules: the Local Geometry Enhancement (LGE) module and the Graph Distribution Consistency (GDC) module. LGE enhances both image and point cloud features with normal vectors, injecting geometric structure into image features to reduce mismatches. GDC constructs a graph from matched points to update features and explicitly constrain similarity distributions. Extensive experiments and ablations on two benchmarks, RGB-D Scenes v2 and 7-Scenes, demonstrate that our approach achieves state-of-the-art performance in image-to-point cloud registration.

Keywords

Cite

@article{arxiv.2603.26262,
  title  = {GLASS: Geometry-aware Local Alignment and Structure Synchronization Network for 2D-3D Registration},
  author = {Zhixin Cheng and Jiacheng Deng and Xinjun Li and Bohao Liao and Li Liu and Xiaotian Yin and Baoqun Yin and Tianzhu Zhang},
  journal= {arXiv preprint arXiv:2603.26262},
  year   = {2026}
}

Comments

Accepted by IEEE Transactions on Circuits and Systems for Video Technology

R2 v1 2026-07-01T11:40:31.438Z