English

Normalized Matching Transformer

Computer Vision and Pattern Recognition 2026-05-06 v3 Machine Learning

Abstract

We introduce the Normalized Matching Transformer (NMT), a deep learning approach for efficient and accurate sparse semantic keypoint matching between image pairs. NMT consists of a strong visual backbone, geometric feature refinement via SplineCNN, followed by a normalized Transformer for computing matching features. Central to NMT is our hyperspherical normalization strategy: we enforce unit-norm embeddings at every Transformer layer and train with a combined contrastive InfoNCE and hyperspherical uniformity loss to yield more discriminative keypoint representations. This novel architecture/loss combination encourages close alignment of matching image features and large distances between non-matching ones not only at the output level, but for each layer. Despite its architectural simplicity, NMT sets a new state-of-the-art performance on PascalVOC and SPair-71k, outperforming BBGM, ASAR, COMMON and GMTR by 5.1% and 2.2%, respectively, while converging in at least 1.7x fewer epochs compared to other state-of-the-art baselines. These results underscore the power of combining pervasive normalization with hyperspherical learning for matching tasks.

Keywords

Cite

@article{arxiv.2503.17715,
  title  = {Normalized Matching Transformer},
  author = {Abtin Pourhadi and Paul Swoboda},
  journal= {arXiv preprint arXiv:2503.17715},
  year   = {2026}
}
R2 v1 2026-06-28T22:30:47.741Z