跨视图完成模型是零样本对应估计器
计算机视觉与模式识别
2024-12-13 v1
摘要
In this work, we explore new perspectives on cross-view completion learning by drawing an analogy to self-supervised correspondence learning. Through our analysis, we demonstrate that the cross-attention map within cross-view completion models captures correspondence more effectively than other correlations derived from encoder or decoder features. We verify the effectiveness of the cross-attention map by evaluating on both zero-shot matching and learning-based geometric matching and multi-frame depth estimation. Project page is available at https://cvlab-kaist.github.io/ZeroCo/.
引用
@article{arxiv.2412.09072,
title = {Cross-View Completion Models are Zero-shot Correspondence Estimators},
author = {Honggyu An and Jinhyeon Kim and Seonghoon Park and Jaewoo Jung and Jisang Han and Sunghwan Hong and Seungryong Kim},
journal= {arXiv preprint arXiv:2412.09072},
year = {2024}
}
备注
Project Page: https://cvlab-kaist.github.io/ZeroCo/