PLOT：基于部位插槽注意力的文本搜索人物中的对应部件发现
摘要
基于文本的人物搜索通过自由形式的文本查询在庞大的图像集合中识别个体， presents a unique challenge in aligning visual and textual representations, particularly at the human part level. Existing methods often struggle with part feature extraction and alignment due to the lack of direct part-level supervision and reliance on heuristic features. We propose a novel framework that leverages a part discovery module based on slot attention to autonomously identify and align distinctive parts across modalities, enhancing interpretability and retrieval accuracy without explicit part-level correspondence supervision. Additionally, text-based dynamic part attention adjusts the importance of each part, further improving retrieval outcomes. Our method is evaluated on three public benchmarks, significantly outperforming existing methods.
引用
@article{arxiv.2409.13475,
title = {PLOT: Text-based Person Search with Part Slot Attention for Corresponding Part Discovery},
author = {Jicheol Park and Dongwon Kim and Boseung Jeong and Suha Kwak},
journal= {arXiv preprint arXiv:2409.13475},
year = {2024}
}