English

TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrieval

Computer Vision and Pattern Recognition 2026-04-27 v2

Abstract

Composed Image Retrieval (CIR) is an important image retrieval paradigm that enables users to retrieve a target image using a multimodal query that consists of a reference image and modification text. Although research on CIR has made significant progress, prevailing setups still rely simple modification texts that typically cover only a limited range of salient changes, which induces two limitations highly relevant to practical applications, namely Insufficient Entity Coverage and Clause-Entity Misalignment. In order to address these issues and bring CIR closer to real-world use, we construct two instruction-rich multi-modification datasets, M-FashionIQ and M-CIRR. In addition, we propose TEMA, the Text-oriented Entity Mapping Architecture, which is the first CIR framework designed for multi-modification while also accommodating simple modifications. Extensive experiments on four benchmark datasets demonstrate that TEMA's superiority in both original and multi-modification scenarios, while maintaining an optimal balance between retrieval accuracy and computational efficiency. Our codes and constructed multi-modification dataset (M-FashionIQ and M-CIRR) are available at https://github.com/lee-zixu/ACL26-TEMA/.

Keywords

Cite

@article{arxiv.2604.21806,
  title  = {TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrieval},
  author = {Zixu Li and Yupeng Hu and Zhiheng Fu and Zhiwei Chen and Yongqi Li and Liqiang Nie},
  journal= {arXiv preprint arXiv:2604.21806},
  year   = {2026}
}

Comments

Accepted by ACL 2026

R2 v1 2026-07-01T12:32:42.791Z