English

HINT: Composed Image Retrieval with Dual-path Compositional Contextualized Network

Computer Vision and Pattern Recognition 2026-03-30 v1

Abstract

Composed Image Retrieval (CIR) is a challenging image retrieval paradigm. It aims to retrieve target images from large-scale image databases that are consistent with the modification semantics, based on a multimodal query composed of a reference image and modification text. Although existing methods have made significant progress in cross-modal alignment and feature fusion, a key flaw remains: the neglect of contextual information in discriminating matching samples. However, addressing this limitation is not an easy task due to two challenges: 1) implicit dependencies and 2) the lack of a differential amplification mechanism. To address these challenges, we propose a dual-patH composItional coNtextualized neTwork (HINT), which can perform contextualized encoding and amplify the similarity differences between matching and non-matching samples, thus improving the upper performance of CIR models in complex scenarios. Our HINT model achieves optimal performance on all metrics across two CIR benchmark datasets, demonstrating the superiority of our HINT model. Codes are available at https://github.com/zh-mingyu/HINT.

Keywords

Cite

@article{arxiv.2603.26341,
  title  = {HINT: Composed Image Retrieval with Dual-path Compositional Contextualized Network},
  author = {Mingyu Zhang and Zixu Li and Zhiwei Chen and Zhiheng Fu and Xiaowei Zhu and Jiajia Nie and Yinwei Wei and Yupeng Hu},
  journal= {arXiv preprint arXiv:2603.26341},
  year   = {2026}
}

Comments

Accepted by ICASSP 2026

R2 v1 2026-07-01T11:40:39.617Z