English
Related papers

Related papers: A Sketch+Text Composed Image Retrieval Dataset for…

200 papers

Composed Image Retrieval (CIR) aims to find a target image that aligns with user intent, expressed through a reference image and a modification text. While Zero-shot CIR (ZS-CIR) methods sidestep the need for labeled training data by…

Information Retrieval · Computer Science 2025-12-25 Youjin Jung , Seongwoo Cho , Hyun-seok Min , Sungchul Choi

Widely used in news, business, and educational media, infographics are handcrafted to effectively communicate messages about complex and often abstract topics including `ways to conserve the environment' and `understanding the financial…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Spandan Madan , Zoya Bylinskii , Matthew Tancik , Adrià Recasens , Kimberli Zhong , Sami Alsheikh , Hanspeter Pfister , Aude Oliva , Fredo Durand

Cross-Domain Image Retrieval (CDIR) is a challenging task in computer vision, aiming to match images across different visual domains such as sketches, paintings, and photographs. Existing CDIR methods rely either on supervised learning with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Lucas Iijima , Nikolaos Giakoumoglou , Tania Stathaki

Current multimodal information retrieval studies mainly focus on single-image inputs, which limits real-world applications involving multiple images and text-image interleaved content. In this work, we introduce the text-image interleaved…

Computation and Language · Computer Science 2025-02-19 Xin Zhang , Ziqi Dai , Yongqi Li , Yanzhao Zhang , Dingkun Long , Pengjun Xie , Meishan Zhang , Jun Yu , Wenjie Li , Min Zhang

Composed image retrieval attempts to retrieve an image of interest from gallery images through a composed query of a reference image and its corresponding modified text. It has recently attracted attention due to the collaboration of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Shitong Sun , Fanghua Ye , Shaogang Gong

The social media explosion has populated the Internet with a wealth of images. There are two existing paradigms for image retrieval: 1) content-based image retrieval (CBIR), which has traditionally used visual features for similarity search…

Multimedia · Computer Science 2019-09-04 Sreyasi Nag Chowdhury , Niket Tandon , Hakan Ferhatosmanoglu , Gerhard Weikum

Composed Image Retrieval (CIR) enables fine-grained visual search by combining a reference image with a textual modification. While supervised CIR methods achieve high accuracy, their reliance on costly triplet annotations motivates…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xin Wang , Haipeng Zhang , Mang Li , Zhaohui Xia , Yueguo Chen , Yu Zhang , Chunyu Wei

Composed Image Retrieval (CIR) has demonstrated significant potential by enabling flexible multimodal queries that combine a reference image and modification text. However, CIR inherently prioritizes semantic matching, struggling to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yuxin Yang , Yinan Zhou , Yuxin Chen , Ziqi Zhang , Zongyang Ma , Chunfeng Yuan , Bing Li , Jun Gao , Weiming Hu

Free-hand sketch-based image retrieval (SBIR) is a specific cross-view retrieval task, in which queries are abstract and ambiguous sketches while the retrieval database is formed with natural images. Work in this area mainly focuses on…

Computer Vision and Pattern Recognition · Computer Science 2017-03-17 Li Liu , Fumin Shen , Yuming Shen , Xianglong Liu , Ling Shao

Composed Image Retrieval (CIR) requires both preserving the visual continuity of the reference image and faithfully executing the semantic variables specified in the modification text, which constitute the core challenge of the task.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xingtian Pei , Yukun Song , Changwei Wang , Shunpeng Chen , Rongtao Xu , Shengpeng Xu , Shibiao Xu

In the past few years, cross-modal image-text retrieval (ITR) has experienced increased interest in the research community due to its excellent research value and broad real-world application. It is designed for the scenarios where the…

Information Retrieval · Computer Science 2022-11-21 Min Cao , Shiping Li , Juntao Li , Liqiang Nie , Min Zhang

As a promising field, Multi-Query Image Retrieval (MQIR) aims at searching for the semantically relevant image given multiple region-specific text queries. Existing works mainly focus on a single-level similarity between image regions and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Zhong Ji , Zhihao Li , Yan Zhang , Haoran Wang , Yanwei Pang , Xuelong Li

This paper proposes a novel framework called concatenated image completion via tensor augmentation and completion (ICTAC), which recovers missing entries of color images with high accuracy. Typical images are second- or third-order tensors…

Machine Learning · Computer Science 2016-07-15 Johann A. Bengua , Hoang D. Tuan , Ho N. Phien , Minh N. Do

This paper addresses the problem of media retrieval using a multimodal query (a query which combines visual input with additional semantic information in natural language feedback). We propose a SynthTriplet GAN framework which resolves…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Ivona Tautkute , Tomasz Trzcinski

This paper addresses the task of interactive, conversational text-to-image retrieval. Our DIR-TIR framework progressively refines the target image search through two specialized modules: the Dialog Refiner Module and the Image Refiner…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Zongwei Zhen , Biqing Zeng

Proliferation of touch-based devices has made sketch-based image retrieval practical. While many methods exist for sketch-based object detection/image retrieval on small datasets, relatively less work has been done on large (web)-scale…

Computer Vision and Pattern Recognition · Computer Science 2015-11-03 Sarthak Parui , Anurag Mittal

Sketch-based image retrieval (SBIR) is challenging due to the inherent domain-gap between sketch and photo. Compared with pixel-perfect depictions of photos, sketches are iconic renderings of the real world with highly abstract. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2017-05-30 Peng Xu , Qiyue Yin , Yongye Huang , Yi-Zhe Song , Zhanyu Ma , Liang Wang , Tao Xiang , W. Bastiaan Kleijn , Jun Guo

The accelerating growth of scientific publications has intensified the need for scalable, trustworthy systems to synthesize knowledge across diverse literature. While recent retrieval-augmented generation (RAG) methods have improved access…

Digital Libraries · Computer Science 2025-11-19 Hang Ding , Yilun Zhao , Tiansheng Hu , Manasi Patwardhan , Arman Cohan

Remote Sensing Image-Text Retrieval (RSITR) is pivotal for knowledge services and data mining in the remote sensing (RS) domain. Considering the multi-scale representations in image content and text vocabulary can enable the models to learn…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Rui Yang , Shuang Wang , Yingping Han , Yuanheng Li , Dong Zhao , Dou Quan , Yanhe Guo , Licheng Jiao

Scene text recognition (STR) has attracted much attention due to its broad applications. The previous works pay more attention to dealing with the recognition of Latin text images with complex backgrounds by introducing language models or…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Haiyang Yu , Xiaocong Wang , Bin Li , Xiangyang Xue