English
Related papers

Related papers: A Sketch+Text Composed Image Retrieval Dataset for…

200 papers

Blind Image Quality Assessment (BIQA) has advanced significantly through deep learning, but the scarcity of large-scale labeled datasets remains a challenge. While synthetic data offers a promising solution, models trained on existing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Aobo Li , Jinjian Wu , Yongxu Liu , Leida Li , Weisheng Dong

Unsupervised cross-domain image retrieval (UCIR) aims to retrieve images of the same category across diverse domains without relying on annotations. Existing UCIR methods, which align cross-domain features for the entire image, often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Ruohong Yang , Peng Hu , Yunfan Li , Xi Peng

Remote sensing composed image retrieval (RSCIR) enables search in large satellite image archives using composed queries that combine a reference image with a textual modifier. Although RSCIR offers a flexible interface for expressing…

The explosive increase and ubiquitous accessibility of visual data on the Web have led to the prosperity of research activity in image search or retrieval. With the ignorance of visual content as a ranking clue, methods with text search…

Multimedia · Computer Science 2017-09-05 Wengang Zhou , Houqiang Li , Qi Tian

This work addresses composed image retrieval in the context of domain conversion, where the content of a query image is retrieved in the domain specified by the query text. We show that a strong vision-language model provides sufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Nikos Efthymiadis , Bill Psomas , Zakaria Laskar , Konstantinos Karantzalos , Yannis Avrithis , Ondřej Chum , Giorgos Tolias

Composed Image Retrieval (CIR) enables image search by combining a reference image with modification text. Intrinsic noise in CIR triplets incurs intrinsic uncertainty and threatens the model's robustness. Probabilistic learning approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Haomiao Tang , Jinpeng Wang , Minyi Zhao , Guanghao Meng , Ruisheng Luo , Long Chen , Shu-Tao Xia

Differentiable ARchiTecture Search, i.e., DARTS, has drawn great attention in neural architecture search. It tries to find the optimal architecture in a shallow search network and then measures its performance in a deep evaluation network.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Hongyuan Yu , Houwen Peng , Yan Huang , Jianlong Fu , Hao Du , Liang Wang , Haibin Ling

Text-to-image multimodal tasks, generating/retrieving an image from a given text description, are extremely challenging tasks since raw text descriptions cover quite limited information in order to fully describe visually realistic images.…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Soyeon Caren Han , Siqu Long , Siwen Luo , Kunze Wang , Josiah Poon

The advent of text-image models, most notably CLIP, has significantly transformed the landscape of information retrieval. These models enable the fusion of various modalities, such as text and images. One significant outcome of CLIP is its…

Information Retrieval · Computer Science 2024-06-21 Christian Lülf , Denis Mayr Lima Martins , Marcos Antonio Vaz Salles , Yongluan Zhou , Fabian Gieseke

We propose MIRA, a new benchmark designed to evaluate models in scenarios where generating intermediate visual images is essential for successful reasoning. Unlike traditional CoT methods that rely solely on text, tasks in MIRA require…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Yiyang Zhou , Haoqin Tu , Zijun Wang , Zeyu Wang , Niklas Muennighoff , Fan Nie , Yejin Choi , James Zou , Chaorui Deng , Shen Yan , Haoqi Fan , Cihang Xie , Huaxiu Yao , Qinghao Ye

Vision transformers in vision-language models typically use the same amount of compute for every image, regardless of whether it is simple or complex. We propose ICAR (Image Complexity-Aware Retrieval), an adaptive computation approach that…

Information Retrieval · Computer Science 2026-01-16 Mikel Williams-Lekuona , Georgina Cosma

The huge domain gap between sketches and photos and the highly abstract sketch representations pose challenges for sketch-based image retrieval (\underline{SBIR}). The zero-shot sketch-based image retrieval (\underline{ZS-SBIR}) is more…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Hao Ren , Ziqiang Zheng , Yang Wu , Hong Lu , Yang Yang , Ying Shan , Sai-Kit Yeung

Developers often depend on code search engines to obtain solutions for their programming tasks. However, finding an expected solution containing code examples along with their explanations is challenging due to several issues. There is a…

Software Engineering · Computer Science 2021-08-06 Rodrigo F. Silva , M. Masudur Rahman , Carlos Eduardo Dantas , Chanchal Roy , Foutse Khomh , Marcelo A. Maia

Given a query composed of a reference image and a relative caption, the Composed Image Retrieval goal is to retrieve images visually similar to the reference one that integrates the modifications expressed by the caption. Given that recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Alberto Baldrati , Marco Bertini , Tiberio Uricchio , Alberto del Bimbo

Compositional image retrieval (CIR) is a multimodal learning task where a model combines a query image with a user-provided text modification to retrieve a target image. CIR finds applications in a variety of domains including product…

With the explosive growth of multi-modal information on the Internet, unimodal search cannot satisfy the requirement of Internet applications. Text-image retrieval research is needed to realize high-quality and efficient retrieval between…

Information Retrieval · Computer Science 2024-04-02 Haoyu Liu , Yaoxian Song , Xuwu Wang , Zhu Xiangru , Zhixu Li , Wei Song , Tiefeng Li

Low-shot sketch-based image retrieval is an emerging task in computer vision, allowing to retrieve natural images relevant to hand-drawn sketch queries that are rarely seen during the training phase. Related prior works either require…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Anjan Dutta , Zeynep Akata

Image retrieval remains a fundamental yet challenging problem in computer vision. While recent advances in Multimodal Large Language Models (MLLMs) have demonstrated strong reasoning capabilities, existing methods typically employ them only…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Shangrong Wu , Yanghong Zhou , Yang Chen , Feng Zhang , P. Y. Mok

As a fundamental and challenging task in bridging language and vision domains, Image-Text Retrieval (ITR) aims at searching for the target instances that are semantically relevant to the given query from the other modality, and its key…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yan Zhang , Zhong Ji , Di Wang , Yanwei Pang , Xuelong Li

Recently, Zero-shot Sketch-based Image Retrieval (ZS-SBIR) has attracted the attention of the computer vision community due to it's real-world applications, and the more realistic and challenging setting than found in SBIR. ZS-SBIR inherits…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Osman Tursun , Simon Denman , Sridha Sridharan , Ethan Goan , Clinton Fookes