中文
相关论文

相关论文: Generative Editing in the Joint Vision-Language Sp…

200 篇论文

Infrared-visible (IR-VIS) image fusion is vital for perception and security, yet most methods rely on the availability of both modalities during training and inference. When the infrared modality is absent, pixel-space generative…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Yafei Zhang , Meng Ma , Huafeng Li , Yu Liu

This paper proposes a novel diffusion-based model, CompoDiff, for solving zero-shot Composed Image Retrieval (ZS-CIR) with latent diffusion. This paper also introduces a new synthetic dataset, named SynthTriplets18M, with 18.8 million…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Geonmo Gu , Sanghyuk Chun , Wonjae Kim , HeeJae Jun , Yoohoon Kang , Sangdoo Yun

Composed Image Retrieval (CIR) retrieves target images using a reference image paired with modification text. Despite rapid advances, all existing methods and datasets operate at the image level -- a single reference image plus modification…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Peng Yuan , Bingyin Mei , Hui Zhang

Composed Image Retrieval (CIR) facilitates image retrieval through a multimodal query consisting of a reference image and modification text. The reference image defines the retrieval context, while the modification text specifies desired…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Zixu Li , Zhiheng Fu , Yupeng Hu , Zhiwei Chen , Haokun Wen , Liqiang Nie

Creating novel images by fusing visual cues from multiple sources is a fundamental yet underexplored problem in image-to-image generation, with broad applications in artistic creation, virtual reality and visual media. Existing methods…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Zeren Xiong , Yue Yu , Zedong Zhang , Shuo Chen , Jian Yang , Jun Li

Composed Image Retrieval (CIR) involves retrieving a target image based on a composed query of an image paired with text that specifies modifications or changes to the visual reference. CIR is inherently an instruction-following task, as…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Wenliang Zhong , Weizhi An , Feng Jiang , Hehuan Ma , Yuzhi Guo , Junzhou Huang

The Composed Image Retrieval (CIR) task aims to retrieve target images using a composed query consisting of a reference image and a modified text. Advanced methods often utilize contrastive learning as the optimization objective, which…

计算机视觉与模式识别 · 计算机科学 2024-08-08 Zhangchi Feng , Richong Zhang , Zhijie Nie

In Composed Image Retrieval (CIR), a user combines a query image with text to describe their intended target. Existing methods rely on supervised learning of CIR models using labeled triplets consisting of the query image, text…

计算机视觉与模式识别 · 计算机科学 2023-05-17 Kuniaki Saito , Kihyuk Sohn , Xiang Zhang , Chun-Liang Li , Chen-Yu Lee , Kate Saenko , Tomas Pfister

Composed Image Retrieval (CIR) aims to retrieve images based on a query image with text. Current Zero-Shot CIR (ZS-CIR) methods try to solve CIR tasks without using expensive triplet-labeled training datasets. However, the gap between…

计算机视觉与模式识别 · 计算机科学 2024-07-10 Yingying Jiang , Hanchao Jia , Xiaobing Wang , Peng Hao

Given an image and a target modification (e.g an image of the Eiffel tower and the text "without people and at night-time"), Compositional Image Retrieval (CIR) aims to retrieve the relevant target image in a database. While supervised…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Shyamgopal Karthik , Karsten Roth , Massimiliano Mancini , Zeynep Akata

Retrieval is being redefined by agentic AI, demanding multimodal reasoning beyond conventional similarity-based paradigms. Composed Image Retrieval (CIR) exemplifies this shift as each query combines a reference image with textual…

信息检索 · 计算机科学 2026-03-02 Zhongyu Yang , Wei Pang , Yingfang Yuan

Composed image retrieval (CIR) requires multi-modal models to jointly reason over visual content and semantic modifications presented in text-image input pairs. While current CIR models achieve strong performance on common benchmark cases,…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Chenchen Zhao , Jianhuan Zhuo , Muxi Chen , Zhaohua Zhang , Wenyu Jiang , Tianwen Jiang , Qiuyong Xiao , Jihong Zhang , Qiang Xu

Generative retrieval (GR) reformulates information retrieval (IR) by framing it as the generation of document identifiers (docids), thereby enabling end-to-end optimization and seamless integration with generative language models (LMs).…

信息检索 · 计算机科学 2026-04-28 Weiwei Sun , Keyi Kong , Xinyu Ma , Shuaiqiang Wang , Dawei Yin , Maarten de Rijke , Zhaochun Ren , Yiming Yang

Composed Image Retrieval (CIR) aims to retrieve a target image based on a reference image and conditioning text, enabling controllable image searches. The mainstream Zero-Shot (ZS) CIR methods bypass the need for expensive training CIR…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Jaeseok Byun , Seokhyeon Jeong , Wonjae Kim , Sanghyuk Chun , Taesup Moon

Composed image retrieval attempts to retrieve an image of interest from gallery images through a composed query of a reference image and its corresponding modified text. It has recently attracted attention due to the collaboration of…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Shitong Sun , Fanghua Ye , Shaogang Gong

Composed Image Retrieval (CIR) represents a novel retrieval paradigm that is capable of expressing users' intricate retrieval requirements flexibly. It enables the user to give a multimodal query, comprising a reference image and a…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Zhiwei Chen , Yupeng Hu , Zixu Li , Zhiheng Fu , Xuemeng Song , Liqiang Nie

Composed Image Retrieval (CIR) is an important image retrieval paradigm that enables users to retrieve a target image using a multimodal query that consists of a reference image and modification text. Although research on CIR has made…

计算机视觉与模式识别 · 计算机科学 2026-04-27 Zixu Li , Yupeng Hu , Zhiheng Fu , Zhiwei Chen , Yongqi Li , Liqiang Nie

Zero-Shot Composed Image Retrieval (ZS-CIR) involves diverse tasks with a broad range of visual content manipulation intent across domain, scene, object, and attribute. The key challenge for ZS-CIR tasks is to modify a reference image…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Yuanmin Tang , Jing Yu , Keke Gai , Jiamin Zhuang , Gang Xiong , Gaopeng Gou , Qi Wu

This paper proposes a novel zero-shot composed image retrieval (CIR) method considering the query-target relationship by masked image-text pairs. The objective of CIR is to retrieve the target image using a query image and a query text.…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Huaying Zhang , Rintaro Yanagi , Ren Togo , Takahiro Ogawa , Miki Haseyama

Zero-shot Learning (ZSL) aims to enable classifiers to identify unseen classes. This is typically achieved by generating visual features for unseen classes based on learned visual-semantic correlations from seen classes. However, most…

计算机视觉与模式识别 · 计算机科学 2025-02-12 Zihan Ye , Shreyank N. Gowda , Xiaowei Huang , Haotian Xu , Yaochu Jin , Kaizhu Huang , Xiaobo Jin