中文
相关论文

相关论文: Modality and Task Adaptation for Enhanced Zero-sho…

200 篇论文

The relations expressed in user queries are vital for cross-modal information retrieval. Relation-focused cross-modal retrieval aims to retrieve information that corresponds to these relations, enabling effective retrieval across different…

计算机视觉与模式识别 · 计算机科学 2023-07-31 Yan Gong , Georgina Cosma , Axel Finke

Composed Image Retrieval (CIR) is the task of retrieving a target image from a database using a multimodal query, which consists of a reference image and a modification text. The text specifies how to alter the reference image to form a…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Tong Wang , Yunhan Zhao , Shu Kong

Composed Image Retrieval (CIR) aims to retrieve target images based on a hybrid query comprising a reference image and a modification text. Early dual-tower Vision-Language Models (VLMs) struggle with cross-modality compositional reasoning…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Tianyu Yang , Chenwei He , Xiangzhao Hao , Tianyue Wang , Jiarui Guo , Haiyun Guo , Leigang Qu , Jinqiao Wang , Tat-Seng Chua

Composed image retrieval (CIR) is the task of retrieving specific images by using a query that involves both a reference image and a relative caption. Most existing CIR models adopt the late-fusion strategy to combine visual and language…

计算机视觉与模式识别 · 计算机科学 2023-10-10 Yang Bai , Xinxing Xu , Yong Liu , Salman Khan , Fahad Khan , Wangmeng Zuo , Rick Siow Mong Goh , Chun-Mei Feng

Composed Image Retrieval (CIR) seeks to find a target image using a multi-modal query, which combines an image with modification text to pinpoint the target. While recent CIR methods have shown promise, they mainly focus on exploring…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Peng Gao , Yujian Lee , Zailong Chen , Hui zhang , Xubo Liu , Yiyang Hu , Guquang Jing

Retrieval is being redefined by agentic AI, demanding multimodal reasoning beyond conventional similarity-based paradigms. Composed Image Retrieval (CIR) exemplifies this shift as each query combines a reference image with textual…

信息检索 · 计算机科学 2026-03-02 Zhongyu Yang , Wei Pang , Yingfang Yuan

Zero-shot sketch-based image retrieval typically asks for a trained model to be applied as is to unseen categories. In this paper, we question to argue that this setup by definition is not compatible with the inherent abstract and…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Aneeshan Sain , Ayan Kumar Bhunia , Vaishnav Potlapalli , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

In tissue characterization and cancer diagnostics, multimodal imaging has emerged as a powerful technique. Thanks to computational advances, large datasets can be exploited to discover patterns in pathologies and improve diagnosis. However,…

计算机视觉与模式识别 · 计算机科学 2023-03-21 Eva Breznik , Elisabeth Wetzer , Joakim Lindblad , Nataša Sladoje

Composed Image Retrieval (CIR) is a multimodal retrieval task where a query consists of a reference image and a textual modification, and the goal is to retrieve a target image satisfying both. In principle, strong performance on CIR…

Vision transformers in vision-language models typically use the same amount of compute for every image, regardless of whether it is simple or complex. We propose ICAR (Image Complexity-Aware Retrieval), an adaptive computation approach that…

信息检索 · 计算机科学 2026-01-16 Mikel Williams-Lekuona , Georgina Cosma

Zero-Shot Composed Image Retrieval (ZS-CIR) aims to retrieve target images by integrating information from a composed query (reference image and modification text) without training samples. Existing methods primarily combine caption models…

计算机视觉与模式识别 · 计算机科学 2025-03-03 Zelong Sun , Dong Jing , Zhiwu Lu

Composed Image Retrieval (CIR) aims to retrieve a target image based on a query composed of a reference image, and a relative caption that specifies the desired modification. Despite the rapid development of CIR models, their performance is…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Yikun Liu , Jiangchao Yao , Weidi Xie , Yanfeng Wang

Composed Image Retrieval (CIR) involves searching for target images based on an image-text pair query. While current methods treat this as a query-target matching problem, we argue that CIR triplets contain additional associations beyond…

计算机视觉与模式识别 · 计算机科学 2024-05-31 Xintong Jiang , Yaxiong Wang , Mengjian Li , Yujiao Wu , Bingwen Hu , Xueming Qian

Composed Image Retrieval (CIR) uses a reference image plus a natural-language edit to retrieve images that apply the requested change while preserving other relevant visual content. Classic fusion pipelines typically rely on supervised…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Guoyizhe Wei , Yang Jiao , Nan Xi , Zhishen Huang , Jingjing Meng , Rama Chellappa , Yan Gao

Composed Image Retrieval (CIR) facilitates image retrieval through a multimodal query consisting of a reference image and modification text. The reference image defines the retrieval context, while the modification text specifies desired…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Zixu Li , Zhiheng Fu , Yupeng Hu , Zhiwei Chen , Haokun Wen , Liqiang Nie

Composed Image Retrieval (CIR) is a flexible image retrieval paradigm that enables users to accurately locate the target image through a multimodal query composed of a reference image and modification text. Although this task has…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Zixu Li , Yupeng Hu , Zhiwei Chen , Shiqi Zhang , Qinlei Huang , Zhiheng Fu , Yinwei Wei

Composed image retrieval (CIR) aims to retrieve the target image based on a multimodal query, i.e., a reference image paired with corresponding modification text. Recent CIR studies leverage vision-language pre-trained (VLP) methods as the…

多媒体 · 计算机科学 2024-04-25 Haokun Wen , Xuemeng Song , Xiaolin Chen , Yinwei Wei , Liqiang Nie , Tat-Seng Chua

Composed Image Retrieval (CIR), which aims to find a target image from a reference image and a modification text, presents the core challenge of performing unified reasoning across visual and semantic modalities. While current approaches…

计算机视觉与模式识别 · 计算机科学 2025-10-10 Weihuang Lin , Yiwei Ma , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

As a fundamental and challenging task in bridging language and vision domains, Image-Text Retrieval (ITR) aims at searching for the target instances that are semantically relevant to the given query from the other modality, and its key…

计算机视觉与模式识别 · 计算机科学 2023-01-18 Yan Zhang , Zhong Ji , Di Wang , Yanwei Pang , Xuelong Li

Cross-modal text-molecule retrieval model aims to learn a shared feature space of the text and molecule modalities for accurate similarity calculation, which facilitates the rapid screening of molecules with specific properties and…

信息检索 · 计算机科学 2024-11-01 Jia Song , Wanru Zhuang , Yujie Lin , Liang Zhang , Chunyan Li , Jinsong Su , Song He , Xiaochen Bo