中文
相关论文

相关论文: An Efficient Framework for Zero-Shot Sketch-Based …

200 篇论文

Composed Image Retrieval (CIR) aims to retrieve a target image from a query composed of a reference image and modification text. Recent training-free zero-shot methods often employ Multimodal Large Language Models (MLLMs) with…

信息检索 · 计算机科学 2026-02-06 Yi Sun , Jinyu Xu , Qing Xie , Jiachen Li , Yanchun Ma , Yongjian Liu

This paper tackles the Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) problem from the viewpoint of cross-modality metric learning. This task has two characteristics: 1) the zero-shot setting requires a metric space with good within-class…

计算机视觉与模式识别 · 计算机科学 2021-12-17 Zongheng Huang , YiFan Sun , Chuchu Han , Changxin Gao , Nong Sang

Zero-shot image recognition (ZSIR) aims to recognize and reason in unseen domains by learning generalized knowledge from limited data in the seen domain. The gist of ZSIR is constructing a well-aligned mapping between the input visual space…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Jingcai Guo , Zhijie Rao , Zhi Chen , Song Guo , Jingren Zhou , Dacheng Tao

We address the challenges inherent in sketch-based image retrieval (SBIR) across various settings, including zero-shot SBIR, generalized zero-shot SBIR, and fine-grained zero-shot SBIR, by leveraging the vision-language foundation model…

计算机视觉与模式识别 · 计算机科学 2024-07-24 Mainak Singha , Ankit Jha , Divyam Gupta , Pranav Singla , Biplab Banerjee

Zero-Shot Sketch-Based Image Retrieval (ZSSBIR) is an emerging task. The pioneering work focused on the modal gap but ignored inter-class information. Although recent work has begun to consider the triplet-based or contrast-based loss to…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Haoxiang Zhang , He Jiang , Ziqiang Wang , Deqiang Cheng

Low-shot sketch-based image retrieval is an emerging task in computer vision, allowing to retrieve natural images relevant to hand-drawn sketch queries that are rarely seen during the training phase. Related prior works either require…

计算机视觉与模式识别 · 计算机科学 2020-06-23 Anjan Dutta , Zeynep Akata

Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) aims to minimize the distance between sketches and corresponding images in the embedding space. However, scalability is hindered by the growing complexity of solutions, mainly due to the…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Jianan Jiang , Hao Tang , Zhilin Jiang , Weiren Yu , Di Wu

This paper, for the first time, explores text-to-image diffusion models for Zero-Shot Sketch-based Image Retrieval (ZS-SBIR). We highlight a pivotal discovery: the capacity of text-to-image diffusion models to seamlessly bridge the gap…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Subhadeep Koley , Ayan Kumar Bhunia , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Composed image retrieval attempts to retrieve an image of interest from gallery images through a composed query of a reference image and its corresponding modified text. It has recently attracted attention due to the collaboration of…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Shitong Sun , Fanghua Ye , Shaogang Gong

Sketch-Based Image Retrieval (SBIR) is a crucial task in multimedia retrieval, where the goal is to retrieve a set of images that match a given sketch query. Researchers have already proposed several well-performing solutions for this task,…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Omar Seddati , Nathan Hubens , Stéphane Dupont , Thierry Dutoit

Fine-grained sketch-based image retrieval (FG-SBIR) addresses the problem of retrieving a particular photo instance given a user's query sketch. Its widespread applicability is however hindered by the fact that drawing a sketch takes time,…

计算机视觉与模式识别 · 计算机科学 2020-05-13 Ayan Kumar Bhunia , Yongxin Yang , Timothy M. Hospedales , Tao Xiang , Yi-Zhe Song

We study the zero-shot Composed Image Retrieval (ZS-CIR) task, which is to retrieve the target image given a reference image and a description without training on the triplet datasets. Previous works generate pseudo-word tokens by…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Yucheng Suo , Fan Ma , Linchao Zhu , Yi Yang

Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) aims at finding a specific image from a large gallery given a query sketch. Despite the widespread applicability of FG-SBIR in many critical domains (e.g., crime activity tracking),…

计算机视觉与模式识别 · 计算机科学 2021-11-23 Dingrong Wang , Hitesh Sapkota , Xumin Liu , Qi Yu

Sketch-based image retrieval (SBIR) associates hand-drawn sketches with their corresponding realistic images. In this study, we aim to tackle two major challenges of this task simultaneously: i) zero-shot, dealing with unseen categories,…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Liying Gao , Bingliang Jiao , Peng Wang , Shizhou Zhang , Hanwang Zhang , Yanning Zhang

Current Zero-Shot Learning (ZSL) approaches are restricted to recognition of a single dominant unseen object category in a test image. We hypothesize that this setting is ill-suited for real-world applications where unseen objects appear…

计算机视觉与模式识别 · 计算机科学 2019-04-12 Shafin Rahman , Salman Khan , Fatih Porikli

Sketch-based image retrieval (SBIR) is a challenging task due to the large cross-domain gap between sketches and natural images. How to align abstract sketches and natural images into a common high-level semantic space remains a key problem…

计算机视觉与模式识别 · 计算机科学 2019-11-13 Jianjun Lei , Yuxin Song , Bo Peng , Zhanyu Ma , Ling Shao , Yi-Zhe Song

The recent focus on Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) has shifted towards generalising a model to new categories without any training data from them. In real-world applications, however, a trained FG-SBIR model is often…

计算机视觉与模式识别 · 计算机科学 2022-08-22 Ayan Kumar Bhunia , Aneeshan Sain , Parth Shah , Animesh Gupta , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

The ability to retrieve a photo by mere free-hand sketching highlights the immense potential of Fine-grained sketch-based image retrieval (FG-SBIR). However, its rapid practical adoption, as well as scalability, is limited by the expense of…

计算机视觉与模式识别 · 计算机科学 2023-09-19 Himanshu Thakur , Soumitri Chattopadhyay

Zero-shot learning (ZSL) for image classification focuses on recognizing novel categories that have no labeled data available for training. The learning is generally carried out with the help of mid-level semantic descriptors associated…

计算机视觉与模式识别 · 计算机科学 2019-03-29 Debasmit Das , C. S. George Lee

Generalized Zero-Shot Learning (GZSL) and Open-Set Recognition (OSR) are two mainstream settings that greatly extend conventional visual object recognition. However, the limitations of their problem settings are not negligible. The novel…

计算机视觉与模式识别 · 计算机科学 2023-02-10 Zhaonan Li , Hongfu Liu