English
Related papers

Related papers: A Zero-Shot Framework for Sketch-based Image Retri…

200 papers

Zero-Shot Composed Image Retrieval (ZS-CIR) involves diverse tasks with a broad range of visual content manipulation intent across domain, scene, object, and attribute. The key challenge for ZS-CIR tasks is to modify a reference image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yuanmin Tang , Jing Yu , Keke Gai , Jiamin Zhuang , Gang Xiong , Gaopeng Gou , Qi Wu

Sketch-based 3D shape retrieval is a challenging task due to the large domain discrepancy between sketches and 3D shapes. Since existing methods are trained and evaluated on the same categories, they cannot effectively recognize the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Rui Xu , Zongyan Han , Le Hui , Jianjun Qian , Jin Xie

Sketching and stochastic gradient methods are arguably the most common techniques to derive efficient large scale learning algorithms. In this paper, we investigate their application in the context of nonparametric statistical learning.…

Machine Learning · Statistics 2019-01-25 Luigi Carratino , Alessandro Rudi , Lorenzo Rosasco

Sketching enables many exciting applications, notably, image retrieval. The fear-to-sketch problem (i.e., "I can't sketch") has however proven to be fatal for its widespread adoption. This paper tackles this "fear" head on, and for the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ayan Kumar Bhunia , Subhadeep Koley , Abdullah Faiz Ur Rahman Khilji , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Pre-trained vision-language models (VLMs) excel in multimodal tasks, commonly encoding images as embedding vectors for storage in databases and retrieval via approximate nearest neighbor search (ANNS). However, these models struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Ofer Idan , Vladi Vexler , Gil Lederman , Dima Sivov , Aviad Cohen Zada , Shir Niego Komforti

Given a query consisting of a reference image and a relative caption, Composed Image Retrieval (CIR) aims to retrieve target images visually similar to the reference one while incorporating the changes specified in the relative caption. The…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Lorenzo Agnolucci , Alberto Baldrati , Alberto Del Bimbo , Marco Bertini

Composed image retrieval (CIR) is the task of retrieving a target image specified by a query image and a relative text that describes a semantic modification to the query image. Existing methods in CIR struggle to accurately represent the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Eric Xing , Pranavi Kolouju , Robert Pless , Abby Stylianou , Nathan Jacobs

Zero-shot learning (ZSL) which aims to recognize unseen classes with no labeled training sample, efficiently tackles the problem of missing labeled data in image retrieval. Nowadays there are mainly two types of popular methods for ZSL to…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Gang Yang , Jinlu Liu , Xirong Li

Composed image retrieval (CIR) is a new and flexible image retrieval paradigm, which can retrieve the target image for a multimodal query, including a reference image and its corresponding modification text. Although existing efforts have…

Multimedia · Computer Science 2023-09-06 Haokun Wen , Xian Zhang , Xuemeng Song , Yinwei Wei , Liqiang Nie

In this paper we address the problem of learning robust cross-domain representations for sketch-based image retrieval (SBIR). While most SBIR approaches focus on extracting low- and mid-level descriptors for direct feature matching, recent…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Dan Xu , Xavier Alameda-Pineda , Jingkuan Song , Elisa Ricci , Nicu Sebe

Scene understanding and reasoning has been a fundamental problem in 3D computer vision, requiring models to identify objects, their properties, and spatial or comparative relationships among the objects. Existing approaches enable this by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Vivek Madhavaram , Vartika Sengar , Arkadipta De , Charu Sharma

Composed Image Retrieval (CIR) is a pivotal and complex task in multimodal understanding. Current CIR benchmarks typically feature limited query categories and fail to capture the diverse requirements of real-world scenarios. To bridge this…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Tingyu Song , Yanzhao Zhang , Mingxin Li , Zhuoning Guo , Dingkun Long , Pengjun Xie , Siyue Zhang , Yilun Zhao , Shu Wu

Content-Based Image Retrieval (CBIR) systems have been widely used for a wide range of applications such as Art collections, Crime prevention and Intellectual property. In this paper, a novel CBIR system, which utilizes visual contents…

Computer Vision and Pattern Recognition · Computer Science 2017-03-23 I. M. El-Henawy , Kareem Ahmed

This paper studies the problem of generalized zero-shot learning which requires the model to train on image-label pairs from some seen classes and test on the task of classifying new images from both seen and unseen classes. Most previous…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 He Huang , Changhu Wang , Philip S. Yu , Chang-Dong Wang

Composed Image Retrieval (CIR) aims to retrieve target images that closely resemble a reference image while integrating user-specified textual modifications, thereby capturing user intent more precisely. Existing training-free zero-shot CIR…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Yuanmin Tang , Xiaoting Qin , Jue Zhang , Jing Yu , Gaopeng Gou , Gang Xiong , Qingwei Ling , Saravan Rajmohan , Dongmei Zhang , Qi Wu

The study of neural generative models of human sketches is a fascinating contemporary modeling problem due to the links between sketch image generation and the human drawing process. The landmark SketchRNN provided breakthrough by…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Ayan Das , Yongxin Yang , Timothy Hospedales , Tao Xiang , Yi-Zhe Song

This paper proposes a content based image retrieval (CBIR) system using the local colour and texture features of selected image sub-blocks and global colour and shape features of the image. The image sub-blocks are roughly identified by…

Information Retrieval · Computer Science 2013-07-08 E. R. Vimina , K. Poulose Jacob

Sketches reflect the drawing style of individual artists; therefore, it is important to consider their unique styles when extracting sketches from color images for various applications. Unfortunately, most existing sketch extraction methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Chang Wook Seo , Amirsaman Ashtari , Junyong Noh

Sketches make an intuitive and powerful visual expression as they are fast executed freehand drawings. We present a method for synthesizing realistic photos from scene sketches. Without the need for sketch and photo pairs, our framework…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Jiayun Wang , Sangryul Jeon , Stella X. Yu , Xi Zhang , Himanshu Arora , Yu Lou

The Composed Image Retrieval (CIR) task aims to retrieve target images using a composed query consisting of a reference image and a modified text. Advanced methods often utilize contrastive learning as the optimization objective, which…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Zhangchi Feng , Richong Zhang , Zhijie Nie