English
Related papers

Related papers: Multi-granularity Association Learning Framework f…

200 papers

We present an algorithm for searching image collections using free-hand sketches that describe the appearance and relative positions of multiple objects. Sketch based image retrieval (SBIR) methods predominantly match queries containing a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Alexander Black , Tu Bui , Long Mai , Hailin Jin , John Collomosse

Composed Image Retrieval (CIR) is a challenging task that aims to retrieve the target image with a multimodal query, i.e., a reference image, and its complementary modification text. As previous supervised or zero-shot learning paradigms…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Bohan Hou , Haoqiang Lin , Haokun Wen , Meng Liu , Mingzhu Xu , Xuemeng Song

This paper proposes a novel approach for Sketch-Based Image Retrieval (SBIR), for which the key is to bridge the gap between sketches and photos in terms of the data representation. Inspired by channel-wise attention explored in recent…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Peng Lu , Gao Huang , Hangyu Lin , Wenming Yang , Guodong Guo , Yanwei Fu

We consider feature selection for applications in machine learning where the dimensionality of the data is so large that it exceeds the working memory of the (local) computing machine. Unfortunately, current large-scale sketching algorithms…

Machine Learning · Computer Science 2021-05-27 Amirali Aghazadeh , Vipul Gupta , Alex DeWeese , O. Ozan Koyluoglu , Kannan Ramchandran

Fine-grained image retrieval (FGIR) is to learn visual representations that distinguish visually similar objects while maintaining generalization. Existing methods propose to generate discriminative features, but rarely consider the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Xin Jiang , Hao Tang , Rui Yan , Jinhui Tang , Zechao Li

Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) is a novel cross-modal retrieval task, where abstract sketches are used as queries to retrieve natural images under zero-shot scenario. Most existing methods regard ZS-SBIR as a traditional…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Zhipeng Wang , Hao Wang , Jiexi Yan , Aming Wu , Cheng Deng

We scrutinise an important observation plaguing scene-level sketch research -- that a significant portion of scene sketches are "partial". A quick pilot study reveals: (i) a scene sketch does not necessarily contain all objects in the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Pinaki Nath Chowdhury , Ayan Kumar Bhunia , Viswanatha Reddy Gajjala , Aneeshan Sain , Tao Xiang , Yi-Zhe Song

Zero-shot sketch-based image retrieval (ZS-SBIR) is a specific cross-modal retrieval task for searching natural images given free-hand sketches under the zero-shot scenario. Most existing methods solve this problem by simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Xinxun Xu , Muli Yang , Yanhua Yang , Hao Wang

In recent years, text-to-video retrieval methods based on CLIP have experienced rapid development. The primary direction of evolution is to exploit the much wider gamut of visual and textual cues to achieve alignment. Concretely, those…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Kaibin Tian , Yanhua Cheng , Yi Liu , Xinglin Hou , Quan Chen , Han Li

This paper tackles the Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) problem from the viewpoint of cross-modality metric learning. This task has two characteristics: 1) the zero-shot setting requires a metric space with good within-class…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Zongheng Huang , YiFan Sun , Chuchu Han , Changxin Gao , Nong Sang

Sketch-based image retrieval (SBIR) is the task of retrieving natural images (photos) that match the semantics and the spatial configuration of hand-drawn sketch queries. The universality of sketches extends the scope of possible…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Omar Seddati , Stéphane Dupont , Saïd Mahmoudi , Thierry Dutoit

Zero-Shot Sketch-Based Image Retrieval (ZSSBIR) is an emerging task. The pioneering work focused on the modal gap but ignored inter-class information. Although recent work has begun to consider the triplet-based or contrast-based loss to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Haoxiang Zhang , He Jiang , Ziqiang Wang , Deqiang Cheng

Current methods for searching brain MR images rely on text-based approaches, highlighting a significant need for content-based image retrieval (CBIR) systems. Directly applying 3D brain MR images to machine learning models offers the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Shuhei Tomoshige , Hayato Muraki , Kenichi Oishi , Hitoshi Iyatomi

The efficacy of zero-shot sketch-based image retrieval (ZS-SBIR) models is governed by two challenges. The immense distributions-gap between the sketches and the images requires a proper domain alignment. Moreover, the fine-grained nature…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Ushasi Chaudhuri , Ruchika Chavan , Biplab Banerjee , Anjan Dutta , Zeynep Akata

This paper proposes a content based image retrieval (CBIR) system using the local colour and texture features of selected image sub-blocks and global colour and shape features of the image. The image sub-blocks are roughly identified by…

Information Retrieval · Computer Science 2013-07-08 E. R. Vimina , K. Poulose Jacob

Zero-shot sketch-based image retrieval typically asks for a trained model to be applied as is to unseen categories. In this paper, we question to argue that this setup by definition is not compatible with the inherent abstract and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Aneeshan Sain , Ayan Kumar Bhunia , Vaishnav Potlapalli , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Sketch-based image retrieval (SBIR) has undergone an increasing interest in the community of computer vision bringing high impact in real applications. For instance, SBIR brings an increased benefit to eCommerce search engines because it…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Pablo Torres , Jose M. Saavedra

Pre-trained vision-language models (VLMs) excel in multimodal tasks, commonly encoding images as embedding vectors for storage in databases and retrieval via approximate nearest neighbor search (ANNS). However, these models struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Ofer Idan , Vladi Vexler , Gil Lederman , Dima Sivov , Aviad Cohen Zada , Shir Niego Komforti

CLIP has shown impressive results in aligning images and texts at scale. However, its ability to capture detailed visual features remains limited because CLIP matches images and texts at a global level. To address this issue, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Rui Xiao , Sanghwan Kim , Mariana-Iuliana Georgescu , Zeynep Akata , Stephan Alaniz

Generating reliable pseudo masks from image-level labels is challenging in the weakly supervised semantic segmentation (WSSS) task due to the lack of spatial information. Prevalent class activation map (CAM)-based solutions are challenged…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Xu Yin , Woobin Im , Dongbo Min , Yuchi Huo , Fei Pan , Sung-Eui Yoon