English
Related papers

Related papers: Semantically Tied Paired Cycle Consistency for Zer…

200 papers

The existing zero-shot detection approaches project visual features to the semantic domain for seen objects, hoping to map unseen objects to their corresponding semantics during inference. However, since the unseen objects are never…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Nasir Hayat , Munawar Hayat , Shafin Rahman , Salman Khan , Syed Waqas Zamir , Fahad Shahbaz Khan

The application of zero-shot learning in computer vision has been revolutionized by the use of image-text matching models. The most notable example, CLIP, has been widely used for both zero-shot classification and guiding generative models…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Roni Paiss , Hila Chefer , Lior Wolf

Leveraging class semantic descriptions and examples of known objects, zero-shot learning makes it possible to train a recognition model for an object class whose examples are not available. In this paper, we propose a novel zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Soravit Changpinyo , Wei-Lun Chao , Fei Sha

Several recent publications have proposed methods for mapping images into continuous semantic embedding spaces. In some cases the embedding space is trained jointly with the image transformation. In other cases the semantic embedding space…

Machine Learning · Computer Science 2017-02-28 Mohammad Norouzi , Tomas Mikolov , Samy Bengio , Yoram Singer , Jonathon Shlens , Andrea Frome , Greg S. Corrado , Jeffrey Dean

The explosive increase and ubiquitous accessibility of visual data on the Web have led to the prosperity of research activity in image search or retrieval. With the ignorance of visual content as a ranking clue, methods with text search…

Multimedia · Computer Science 2017-09-05 Wengang Zhou , Houqiang Li , Qi Tian

To see is to sketch -- free-hand sketching naturally builds ties between human and machine vision. In this paper, we present a novel approach for translating an object photo to a sketch, mimicking the human sketching process. This is an…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Jifei Song , Kaiyue Pang , Yi-Zhe Song , Tao Xiang , Timothy Hospedales

In cross-domain retrieval, a model is required to identify images from the same semantic category across two visual domains. For instance, given a sketch of an object, a model needs to retrieve a real image of it from an online store's…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Samarth Mishra , Carlos D. Castillo , Hongcheng Wang , Kate Saenko , Venkatesh Saligrama

The objective of Content-Based Image Retrieval (CBIR) methods is essentially to extract, from large (image) databases, a specified number of images similar in visual and semantic content to a so-called query image. To bridge the semantic…

Information Retrieval · Computer Science 2015-02-12 Smarajit Bose , Amita Pal , Jhimli Mallick , Sunil Kumar , Pratyaydipta Rudra

As a new communication paradigm, semantic communication has received widespread attention in communication fields. However, since the decoding of semantic signals relies on contextual knowledge, misalignment between the starting position of…

Signal Processing · Electrical Eng. & Systems 2023-12-19 Xiaoyi Liu , Haotai Liang , Chen Dong , Xiaodong Xu

Zero-shot Panoptic Segmentation (ZPS) aims to recognize foreground instances and background stuff without images containing unseen categories in training. Due to the visual data sparsity and the difficulty of generalizing from seen to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jialei Chen , Daisuke Deguchi , Chenkai Zhang , Hiroshi Murase

Content-Based Image Retrieval (CIR) aims to search for a target image by concurrently comprehending the composition of an example image and a complementary text, which potentially impacts a wide variety of real-world applications, such as…

Artificial Intelligence · Computer Science 2022-07-12 Wenqiao Zhang , Jiannan Guo , Mengze Li , Haochen Shi , Shengyu Zhang , Juncheng Li , Siliang Tang , Yueting Zhuang

The performance of face photo-sketch translation has improved a lot thanks to deep neural networks. GAN based methods trained on paired images can produce high-quality results under laboratory settings. Such paired datasets are, however,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Chaofeng Chen , Wei Liu , Xiao Tan , Kwan-Yee K. Wong

Zero-Shot Classification (ZSC) equips the learned model with the ability to recognize the visual instances from the novel classes via constructing the interactions between the visual and the semantic modalities. In contrast to the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Zhong Ji , Xuejie Yu , Yunlong Yu , Yanwei Pang , Zhongfei Zhang

Existing neural information retrieval (IR) models have often been studied in homogeneous and narrow settings, which has considerably limited insights into their out-of-distribution (OOD) generalization capabilities. To address this, and to…

Information Retrieval · Computer Science 2021-10-22 Nandan Thakur , Nils Reimers , Andreas Rücklé , Abhishek Srivastava , Iryna Gurevych

Convolutional neural networks (CNNs) have been successfully applied to solve the problem of correspondence estimation between semantically related images. Due to non-availability of large training datasets, existing methods resort to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Zakaria Laskar , Juho Kannala

Existing methods using generative adversarial approaches for Zero-Shot Learning (ZSL) aim to generate realistic visual features from class semantics by a single generative network, which is highly under-constrained. As a result, the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Zhi Chen , Jingjing Li , Yadan Luo , Zi Huang , Yang Yang

Content-Based Image Retrieval (CBIR) locates, retrieves and displays images alike to one given as a query, using a set of features. It demands accessible data in medical archives and from medical equipment, to infer meaning after some…

Computer Vision and Pattern Recognition · Computer Science 2016-10-11 Albany E. Herrmann , Vania Vieira Estrela

The amount of medical images stored in hospitals is increasing faster than ever; however, utilizing the accumulated medical images has been limited. This is because existing content-based medical image retrieval (CBMIR) systems usually…

In this paper, we propose a novel abstraction-aware sketch-based image retrieval framework capable of handling sketch abstraction at varied levels. Prior works had mainly focused on tackling sub-factors such as drawing style and order, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Subhadeep Koley , Ayan Kumar Bhunia , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Composed Image Retrieval (CIR) is a challenging image retrieval paradigm. It aims to retrieve target images from large-scale image databases that are consistent with the modification semantics, based on a multimodal query composed of a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Mingyu Zhang , Zixu Li , Zhiwei Chen , Zhiheng Fu , Xiaowei Zhu , Jiajia Nie , Yinwei Wei , Yupeng Hu