English
Related papers

Related papers: Cross-modal Zero-shot Hashing

200 papers

Zero-Shot Learning (ZSL) is a classification task where we do not have even a single training labeled example from a set of unseen classes. Instead, we only have prior information (or description) about seen and unseen classes, often in the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Shabnam Daghaghi , Tharun Medini , Anshumali Shrivastava

Retrieving nearest neighbors across correlated data in multiple modalities, such as image-text pairs on Facebook and video-tag pairs on YouTube, has become a challenging task due to the huge amount of data. Multimodal hashing methods that…

Information Retrieval · Computer Science 2017-12-12 Dayong Tian , Maoguo Gong , Deyun Zhou , Jiao Shi , Yu Lei

Due to the lack of properly annotated medical data, exploring the generalization capability of the deep model is becoming a public concern. Zero-shot learning (ZSL) has emerged in recent years to equip the deep model with the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Cheng Bian , Chenglang Yuan , Kai Ma , Shuang Yu , Dong Wei , Yefeng Zheng

Cross-modal hashing is an important approach for multimodal data management and application. Existing unsupervised cross-modal hashing algorithms mainly rely on data features in pre-trained models to mine their similarity relationships.…

Information Retrieval · Computer Science 2022-07-12 Liang Li , Baihua Zheng , Weiwei Sun

Given the benefits of its low storage requirements and high retrieval efficiency, hashing has recently received increasing attention. In particular,cross-modal hashing has been widely and successfully used in multimedia similarity search…

Information Retrieval · Computer Science 2019-04-05 Cheng Deng , Zhaojia Chen , Xianglong Liu , Xinbo Gao , Dacheng Tao

As an important and challenging problem in computer vision, zero-shot learning (ZSL) aims at automatically recognizing the instances from unseen object classes without training data. To address this problem, ZSL is usually carried out in…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Yunlong Yu , Zhong Ji , Xi Li , Jichang Guo , Zhongfei Zhang , Haibin Ling , Fei Wu

Hashing is widely applied to approximate nearest neighbor search for large-scale multimodal retrieval with storage and computation efficiency. Cross-modal hashing improves the quality of hash coding by exploiting semantic correlations…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Yue Cao , Mingsheng Long , Jianmin Wang , Philip S. Yu

In this paper, we propose a novel approach for generalized zero-shot learning in a multi-modal setting, where we have novel classes of audio/video during testing that are not seen during training. We use the semantic relatedness of text…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Pratik Mazumder , Pravendra Singh , Kranti Kumar Parida , Vinay P. Namboodiri

Music classification and tagging is conducted through categorical supervised learning with a fixed set of labels. In principle, this cannot make predictions on unseen labels. Zero-shot learning is an approach to solve the problem by using…

Multimedia · Computer Science 2019-06-21 Jeong Choi , Jongpil Lee , Jiyoung Park , Juhan Nam

Recently, zero-shot learning (ZSL) has received increasing interest. The key idea underpinning existing ZSL approaches is to exploit knowledge transfer via an intermediate-level semantic representation which is assumed to be shared between…

Machine Learning · Computer Science 2015-03-30 Yanwei Fu , Yongxin Yang , Timothy M. Hospedales , Tao Xiang , Shaogang Gong

Deep hashing has recently received attention in cross-modal retrieval for its impressive advantages. However, existing hashing methods for cross-modal retrieval cannot fully capture the heterogeneous multi-modal correlation and exploit the…

Information Retrieval · Computer Science 2020-04-02 Li Wang , Lei Zhu , En Yu , Jiande Sun , Huaxiang Zhang

Hashing that projects data into binary codes has shown extraordinary talents in cross-modal retrieval due to its low storage usage and high query speed. Despite their empirical success on some scenarios, existing cross-modal hashing methods…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Yufeng Shi , Xinge You , Jiamiao Xu , Feng Zheng , Qinmu Peng , Weihua Ou

With the rapid growth of various types of multimodal data, cross-modal deep hashing has received broad attention for solving cross-modal retrieval problems efficiently. Most cross-modal hashing methods follow the traditional supervised…

Information Retrieval · Computer Science 2019-02-05 Shifeng Zhang , Jianmin Li , Bo Zhang

Hashing has been widely adopted for large-scale data retrieval in many domains, due to its low storage cost and high retrieval speed. Existing cross-modal hashing methods optimistically assume that the correspondence between training…

Machine Learning · Computer Science 2019-05-30 Xuanwu Liu , Jun Wang , Guoxian Yu , Carlotta Domeniconi , Xiangliang Zhang

Cross-modal hashing, favored for its effectiveness and efficiency, has received wide attention to facilitating efficient retrieval across different modalities. Nevertheless, most existing methods do not sufficiently exploit the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Xin Liu , Xingzhi Wang , Yiu-ming Cheung

We present a cross-modal Transformer-based framework, which jointly encodes video data and text labels for zero-shot action recognition (ZSAR). Our model employs a conceptually new pipeline by which visual representations are learned in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Chung-Ching Lin , Kevin Lin , Linjie Li , Lijuan Wang , Zicheng Liu

Due to their high retrieval efficiency and low storage cost for cross-modal search task, cross-modal hashing methods have attracted considerable attention. For the supervised cross-modal hashing methods, how to make the learned hash codes…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Rong-Cheng Tu , Xian-Ling Mao , Rongxin Tu , Binbin Bian , Wei Wei , Heyan Huang

Learning compact representation is vital and challenging for large scale multimedia data. Cross-view/cross-modal hashing for effective binary representation learning has received significant attention with exponentially growing availability…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Liu Liu , Hairong Qi

The Zero-Shot Learning (ZSL) task attempts to learn concepts without any labeled data. Unlike traditional classification/detection tasks, the evaluation environment is provided unseen classes never encountered during training. As such, it…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Abhijit Suprem

Zero-Shot Learning (ZSL) is typically achieved by resorting to a class semantic embedding space to transfer the knowledge from the seen classes to unseen ones. Capturing the common semantic characteristics between the visual modality and…

Computer Vision and Pattern Recognition · Computer Science 2018-04-23 Yunlong Yu , Zhong Ji , Jichang Guo , Zhongfei , Zhang