English
Related papers

Related papers: Cross-Modality Hashing with Partial Correspondence

200 papers

The abundance of multimodal data (e.g. social media posts) has inspired interest in cross-modal retrieval methods. Popular approaches rely on a variety of metric learning losses, which prescribe what the proximity of image and text should…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Christopher Thomas , Adriana Kovashka

Hashing that projects data into binary codes has shown extraordinary talents in cross-modal retrieval due to its low storage usage and high query speed. Despite their empirical success on some scenarios, existing cross-modal hashing methods…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Yufeng Shi , Xinge You , Jiamiao Xu , Feng Zheng , Qinmu Peng , Weihua Ou

In recent years, cross-modal retrieval has drawn much attention due to the rapid growth of multimodal data. It takes one type of data as the query to retrieve relevant data of another type. For example, a user can use a text to retrieve…

Multimedia · Computer Science 2016-07-22 Kaiye Wang , Qiyue Yin , Wei Wang , Shu Wu , Liang Wang

Cross-modal retrieval deals with retrieving relevant items from one modality, when provided with a search query from another modality. Hashing techniques, where the data is represented as binary bits have specifically gained importance due…

Computer Vision and Pattern Recognition · Computer Science 2020-02-04 Devraj Mandal , Soma Biswas

Cross-modal hashing is a promising approach for efficient data retrieval and storage optimization. However, contemporary methods exhibit significant limitations in semantic preservation, contextual integrity, and information redundancy,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Qiang Zou , Shuli Cheng , Jiayi Chen

Due to their high retrieval efficiency and low storage cost, cross-modal hashing methods have attracted considerable attention. Generally, compared with shallow cross-modal hashing methods, deep cross-modal hashing methods can achieve a…

Information Retrieval · Computer Science 2019-07-30 Rong-Cheng Tu , Xian-Ling Mao , Bing Ma , Yong Hu , Tan Yan , Wei Wei , Heyan Huang

Thanks to the success of deep learning, cross-modal retrieval has made significant progress recently. However, there still remains a crucial bottleneck: how to bridge the modality gap to further enhance the retrieval accuracy. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Chao Li , Cheng Deng , Ning Li , Wei Liu , Xinbo Gao , Dacheng Tao

Feature modeling of different modalities is a basic problem in current research of cross-modal information retrieval. Existing models typically project texts and images into one embedding space, in which semantically similar information…

Multimedia · Computer Science 2019-06-13 Jing Yu , Chenghao Yang , Zengchang Qin , Zhuoqian Yang , Yue Hu , Weifeng Zhang

The widespread presence of hate speech on the internet, including formats such as text-based tweets and vision-language memes, poses a significant challenge to digital platform safety. Recent research has developed detection models tailored…

Computation and Language · Computer Science 2024-10-10 Ming Shan Hee , Aditi Kumaresan , Roy Ka-Wei Lee

Due to abundance of data from multiple modalities, cross-modal retrieval tasks with image-text, audio-image, etc. are gaining increasing importance. Of the different approaches proposed, supervised methods usually give significant…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Devraj Mandal , Pramod Rao , Soma Biswas

Many retrieval applications can benefit from multiple modalities, e.g., text that contains images on Wikipedia, for which how to represent multimodal data is the critical component. Most deep multimodal learning methods typically involve…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Haien Zeng , Hanjiang Lai , Hanlu Chu , Yong Tang , Jian Yin

Hashing techniques have been applied broadly in retrieval tasks due to their low storage requirements and high speed of processing. Many hashing methods based on a single view have been extensively studied for information retrieval.…

Machine Learning · Computer Science 2020-01-07 Jun Yu , Xiao-Jun Wu , Josef Kittler

Cross-modal retrieval aims to retrieve relevant data across different modalities (e.g., texts vs. images). The common strategy is to apply element-wise constraints between manually labeled pair-wise items to guide the generators to learn…

Multimedia · Computer Science 2019-04-18 Xin Wen , Zhizhong Han , Xinyu Yin , Yu-Shen Liu

Known for efficient computation and easy storage, hashing has been extensively explored in cross-modal retrieval. The majority of current hashing models are predicated on the premise of a direct one-to-one mapping between data points.…

Information Retrieval · Computer Science 2024-05-29 Jianzong Wang , Haoxiang Shi , Kaiyi Luo , Xulong Zhang , Ning Cheng , Jing Xiao

Hashing method maps similar high-dimensional data to binary hashcodes with smaller hamming distance, and it has received broad attention due to its low storage cost and fast retrieval speed. Pairwise similarity is easily obtained and widely…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Shifeng Zhang , Jianmin Li , Bo Zhang

Learning-based hashing methods are widely used for nearest neighbor retrieval, and recently, online hashing methods have demonstrated good performance-complexity trade-offs by learning hash functions from streaming data. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Fatih Cakir , Kun He , Sarah Adel Bargal , Stan Sclaroff

The cross-media retrieval problem has received much attention in recent years due to the rapid increasing of multimedia data on the Internet. A new approach to the problem has been raised which intends to match features of different…

Multimedia · Computer Science 2015-12-18 Cuicui Kang , Shengcai Liao , Yonghao He , Jian Wang , Wenjia Niu , Shiming Xiang , Chunhong Pan

In this paper, we propose a novel deep generative approach to cross-modal retrieval to learn hash functions in the absence of paired training samples through the cycle consistency loss. Our proposed approach employs adversarial training…

Computer Vision and Pattern Recognition · Computer Science 2018-12-26 Lin Wu , Yang Wang , Ling Shao

In this paper we introduce a novel hash learning framework that has two main distinguishing features, when compared to past approaches. First, it utilizes codewords in the Hamming space as ancillary means to accomplish its hash learning…

Machine Learning · Computer Science 2015-08-19 Yinjie Huang , Michael Georgiopoulos , Georgios C. Anagnostopoulos

Online hashing methods usually learn the hash functions online, aiming to efficiently adapt to the data variations in the streaming environment. However, when the hash functions are updated, the binary codes for the whole database have to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Zhenyu Weng , Yuesheng Zhu