English
Related papers

Related papers: Efficient Cross-Modal Retrieval via Deep Binary Ha…

200 papers

Current state-of-the-art approaches to cross-modal retrieval process text and visual input jointly, relying on Transformer-based architectures with cross-attention mechanisms that attend over all words and objects in an image. While…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Gregor Geigle , Jonas Pfeiffer , Nils Reimers , Ivan Vulić , Iryna Gurevych

Cross-modal hashing is a successful method to solve large-scale multimedia retrieval issue. A lot of matrix factorization-based hashing methods are proposed. However, the existing methods still struggle with a few problems, such as how to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Wenyun Li , Chi-Man Pun

In the real world, multi-modal data often appears in a streaming fashion, and there is a growing demand for similarity retrieval from such non-stationary data, especially at a large scale. In response to this need, online multi-modal…

Multimedia · Computer Science 2024-06-18 Yu-Wei Zhan , Xiao-Ming Wu , Xin Luo , Yinwei Wei , Xin-Shun Xu

``Learning to hash'' is a practical solution for efficient retrieval, offering fast search speed and low storage cost. It is widely applied in various applications, such as image-text cross-modal search. In this paper, we explore the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Young Kyun Jang , Donghyun Kim , Ser-nam Lim

Hashing has been widely studied for big data retrieval due to its low storage cost and fast query speed. Zero-shot hashing (ZSH) aims to learn a hashing model that is trained using only samples from seen categories, but can generalize well…

Machine Learning · Computer Science 2019-08-21 Xuanwu Liu , Zhao Li , Jun Wang , Guoxian Yu , Carlotta Domeniconi , Xiangliang Zhang

Due to their high retrieval efficiency and low storage cost for cross-modal search task, cross-modal hashing methods have attracted considerable attention. For the supervised cross-modal hashing methods, how to make the learned hash codes…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Rong-Cheng Tu , Xian-Ling Mao , Rongxin Tu , Binbin Bian , Wei Wei , Heyan Huang

Embedding image features into a binary Hamming space can improve both the speed and accuracy of large-scale query-by-example image retrieval systems. Supervised hashing aims to map the original features to compact binary codes in a manner…

Machine Learning · Computer Science 2016-11-17 Guosheng Lin , Chunhua Shen , Anton van den Hengel

Hashing has been widely adopted for large-scale data retrieval in many domains, due to its low storage cost and high retrieval speed. Existing cross-modal hashing methods optimistically assume that the correspondence between training…

Machine Learning · Computer Science 2019-05-30 Xuanwu Liu , Jun Wang , Guoxian Yu , Carlotta Domeniconi , Xiangliang Zhang

Recent years have seen the exponential growth of heterogeneous multimedia data. The need for effective and accurate data retrieval from heterogeneous data sources has attracted much research interest in cross-media retrieval. Here, given a…

Computer Vision and Pattern Recognition · Computer Science 2016-03-21 Xiangyu Wang , Alex Yong-Sang Chia

Cross-modal hashing is usually regarded as an effective technique for large-scale textual-visual cross retrieval, where data from different modalities are mapped into a shared Hamming space for matching. Most of the traditional…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Yuming Shen , Li Liu , Ling Shao , Jingkuan Song

Many retrieval applications can benefit from multiple modalities, e.g., text that contains images on Wikipedia, for which how to represent multimodal data is the critical component. Most deep multimodal learning methods typically involve…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Haien Zeng , Hanjiang Lai , Hanlu Chu , Yong Tang , Jian Yin

The development of cross-modal retrieval systems that can search and retrieve semantically relevant data across different modalities based on a query in any modality has attracted great attention in remote sensing (RS). In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Georgii Mikriukov , Mahdyar Ravanbakhsh , Begüm Demir

Cross-modal hashing, favored for its effectiveness and efficiency, has received wide attention to facilitating efficient retrieval across different modalities. Nevertheless, most existing methods do not sufficiently exploit the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Xin Liu , Xingzhi Wang , Yiu-ming Cheung

Due to the availability of large-scale multi-modal data (e.g., satellite images acquired by different sensors, text sentences, etc) archives, the development of cross-modal retrieval systems that can search and retrieve semantically…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Georgii Mikriukov , Mahdyar Ravanbakhsh , Begüm Demir

Deep online cross-modal hashing has gained much attention from researchers recently, as its promising applications with low storage requirement, fast retrieval efficiency and cross modality adaptive, etc. However, there still exists some…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Jiaxing Li , Lin Jiang , Zeqi Ma , Kaihang Jiang , Xiaozhao Fang , Jie Wen

In this paper, we propose a novel deep generative approach to cross-modal retrieval to learn hash functions in the absence of paired training samples through the cycle consistency loss. Our proposed approach employs adversarial training…

Computer Vision and Pattern Recognition · Computer Science 2018-12-26 Lin Wu , Yang Wang , Ling Shao

The cross-media retrieval problem has received much attention in recent years due to the rapid increasing of multimedia data on the Internet. A new approach to the problem has been raised which intends to match features of different…

Multimedia · Computer Science 2015-12-18 Cuicui Kang , Shengcai Liao , Yonghao He , Jian Wang , Wenjia Niu , Shiming Xiang , Chunhong Pan

We propose theoretical and empirical improvements for two-stage hashing methods. We first provide a theoretical analysis on the quality of the binary codes and show that, under mild assumptions, a residual learning scheme can construct…

Machine Learning · Computer Science 2018-08-07 Fatih Cakir , Kun He , Stan Sclaroff

Cross-modal retrieval aims to retrieve relevant data across different modalities (e.g., texts vs. images). The common strategy is to apply element-wise constraints between manually labeled pair-wise items to guide the generators to learn…

Multimedia · Computer Science 2019-04-18 Xin Wen , Zhizhong Han , Xinyu Yin , Yu-Shen Liu

This paper addresses the problem of learning binary hash codes for large scale image search by proposing a novel hashing method based on deep neural network. The advantage of our deep model over previous deep model used in hashing is that…

Computer Vision and Pattern Recognition · Computer Science 2015-08-31 Thanh-Toan Do , Anh-Zung Doan , Ngai-Man Cheung