English
Related papers

Related papers: Multi-Modal Mutual Information Maximization: A Nov…

200 papers

Cross-modal retrieval deals with retrieving relevant items from one modality, when provided with a search query from another modality. Hashing techniques, where the data is represented as binary bits have specifically gained importance due…

Computer Vision and Pattern Recognition · Computer Science 2020-02-04 Devraj Mandal , Soma Biswas

In recent years, cross-modal hashing (CMH) has attracted increasing attentions, mainly because its potential ability of mapping contents from different modalities, especially in vision and language, into the same space, so that it becomes…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Hengtong Hu , Lingxi Xie , Richang Hong , Qi Tian

Multimodal representation learning poses significant challenges in capturing informative and distinct features from multiple modalities. Existing methods often struggle to exploit the unique characteristics of each modality due to unified…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Cam-Van Thi Nguyen , Ngoc-Hoa Thi Nguyen , Duc-Trong Le , Quang-Thuy Ha

This paper presents a novel framework, namely Deep Cross-modality Spectral Hashing (DCSH), to tackle the unsupervised learning problem of binary hash codes for efficient cross-modal retrieval. The framework is a two-step hashing approach…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Tuan Hoang , Thanh-Toan Do , Tam V. Nguyen , Ngai-Man Cheung

With the advantage of low storage cost and high retrieval efficiency, hashing techniques have recently been an emerging topic in cross-modal similarity search. As multiple modal data reflect similar semantic content, many researches aim at…

Machine Learning · Computer Science 2019-04-19 Jun Yu , Xiao-Jun Wu , Josef Kittler

In hospitals, data are siloed to specific information systems that make the same information available under different modalities such as the different medical imaging exams the patient undergoes (CT scans, MRI, PET, Ultrasound, etc.) and…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Tristan Sylvain , Francis Dutil , Tess Berthier , Lisa Di Jorio , Margaux Luck , Devon Hjelm , Yoshua Bengio

We introduce an efficient computational framework for hashing data belonging to multiple modalities into a single representation space where they become mutually comparable. The proposed approach is based on a novel coupled siamese neural…

Computer Vision and Pattern Recognition · Computer Science 2012-07-09 Jonathan Masci , Michael M. Bronstein , Alexander A. Bronstein , Jürgen Schmidhuber

Large-scale cross-modal hashing similarity retrieval has attracted more and more attention in modern search applications such as search engines and autopilot, showing great superiority in computation and storage. However, current…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Lu Wang , Jie Yang

Hashing that projects data into binary codes has shown extraordinary talents in cross-modal retrieval due to its low storage usage and high query speed. Despite their empirical success on some scenarios, existing cross-modal hashing methods…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Yufeng Shi , Xinge You , Jiamiao Xu , Feng Zheng , Qinmu Peng , Weihua Ou

Unsupervised binary representation allows fast data retrieval without any annotations, enabling practical application like fast person re-identification and multimedia retrieval. It is argued that conflicts in binary space are one of the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Fangrui Liu , Zheng Liu

Binary vector embeddings enable fast nearest neighbor retrieval in large databases of high-dimensional objects, and play an important role in many practical applications, such as image and video retrieval. We study the problem of learning…

Computer Vision and Pattern Recognition · Computer Science 2018-06-26 Fatih Cakir , Kun He , Sarah Adel Bargal , Stan Sclaroff

Learning-based hashing methods are widely used for nearest neighbor retrieval, and recently, online hashing methods have demonstrated good performance-complexity trade-offs by learning hash functions from streaming data. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Fatih Cakir , Kun He , Sarah Adel Bargal , Stan Sclaroff

Cross-modal retrieval aims to search for data with similar semantic meanings across different content modalities. However, cross-modal retrieval requires huge amounts of storage and retrieval time since it needs to process data in multiple…

Information Retrieval · Computer Science 2022-02-22 Yang Shi , Young-joo Chung

Due to its low storage cost and fast query speed, cross-modal hashing (CMH) has been widely used for similarity search in multimedia retrieval applications. However, almost all existing CMH methods are based on hand-crafted features which…

Information Retrieval · Computer Science 2016-02-16 Qing-Yuan Jiang , Wu-Jun Li

In this paper, we study the cross-modal image retrieval, where the inputs contain a source image plus some text that describes certain modifications to this image and the desired image. Prior work usually uses a three-stage strategy to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Chunbin Gu , Jiajun Bu , Xixi Zhou , Chengwei Yao , Dongfang Ma , Zhi Yu , Xifeng Yan

Multi-modal hashing methods are widely used in multimedia retrieval, which can fuse multi-source data to generate binary hash code. However, the individual backbone networks have limited feature expression capabilities and are not jointly…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Jian Zhu , Mingkai Sheng , Zhangmin Huang , Jingfei Chang , Jinling Jiang , Jian Long , Cheng Luo , Lei Liu

With the advantage of low storage cost and high efficiency, hashing learning has received much attention in the domain of Big Data. In this paper, we propose a novel unsupervised hashing learning method to cope with this open problem to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Jun Yu , Xiao-Jun Wu

Matrix factorization has been recently utilized for the task of multi-modal hashing for cross-modality visual search, where basis functions are learned to map data from different modalities to the same Hamming embedding. In this paper, we…

Information Retrieval · Computer Science 2016-04-19 Hong Liu , Rongrong Ji , Yongjian Wu , Gang Hua

The multi-modal hashing method is widely used in multimedia retrieval. It can fuse multi-source data to generate binary hash code. However, the current multi-modal methods have the problem of low retrieval accuracy. The reason is that the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Jian Zhu , Mingkai Sheng , Mingda Ke , Zhangmin Huang , Jingfei Chang

To overcome the barrier of storage and computation, the hashing technique has been widely used for nearest neighbor search in multimedia retrieval applications recently. Particularly, cross-modal retrieval that searches across different…

Information Retrieval · Computer Science 2019-05-16 Sarawut Markchit , Chih-Yi Chiu
‹ Prev 1 2 3 10 Next ›