English
Related papers

Related papers: Cross-Modality Hashing with Partial Correspondence

200 papers

Text-based image retrieval has seen considerable progress in recent years. However, the performance of existing methods suffers in real life since the user is likely to provide an incomplete description of an image, which often leads to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Guanyu Cai , Jun Zhang , Xinyang Jiang , Yifei Gong , Lianghua He , Fufu Yu , Pai Peng , Xiaowei Guo , Feiyue Huang , Xing Sun

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

Recent advances in using retrieval components over external knowledge sources have shown impressive results for a variety of downstream tasks in natural language processing. Here, we explore the use of unstructured external knowledge…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Shir Gur , Natalia Neverova , Chris Stauffer , Ser-Nam Lim , Douwe Kiela , Austin Reiter

Multi-modal data is becoming more common in big data background. Finding the semantically similar objects from different modality is one of the heart problems of multi-modal learning. Most of the current methods try to learn the inter-modal…

Artificial Intelligence · Computer Science 2018-09-05 Qibin Zheng , Xingchun Diao , Jianjun Cao , Xiaolei Zhou , Yi Liu , Hongmei Li

Content-based information retrieval is based on the information contained in documents rather than using metadata such as keywords. Most information retrieval methods are either based on text or image. In this paper, we investigate the…

Computation and Language · Computer Science 2020-10-02 Golsa Tahmasebzadeh , Sherzod Hakimov , Eric Müller-Budack , Ralph Ewerth

Nearest neighbor search aims to obtain the samples in the database with the smallest distances from them to the queries, which is a basic task in a range of fields, including computer vision and data mining. Hashing is one of the most…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Xiao Luo , Haixin Wang , Daqing Wu , Chong Chen , Minghua Deng , Jianqiang Huang , Xian-Sheng Hua

Cross-modal hashing (CMH) is one of the most promising methods in cross-modal approximate nearest neighbor search. Most CMH solutions ideally assume the labels of training and testing set are identical. However, the assumption is often…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Runmin Wang , Guoxian Yu , Lei Liu , Lizhen Cui , Carlotta Domeniconi , Xiangliang Zhang

Hashing is an efficient method for nearest neighbor search in large-scale data space by embedding high-dimensional feature descriptors into a similarity preserving Hamming space with a low dimension. However, large-scale high-speed…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Chenggang Yan , Biao Gong , Yuxuan Wei , Yue Gao

Cross-modal retrieval has drawn wide interest for retrieval across different modalities of data. However, existing methods based on DNN face the challenge of insufficient cross-modal training data, which limits the training effectiveness…

Multimedia · Computer Science 2017-08-16 Xin Huang , Yuxin Peng , Mingkuan Yuan

The burgeoning volume of digital content across diverse modalities necessitates efficient storage and retrieval methods. Conventional approaches struggle to cope with the escalating complexity and scale of multimedia data. In this paper, we…

Artificial Intelligence · Computer Science 2024-04-17 Jixiang Luo

Correlation networks derived from multivariate data appear in many applications across the sciences. These networks are usually dense and require sparsification to detect meaningful structure. However, current methods for sparsifying…

Physics and Society · Physics 2023-03-06 Magnus Neuman , Viktor Jonsson , Joaquín Calatayud , Martin Rosvall

Text-based person search is the task of finding person images that are the most relevant to the natural language text description given as query. The main challenge of this task is a large gap between the target images and text queries,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Jicheol Park , Boseung Jeong , Dongwon Kim , Suha Kwak

Nowadays, cross-modal retrieval plays an indispensable role to flexibly find information across different modalities of data. Effectively measuring the similarity between different modalities of data is the key of cross-modal retrieval.…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Yuxin Peng , Jinwei Qi , Yuxin Yuan

Due to limitations in data quality, some essential visual tasks are difficult to perform independently. Introducing previously unavailable information to transfer informative dark knowledge has been a common way to solve such hard tasks.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Lingyu Si , Hongwei Dong , Wenwen Qiang , Junzhi Yu , Wenlong Zhai , Changwen Zheng , Fanjiang Xu , Fuchun Sun

HalftimeHash is a new algorithm for hashing long strings. The goals are few collisions (different inputs that produce identical output hash values) and high performance. Compared to the fastest universal hash functions on long strings…

Data Structures and Algorithms · Computer Science 2021-04-22 Jim Apple

Having access to multi-modal cues (e.g. vision and audio) empowers some cognitive tasks to be done faster compared to learning from a single modality. In this work, we propose to transfer knowledge across heterogeneous modalities, even…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Yanbei Chen , Yongqin Xian , A. Sophia Koepke , Ying Shan , Zeynep Akata

Multimodal learning from document data has achieved great success lately as it allows to pre-train semantically meaningful features as a prior into a learnable downstream task. In this paper, we approach the document classification problem…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Souhail Bakkali , Zuheng Ming , Mickael Coustaty , Marçal Rusiñol , Oriol Ramos Terrades

Internet memes are powerful tools for communication, capable of spreading political, psychological, and sociocultural ideas. However, they can be harmful and can be used to disseminate hate toward targeted individuals or groups. Although…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Felix Breiteneder , Mohammad Belal , Muhammad Saad Saeed , Shahed Masoudian , Usman Naseem , Kulshrestha Juhi , Markus Schedl , Shah Nawaz

Compared with the traditional hashing methods, deep hashing methods generate hash codes with rich semantic information and greatly improves the performances in the image retrieval field. However, it is unsatisfied for current deep hashing…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Hai Su , Meiyin Han , Junle Liang , Jun Liang , Songsen Yu

We are interested in identity-based retrieval of face sets from large unlabelled collections acquired in uncontrolled environments. Given a baseline algorithm for measuring the similarity of two face sets, the meta-algorithm introduced in…

Computer Vision and Pattern Recognition · Computer Science 2016-04-15 Ognjen Arandjelovic