English
Related papers

Related papers: A Novel Self-Supervised Cross-Modal Image Retrieva…

200 papers

The success of speech-image retrieval relies on establishing an effective alignment between speech and image. Existing methods often model cross-modal interaction through simple cosine similarity of the global feature of each modality,…

Computation and Language · Computer Science 2024-09-12 Lifeng Zhou , Yuke Li , Rui Deng , Yuting Yang , Haoqi Zhu

Remote sensing image super-resolution (RSISR) is a crucial task in remote sensing image processing, aiming to reconstruct high-resolution (HR) images from their low-resolution (LR) counterparts. Despite the growing number of RSISR methods…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Yunliang Qi , Meng Lou , Yimin Liu , Lu Li , Zhen Yang , Wen Nie

Multi-modal magnetic resonance imaging (MRI) is essential in clinics for comprehensive diagnosis and surgical planning. Nevertheless, the segmentation of multi-modal MR images tends to be time-consuming and challenging. Convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2019-08-07 Cheng Li , Hui Sun , Zaiyi Liu , Meiyun Wang , Hairong Zheng , Shanshan Wang

Image-based retrieval in large Earth observation archives is challenging because one needs to navigate across thousands of candidate matches only with the query image as a guide. By using text as information supporting the visual query, the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Li Mi , Xianjie Dai , Javiera Castillo-Navarro , Devis Tuia

Composed Image Retrieval (CIR) retrieves target images using a multi-modal query that combines a reference image with text describing desired modifications. The primary challenge is effectively fusing this visual and textual information.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Chaoyang Wang , Zeyu Zhang , Long Teng , Zijun Li , Shichao Kan

Despite the recent developments in the field of cross-modal retrieval, there has been less research focusing on low-resource languages due to the lack of manually annotated datasets. In this paper, we propose a noise-robust cross-lingual…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Yabing Wang , Jianfeng Dong , Tianxiang Liang , Minsong Zhang , Rui Cai , Xun Wang

This paper addresses the problem of semi-supervised transfer learning with limited cross-modality data in remote sensing. A large amount of multi-modal earth observation images, such as multispectral imagery (MSI) or synthetic aperture…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Danfeng Hong , Naoto Yokoya , Gui-Song Xia , Jocelyn Chanussot , Xiao Xiang Zhu

Fusion-based hyperspectral image super-resolution aims to fuse low-resolution hyperspectral images (LR-HSIs) and high-resolution multispectral images (HR-MSIs) to reconstruct high spatial and high spectral resolution images. Current methods…

Image and Video Processing · Electrical Eng. & Systems 2026-03-25 Songcheng Du , Yang Zou , Zixu Wang , Xingyuan Li , Ying Li , Changjing Shang , Qiang Shen

To tackle the challenge of vehicle re-identification (Re-ID) in complex lighting environments and diverse scenes, multi-spectral sources like visible and infrared information are taken into consideration due to their excellent complementary…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Aihua Zheng , Xianpeng Zhu , Zhiqi Ma , Chenglong Li , Jin Tang , Jixin Ma

Due to the availability of large-scale multi-modal data (e.g., satellite images acquired by different sensors, text sentences, etc) archives, the development of cross-modal retrieval systems that can search and retrieve semantically…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Georgii Mikriukov , Mahdyar Ravanbakhsh , Begüm Demir

In many visual systems, visual tracking often bases on RGB image sequences, in which some targets are invalid in low-light conditions, and tracking performance is thus affected significantly. Introducing other modalities such as depth and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Chenglong Li , Tianhao Zhu , Lei Liu , Xiaonan Si , Zilin Fan , Sulan Zhai

Developing advanced medical imaging retrieval systems is challenging due to the varying definitions of `similar images' across different medical contexts. This challenge is compounded by the lack of large-scale, high-quality medical imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Tengfei Zhang , Ziheng Zhao , Chaoyi Wu , Xiao Zhou , Ya Zhang , Yanfeng Wang , Weidi Xie

This paper presents a novel graph-theoretic deep representation learning method in the framework of multi-label remote sensing (RS) image retrieval problems. The proposed method aims to extract and exploit multi-label co-occurrence…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Gencer Sumbul , Begüm Demir

Remote Sensing Change Detection (RS-CD) aims to detect relevant changes from Multi-Temporal Remote Sensing Images (MT-RSIs), which aids in various RS applications such as land cover, land use, human development analysis, and disaster…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Wele Gedara Chaminda Bandara , Vishal M. Patel

The cross-media retrieval problem has received much attention in recent years due to the rapid increasing of multimedia data on the Internet. A new approach to the problem has been raised which intends to match features of different…

Multimedia · Computer Science 2015-12-18 Cuicui Kang , Shengcai Liao , Yonghao He , Jian Wang , Wenjia Niu , Shiming Xiang , Chunhong Pan

Single image super-resolution (SISR), which aims to reconstruct a high-resolution (HR) image from a low-resolution (LR) observation, has been an active research topic in the area of image processing in recent decades. Particularly, deep…

Image and Video Processing · Electrical Eng. & Systems 2021-03-04 Honggang Chen , Xiaohai He , Linbo Qing , Yuanyuan Wu , Chao Ren , Ce Zhu

The RGB-infrared cross-modality person re-identification (ReID) task aims to recognize the images of the same identity between the visible modality and the infrared modality. Existing methods mainly use a two-stream architecture to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Yajun Gao , Tengfei Liang , Yi Jin , Xiaoyan Gu , Wu Liu , Yidong Li , Congyan Lang

Multi-modality imaging improves disease diagnosis and reveals distinct deviations in tissues with anatomical properties. The existence of completely aligned and paired multi-modality neuroimaging data has proved its effectiveness in brain…

Image and Video Processing · Electrical Eng. & Systems 2023-09-26 Guoyang Xie , Yawen Huang , Jinbao Wang , Jiayi Lyu , Feng Zheng , Yefeng Zheng , Yaochu Jin

Composed Image Retrieval (CIR) is an emerging yet challenging task that allows users to search for target images using a multimodal query, comprising a reference image and a modification text specifying the user's desired changes to the…

Multimedia · Computer Science 2025-03-05 Xuemeng Song , Haoqiang Lin , Haokun Wen , Bohan Hou , Mingzhu Xu , Liqiang Nie

Recently, the Magnetic Resonance Imaging (MRI) images have limited and unsatisfactory resolutions due to various constraints such as physical, technological and economic considerations. Super-resolution techniques can obtain high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Yinghua Li , Bin Song , Jie Guo , Xiaojiang Du , Mohsen Guizani