English
Related papers

Related papers: A Novel Self-Supervised Cross-Modal Image Retrieva…

200 papers

Cross-domain image retrieval aims at retrieving images across different domains to excavate cross-domain classificatory or correspondence relationships. This paper studies a less-touched problem of cross-domain image retrieval, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Xu Wang , Dezhong Peng , Ming Yan , Peng Hu

Despite the achievements of large-scale multimodal pre-training approaches, cross-modal retrieval, e.g., image-text retrieval, remains a challenging task. To bridge the semantic gap between the two modalities, previous studies mainly focus…

Computation and Language · Computer Science 2021-06-08 Shuhuai Ren , Junyang Lin , Guangxiang Zhao , Rui Men , An Yang , Jingren Zhou , Xu Sun , Hongxia Yang

In supervised deep learning, learning good representations for remote--sensing images (RSI) relies on manual annotations. However, in the area of remote sensing, it is hard to obtain huge amounts of labeled data. Recently, self--supervised…

Machine Learning · Computer Science 2022-09-27 Qinglin Li , Bin Li , Jonathan M Garibaldi , Guoping Qiu

Remote sensing image change captioning (RSICC) aims to articulate the changes in objects of interest within bi-temporal remote sensing images using natural language. Given the limitations of current RSICC methods in expressing general…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yongshuo Zhu , Lu Li , Keyan Chen , Chenyang Liu , Fugen Zhou , Zhenwei Shi

RGB-Infrared person re-identification (RGB-IR Re-ID) aims to match persons from heterogeneous images captured by visible and thermal cameras, which is of great significance in the surveillance system under poor light conditions. Facing…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Can Zhang , Hong Liu , Wei Guo , Mang Ye

Single image super-resolution (SISR) aims to obtain a high-resolution output from one low-resolution image. Currently, deep learning-based SISR approaches have been widely discussed in medical image processing, because of their potential to…

Image and Video Processing · Electrical Eng. & Systems 2021-05-25 Jin Zhu , Chuan Tan , Junwei Yang , Guang Yang , Pietro Lio'

Popular methods in compressed sensing (CS) are dependent on deep learning (DL), where large amounts of data are used to train non-linear reconstruction models. However, ensuring generalisability over and access to multiple datasets is…

Image and Video Processing · Electrical Eng. & Systems 2024-09-02 Marlon Bran Lorenzana , Feng Liu , Shekhar S. Chandra

Cross-lingual cross-modal retrieval has garnered increasing attention recently, which aims to achieve the alignment between vision and target language (V-T) without using any annotated V-T data pairs. Current methods employ machine…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Yabing Wang , Fan Wang , Jianfeng Dong , Hao Luo

Cross-spectrum depth estimation aims to provide a depth map in all illumination conditions with a pair of dual-spectrum images. It is valuable for autonomous vehicle applications when the vehicle is equipped with two cameras of different…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Yubin Guo , Haobo Jiang , Xinlei Qi , Jin Xie , Cheng-Zhong Xu , Hui Kong

With the exponential surge in diverse multi-modal data, traditional uni-modal retrieval methods struggle to meet the needs of users seeking access to data across various modalities. To address this, cross-modal retrieval has emerged,…

Information Retrieval · Computer Science 2024-10-01 Tianshi Wang , Fengling Li , Lei Zhu , Jingjing Li , Zheng Zhang , Heng Tao Shen

Remote Sensing Image-Text Retrieval (RSITR) plays a critical role in geographic information interpretation, disaster monitoring, and urban planning by establishing semantic associations between image and textual descriptions. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Hailong Ning , Siying Wang , Tao Lei , Xiaopeng Cao , Huanmin Dou , Bin Zhao , Asoke K. Nandi , Petia Radeva

Co-registration of multimodal remote sensing images is still an ongoing challenge because of nonlinear radiometric differences (NRD) and significant geometric distortions (e.g., scale and rotation changes) between these images. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Yuanxin Ye , Bai Zhu , Tengfeng Tang , Chao Yang , Qizhi Xu , Guo Zhang

In recent years, there has been significant research focusing on addressing security concerns in single-modal person re-identification (ReID) systems that are based on RGB images. However, the safety of cross-modality scenarios, which are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Yunpeng Gong , Zhun Zhong , Yansong Qu , Zhiming Luo , Rongrong Ji , Min Jiang

Large Vision-Language Models (LVLMs) often omit or misrepresent critical visual content in generated image captions. Minimizing such information loss will force LVLMs to focus on image details to generate precise descriptions. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Haonan Jia , Shichao Dong , Xin Dong , Zenghui Sun , Jin Wang , Jinsong Lan , Xiaoyong Zhu , Bo Zheng , Kaifu Zhang

Acquiring images in high resolution is often a challenging task. Especially in the medical sector, image quality has to be balanced with acquisition time and patient comfort. To strike a compromise between scan time and quality for Magnetic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Maja Schlereth , Moritz Schillinger , Katharina Breininger

The substantial modality-induced variations in radiometric, texture, and structural characteristics pose significant challenges for the accurate registration of multimodal images. While supervised deep learning methods have demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-05-29 Xiaochen Wei , Weiwei Guo , Wenxian Yu

Composed image retrieval (CIR), which formulates the query as a combination of a reference image and modified text, has emerged as a new form of image search due to its enhanced ability to capture user intent. However, training a CIR model…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Ren-Di Wu , Yu-Yen Lin , Huei-Fang Yang

Remote sensing images (RSIs) in real scenes may be disturbed by multiple factors such as optical blur, undersampling, and additional noise, resulting in complex and diverse degradation models. At present, the mainstream SR algorithms only…

Image and Video Processing · Electrical Eng. & Systems 2022-10-17 Hanlin Wu , Ning Ni , Shan Wang , Libao Zhang

The task of single image super-resolution (SISR) aims at reconstructing a high-resolution (HR) image from a low-resolution (LR) image. Although significant progress has been made by deep learning models, they are trained on synthetic paired…

Image and Video Processing · Electrical Eng. & Systems 2019-10-15 Zhen Han , Enyan Dai , Xu Jia , Xiaoying Ren , Shuaijun Chen , Chunjing Xu , Jianzhuang Liu , Qi Tian

Text-to-image person retrieval aims to identify the target person based on a given textual description query. The primary challenge is to learn the mapping of visual and textual modalities into a common latent space. Prior works have…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Ding Jiang , Mang Ye