English
Related papers

Related papers: Changes to Captions: An Attentive Network for Remo…

200 papers

We introduce HyperCap, the first large-scale hyperspectral captioning dataset designed to enhance model performance and effectiveness in remote sensing applications. Unlike traditional hyperspectral imaging (HSI) benchmarks, HyperCap…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Aryan Das , Tanishq Rachamalla , Pravendra Singh , Koushik Biswas , Vinay Kumar Verma , Salvador Garcia , Antonio Plaza , Swalpa Kumar Roy

Remote sensing image captioning has advanced rapidly through encoder--decoder models, although the reliance on large annotated datasets and the focus on English restricts global applicability. To address these limitations, we propose the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Carlos Rebelo , Gil Rocha , João Daniel Silva , Bruno Martins

Remote sensing change understanding (RSCU) is essential for analyzing remote sensing images and understanding how human activities affect the environment. However, existing datasets lack deep understanding and interactions in the diverse…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Junxiao Xue , Quan Deng , Xuecheng Wu , Kelu Yao , Xinyi Yin , Fei Yu , Wei Zhou , Yanfei Zhong , Yang Liu , Dingkang Yang

Remote sensing is critical for disaster monitoring, yet existing datasets lack temporal image pairs and detailed textual annotations. While single-snapshot imagery dominates current resources, it fails to capture dynamic disaster impacts…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Zhenyuan Chen , Chenxi Wang , Ningyu Zhang , Feng Zhang

Remote Sensing Image Change Captioning (RSICC) aims to generate spatially grounded natural language descriptions of scene evolution from bi-temporal imagery, moving beyond binary change masks toward semantic-level understanding. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Yupeng Gao , Tianyu Li , Guoqing Wang , Yang Yang

Change captioning is to describe the semantic change between a pair of similar images in natural language. It is more challenging than general image captioning, because it requires capturing fine-grained change information while being…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Yunbin Tu , Liang Li , Li Su , Ke Lu , Qingming Huang

Transformer-based models have achieved strong performance in remote sensing image captioning by capturing long-range dependencies and contextual information. However, their practical deployment is hindered by high computational costs,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Swadhin Das , Divyansh Mundra , Priyanshu Dayal , Raksha Sharma

The existing methods for Remote Sensing Image Change Captioning (RSICC) perform well in simple scenes but exhibit poorer performance in complex scenes. This limitation is primarily attributed to the model's constrained visual ability to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Chenyang Liu , Keyan Chen , Zipeng Qi , Haotian Zhang , Zhengxia Zou , Zhenwei Shi

The internal workings of modern deep learning models stay often unclear to an external observer, although spatial attention mechanisms are involved. The idea of this work is to translate these spatial attentions into natural language to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Philipp Sadler

In this work we formulate the problem of image captioning as a multimodal translation task. Analogous to machine translation, we present a sequence-to-sequence recurrent neural networks (RNN) model for image caption generation. Different…

Computer Vision and Pattern Recognition · Computer Science 2017-08-11 Chang Liu , Fuchun Sun , Changhu Wang , Feng Wang , Alan Yuille

Previous models for video captioning often use the output from a specific layer of a Convolutional Neural Network (CNN) as video features. However, the variable context-dependent semantics in the video may make it more appropriate to…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Yunchen Pu , Martin Renqiang Min , Zhe Gan , Lawrence Carin

Image captioning and cross-modal retrieval are examples of tasks that involve the joint analysis of visual and linguistic information. In connection to remote sensing imagery, these tasks can help non-expert users in extracting relevant…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 João Daniel Silva , João Magalhães , Devis Tuia , Bruno Martins

Change captioning generates descriptions that explicitly describe the differences between two visually similar images. Existing methods operate on static image pairs, thus ignoring the rich temporal dynamics of the change procedure, which…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Jiayang Sun , Zixin Guo , Min Cao , Guibo Zhu , Jorma Laaksonen

Image Captioning, or the automatic generation of descriptions for images, is one of the core problems in Computer Vision and has seen considerable progress using Deep Learning Techniques. We propose to use Inception-ResNet Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Sulabh Katiyar , Samir Kumar Borgohain

Remote Sensing Image Change Captioning (RSICC) aims to generate natural language descriptions of surface changes between multi-temporal remote sensing images, detailing the categories, locations, and dynamics of changed objects (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Zhiming Wang , Mingze Wang , Sheng Xu , Yanjing Li , Baochang Zhang

This paper explores a novel dynamic network for vision and language tasks, where the inferring structure is customized on the fly for different inputs. Most previous state-of-the-art approaches are static and hand-crafted networks, which…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yiwei Ma , Jiayi Ji , Xiaoshuai Sun , Yiyi Zhou , Xiaopeng Hong , Yongjian Wu , Rongrong Ji

Image captioning transforms complex visual information into abstract natural language for representation, which can help computers understanding the world quickly. However, due to the complexity of the real environment, it needs to identify…

Computer Vision and Pattern Recognition · Computer Science 2021-11-19 Xinxin Zhu , Weining Wang , Longteng Guo , Jing Liu

Remote sensing imagery has attracted significant attention in recent years due to its instrumental role in global environmental monitoring, land usage monitoring, and more. As image databases grow each year, performing automatic…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jielu Zhang , Zhongliang Zhou , Gengchen Mai , Mengxuan Hu , Zihan Guan , Sheng Li , Lan Mu

We deal with the problem of generating textual captions from optical remote sensing (RS) images using the notion of deep reinforcement learning. Due to the high inter-class similarity in reference sentences describing remote sensing data,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Ruchika Chavhan , Biplab Banerjee , Xiao Xiang Zhu , Subhasis Chaudhuri

Image captioning is one of the most challenging tasks in AI, which aims to automatically generate textual sentences for an image. Recent methods for image captioning follow encoder-decoder framework that transforms the sequence of salient…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Zeliang Song , Xiaofei Zhou