English
Related papers

Related papers: SAR-TEXT: A Large-Scale SAR Image-Text Dataset Bui…

200 papers

Visual Question Answering (VQA) in remote sensing (RS) is pivotal for interpreting Earth observation data. However, existing RS VQA datasets are constrained by limitations in annotation richness, question diversity, and the assessment of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xing Zi , Jinghao Xiao , Yunxiao Shi , Xian Tao , Jun Li , Ali Braytee , Mukesh Prasad

Radar sensors provide reliable perception across adverse weather, lighting, and long-range conditions, yet existing machine learning approaches remain fragmented and task-specific, with each downstream task employing distinct architectures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Pushkal Mishra , Kshitiz Bansal , Dinesh Bharadia

Current visual question answering (VQA) tasks often require constructing multimodal datasets and fine-tuning visual language models, which demands significant time and resources. This has greatly hindered the application of VQA to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Fei Wang , Chengcheng Chen , Hongyu Chen , Yugang Chang , Weiming Zeng

Recent advancements in Vision-Language (VL) research have sparked new benchmarks for complex visual reasoning, challenging models' advanced reasoning ability. Traditional Vision-Language Models (VLMs) perform well in visual perception tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zhiyuan Li , Dongnan Liu , Chaoyi Zhang , Heng Wang , Tengfei Xue , Weidong Cai

Vision-Language Models (VLMs) have demonstrated great potential in interpreting remote sensing (RS) images through language-guided semantic. However, the effectiveness of these VLMs critically depends on high-quality image-text training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Dilxat Muhtar , Enzhuo Zhang , Zhenshi Li , Feng Gu , Yanglangxing He , Pengfeng Xiao , Xueliang Zhang

Large language models (LLMs) have increased interest in vision language models (VLMs), which process image-text pairs as input. Studies investigating the visual understanding ability of VLMs have been proposed, but such studies are still…

Computation and Language · Computer Science 2024-06-25 Jesse Atuhurra , Iqra Ali , Tatsuya Hiraoka , Hidetaka Kamigaito , Tomoya Iwakura , Taro Watanabe

Research on the intelligent interpretation of all-weather, all-time Synthetic Aperture Radar (SAR) is crucial for advancing remote sensing applications. In recent years, although Visual Language Models (VLMs) have demonstrated strong…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Xiaokun Zhang , Yi Yang , Ziqi Ye , Baiyun , Xiaorong Guo , Qingchen Fang , Ruyi Zhang , Xinpeng Zhou , Haipeng Wang

Multimodal Large Language Models (MLLMs) have shown exceptional capabilities in vision-language tasks; however, effectively integrating image segmentation into these models remains a significant challenge. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Mengcheng Lan , Chaofeng Chen , Yue Zhou , Jiaxing Xu , Yiping Ke , Xinjiang Wang , Litong Feng , Wayne Zhang

We introduce a method to train vision-language models for remote-sensing images without using any textual annotations. Our key insight is to use co-located internet imagery taken on the ground as an intermediary for connecting…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Utkarsh Mall , Cheng Perng Phoo , Meilin Kelsey Liu , Carl Vondrick , Bharath Hariharan , Kavita Bala

The application of Vision-Language Models (VLMs) in remote sensing (RS) has demonstrated significant potential in traditional tasks such as scene classification, object detection, and image captioning. However, current models, which excel…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zilun Zhang , Haozhan Shen , Tiancheng Zhao , Bin Chen , Zian Guan , Yuhao Wang , Xu Jia , Yuxiang Cai , Yongheng Shang , Jianwei Yin

The availability of large-scale image captioning and visual question answering datasets has contributed significantly to recent successes in vision-and-language pre-training. However, these datasets are often collected with overrestrictive…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Soravit Changpinyo , Piyush Sharma , Nan Ding , Radu Soricut

We introduce a new benchmark designed to advance the development of general-purpose, large-scale vision-language models for remote sensing images. Although several vision-language datasets in remote sensing have been proposed to pursue this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Xiang Li , Jian Ding , Mohamed Elhoseiny

Methods based on Contrastive Language-Image Pre-training (CLIP) are nowadays extensively used in support of vision-and-language tasks involving remote sensing data, such as cross-modal retrieval. The adaptation of CLIP to this specific…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 João Daniel Silva , Joao Magalhaes , Devis Tuia , Bruno Martins

Vision language models have achieved impressive results across various fields. However, adoption in remote sensing remains limited, largely due to the scarcity of paired image-text data. To bridge this gap, synthetic caption generation has…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Madeline Anderson , Miriam Cha , William T. Freeman , J. Taylor Perron , Nathaniel Maidel , Kerri Cahoy

Vision-Language Pre-training (VLP) models like CLIP have significantly advanced Remote Sensing Image-Text Retrieval (RSITR). However, existing methods predominantly rely on coarse-grained global alignment, which often overlooks the dense,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yifan Li , Shiying Wang , Jianqiang Huang

Existing Vision-Language Models (VLMs) are predominantly trained on web-scraped, noisy image-text data, exhibiting limited exposure to the specialized domain of RS. This deficiency results in poor performance on RS-specific tasks, as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Angelos Zavras , Dimitrios Michail , Xiao Xiang Zhu , Begüm Demir , Ioannis Papoutsis

Web-crawled image-text pairs are inherently noisy. Prior studies demonstrate that semantically aligning and enriching textual descriptions of these pairs can significantly enhance model training across various vision-language tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Xianhang Li , Haoqin Tu , Mude Hui , Zeyu Wang , Bingchen Zhao , Junfei Xiao , Sucheng Ren , Jieru Mei , Qing Liu , Huangjie Zheng , Yuyin Zhou , Cihang Xie

Vision-language models (VLMs) achieve remarkable success in single-image tasks. However, real-world scenarios often involve intricate multi-image inputs, leading to a notable performance decline as models struggle to disentangle critical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Juntian Zhang , Chuanqi cheng , Yuhan Liu , Wei Liu , Jian Luan , Rui Yan

A more robust and holistic language-video representation is the key to pushing video understanding forward. Despite the improvement in training strategies, the quality of the language-video dataset is less attention to. The current plain…

Multimedia · Computer Science 2024-06-21 Yuchen Yang , Yingxuan Duan

We present a framework for adapting a large pretrained latent diffusion model to high-resolution Synthetic Aperture Radar (SAR) image generation. The approach enables controllable synthesis and the creation of rare or out-of-distribution…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Solène Debuysère , Nicolas Trouvé , Nathan Letheule , Olivier Lévêque , Elise Colin