English
Related papers

Related papers: DeltaVLM: Interactive Remote Sensing Image Change …

200 papers

In recent years, advanced research has focused on the direct learning and analysis of remote sensing images using natural language processing (NLP) techniques. The ability to accurately describe changes occurring in multi-temporal remote…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Shizhen Chang , Pedram Ghamisi

Vision-Language Models (VLMs) have demonstrated great potential in interpreting remote sensing (RS) images through language-guided semantic. However, the effectiveness of these VLMs critically depends on high-quality image-text training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Dilxat Muhtar , Enzhuo Zhang , Zhenshi Li , Feng Gu , Yanglangxing He , Pengfeng Xiao , Xueliang Zhang

Remote Sensing Image Captioning (RSIC) is the process of generating meaningful descriptions from remote sensing images. Recently, it has gained significant attention, with encoder-decoder models serving as the backbone for generating…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Swadhin Das , Saarthak Gupta , Kamal Kumar , Raksha Sharma

Multi-task ``vision-language-action'' (VLA) models have recently demonstrated increasing promise as generalist foundation models for robotics, achieving non-trivial performance out of the box on new tasks in new environments. However, for…

Robotics · Computer Science 2025-08-05 Kaustubh Sridhar , Souradeep Dutta , Dinesh Jayaraman , Insup Lee

We introduce SMART-HC-VQA, a Sentinel-2-based visual question answering dataset derived from the IARPA SMART Heavy Construction dataset, designed for spatiotemporal analysis of human activity. The dataset transforms construction-site…

Image and Video Processing · Electrical Eng. & Systems 2026-05-12 David F. Ramirez , Tim Overman , Kristen Jaskie , Andreas Spanias

Tool-augmented Large Language Models (LLMs) have shown impressive capabilities in remote sensing (RS) applications. However, existing benchmarks assume question-answering input templates over predefined image-text data pairs. These…

Computation and Language · Computer Science 2024-05-03 Simranjit Singh , Michael Fore , Dimitrios Stamoulis

Traditional Shot Boundary Detection (SBD) inherently struggles with complex transitions by formulating the task around isolated cut points, frequently yielding corrupted video shots. We address this fundamental limitation by formalizing the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Ce Chen , Yi Ren , Yuanming Li , Viktor Goriachko , Zhenhui Ye , Zujin Guo , Zhibin Hong , Mingming Gong

Remote sensing visual question answering (RSVQA) opens new opportunities for the use of overhead imagery by the general public, by enabling human-machine interaction with natural language. Building on the recent advances in natural language…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Christel Chappuis , Eliot Walt , Vincent Mendez , Sylvain Lobry , Bertrand Le Saux , Devis Tuia

Multi-modal Large Language Models (MLLMs) are increasingly prominent in the field of artificial intelligence. Visual instruction fine-tuning (IFT) is a vital process for aligning MLLMs' output with user's intentions. High-quality and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Xiaotian Han , Yiqi Wang , Bohan Zhai , Quanzeng You , Hongxia Yang

Vision Large Language Models (VLLMs) represent a significant advancement in artificial intelligence by integrating image-processing capabilities with textual understanding, thereby enhancing user interactions and expanding application…

Computation and Language · Computer Science 2025-05-09 Madhur Jindal , Saurabh Deshpande

Recently, large vision language models (VLMs) have made significant strides in visual language capabilities through visual instruction tuning, showing great promise in the field of remote sensing image interpretation. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Kaixuan Lu , Ruiqian Zhang , Xiao Huang , Yuxing Xie

Aiming at answering questions based on the content of remotely sensed images, visual question answering for remote sensing data (RSVQA) has attracted much attention nowadays. However, previous works in RSVQA have focused little on the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Zhenghang Yuan , Lichao Mou , Xiao Xiang Zhu

Despite significant progress, existing research on Multimodal Large Language Models (MLLMs) mainly focuses on general visual understanding, overlooking the ability to integrate textual context associated with objects for a more…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Hongliang Wei , Xianqi Zhang , Xingtao Wang , Xiaopeng Fan , Debin Zhao

The analysis of time-sequence satellite images is a powerful tool in remote sensing; it is used to explore the statics and dynamics of the surface of the earth. Usually, the quality of multitemporal images is influenced by metrological…

Image and Video Processing · Electrical Eng. & Systems 2024-05-01 Hessah Albanwan

Change detection in satellite imagery seeks to find occurrences of targeted changes in a given scene taken at different instants. This task has several applications ranging from land-cover mapping, to anthropogenic activity monitory as well…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Hichem Sahbi , Sebastien Deschamps

Manipulating dynamic objects remains an open challenge for Vision-Language-Action (VLA) models, which, despite strong generalization in static manipulation, struggle in dynamic scenarios requiring rapid perception, temporal anticipation,…

Robotics · Computer Science 2026-01-30 Haozhe Xie , Beichen Wen , Jiarui Zheng , Zhaoxi Chen , Fangzhou Hong , Haiwen Diao , Ziwei Liu

Change detection is one of the most active research areas in Remote Sensing (RS). Most of the recently developed change detection methods are based on deep learning (DL) algorithms. This kind of algorithms is generally focused on generating…

Image and Video Processing · Electrical Eng. & Systems 2023-01-18 Valerio Marsocci , Virginia Coletta , Roberta Ravanelli , Simone Scardapane , Mattia Crespi

Recent advancements in dialogue systems have highlighted the significance of integrating multimodal responses, which enable conveying ideas through diverse modalities rather than solely relying on text-based interactions. This enrichment…

Computation and Language · Computer Science 2024-07-08 Chang-Sheng Kao , Yun-Nung Chen

Text-guided object segmentation requires both cross-modal reasoning and pixel grounding abilities. Most recent methods treat text-guided segmentation as one-shot grounding, where the model predicts pixel prompts in a single forward pass to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Xingqi He , Yujie Zhang , Shuyong Gao , Wenjie Li , Lingyi Hong , Mingxi Chen , Kaixun Jiang , Jiyuan Fu , Wenqiang Zhang

We present DeepSeek-VL, an open-source Vision-Language (VL) Model designed for real-world vision and language understanding applications. Our approach is structured around three key dimensions: We strive to ensure our data is diverse,…

Artificial Intelligence · Computer Science 2024-03-12 Haoyu Lu , Wen Liu , Bo Zhang , Bingxuan Wang , Kai Dong , Bo Liu , Jingxiang Sun , Tongzheng Ren , Zhuoshu Li , Hao Yang , Yaofeng Sun , Chengqi Deng , Hanwei Xu , Zhenda Xie , Chong Ruan