English
Related papers

Related papers: EarthGPT: A Universal Multi-modal Large Language M…

200 papers

Recent advances in natural-domain multi-modal large language models (MLLMs) have demonstrated effective spatial reasoning through visual and textual prompting. However, their direct transfer to remote sensing (RS) is hindered by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Wei Zhang , Miaoxin Cai , Yaqian Ning , Tong Zhang , Yin Zhuang , Shijian Lu , He Chen , Jun Li , Xuerui Mao

Recent advances in prompt learning have allowed users to interact with artificial intelligence (AI) tools in multi-turn dialogue, enabling an interactive understanding of images. However, it is difficult and inefficient to deliver…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Wei Zhang , Miaoxin Cai , Tong Zhang , Jun Li , Yin Zhuang , Xuerui Mao

The revolutionary capabilities of large language models (LLMs) have paved the way for multimodal large language models (MLLMs) and fostered diverse applications across various specialized domains. In the remote sensing (RS) field, however,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Dilxat Muhtar , Zhenshi Li , Feng Gu , Xueliang Zhang , Pengfeng Xiao

Multi-modal large language models (MLLMs) have achieved remarkable success in image- and region-level remote sensing (RS) image understanding tasks, such as image captioning, visual question answering, and visual grounding. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ruizhe Ou , Yuan Hu , Fan Zhang , Jiaxin Chen , Yu Liu

Automatically and rapidly understanding Earth's surface is fundamental to our grasp of the living environment and informed decision-making. This underscores the need for a unified system with comprehensive capabilities in analyzing Earth's…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Zhenshi Li , Dilxat Muhtar , Feng Gu , Xueliang Zhang , Pengfeng Xiao , Guangjun He , Xiaoxiang Zhu

Large language models (LLMs) have recently been extended to the vision-language realm, obtaining impressive general multi-modal capabilities. However, the exploration of multi-modal large language models (MLLMs) for remote sensing (RS) data…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Yang Zhan , Zhitong Xiong , Yuan Yuan

Recently, the flourishing large language models(LLM), especially ChatGPT, have shown exceptional performance in language understanding, reasoning, and interaction, attracting users and researchers from multiple fields and domains. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Haonan Guo , Xin Su , Chen Wu , Bo Du , Liangpei Zhang , Deren Li

The application of Vision-Language Models (VLMs) in remote sensing (RS) has demonstrated significant potential in traditional tasks such as scene classification, object detection, and image captioning. However, current models, which excel…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zilun Zhang , Haozhan Shen , Tiancheng Zhao , Bin Chen , Zian Guan , Yuhao Wang , Xu Jia , Yuxiang Cai , Yongheng Shang , Jianwei Yin

The mainstream paradigm of remote sensing image interpretation has long been dominated by vision-centered models, which rely on visual features for semantic understanding. However, these models face inherent limitations in handling…

Artificial Intelligence · Computer Science 2026-01-28 Haifeng Li , Wang Guo , Haiyang Wu , Mengwei Wu , Jipeng Zhang , Qing Zhu , Yu Liu , Xin Huang , Chao Tao

In recent years, multimodal large language models (MLLMs) have shown remarkable capabilities in tasks like visual question answering and common sense reasoning, while visual perception models have made significant strides in perception…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Guanqun Wang , Xinyu Wei , Jiaming Liu , Ray Zhang , Yichi Zhang , Kevin Zhang , Maurice Chong , Shanghang Zhang

Recently, the remarkable success of ChatGPT has sparked a renewed wave of interest in artificial intelligence (AI), and the advancements in visual language models (VLMs) have pushed this enthusiasm to new heights. Differring from previous…

Artificial Intelligence · Computer Science 2025-01-03 Lijie Tao , Haokui Zhang , Haizhao Jing , Yu Liu , Dawei Yan , Guoting Wei , Xizhe Xue

Vision language models (VLMs) have experienced rapid advancements through the integration of large language models (LLMs) with image-text pairs, yet they struggle with detailed regional visual understanding due to limited spatial awareness…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Qiushan Guo , Shalini De Mello , Hongxu Yin , Wonmin Byeon , Ka Chun Cheung , Yizhou Yu , Ping Luo , Sifei Liu

Large language models (LLMs), such as ChatGPT/GPT-4, have proven to be powerful tools in promoting the user experience as an AI assistant. The continuous works are proposing multi-modal large language models (MLLM), empowering LLMs with the…

Computation and Language · Computer Science 2023-10-23 Ziqiang Zheng , Jipeng Zhang , Tuan-Anh Vu , Shizhe Diao , Yue Him Wong Tim , Sai-Kit Yeung

Recent advancements in Natural Language Processing (NLP), particularly in Large Language Models (LLMs), associated with deep learning-based computer vision techniques, have shown substantial potential for automating a variety of tasks. One…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Lucas Prado Osco , Eduardo Lopes de Lemos , Wesley Nunes Gonçalves , Ana Paula Marques Ramos , José Marcato Junior

This paper introduces a novel framework, Tree-GPT, which incorporates Large Language Models (LLMs) into the forestry remote sensing data workflow, thereby enhancing the efficiency of data analysis. Currently, LLMs are unable to extract or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Siqi Du , Shengjun Tang , Weixi Wang , Xiaoming Li , Renzhong Guo

Remote Sensing Large Multi-Modal Models (RSLMMs) are developing rapidly and showcase significant capabilities in remote sensing imagery (RSI) comprehension. However, due to the limitations of existing datasets, RSLMMs have shortcomings in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Junwei Luo , Zhen Pang , Yongjun Zhang , Tingzhu Wang , Linlin Wang , Bo Dang , Jiangwei Lao , Jian Wang , Jingdong Chen , Yihua Tan , Yansheng Li

Recent progress in VLMs has demonstrated impressive capabilities across a variety of tasks in the natural image domain. Motivated by these advancements, the remote sensing community has begun to adopt VLMs for remote sensing vision-language…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Congcong Wen , Yiting Lin , Xiaokang Qu , Nan Li , Yong Liao , Xiang Li , Hui Lin

The remote sensing image intelligence understanding model is undergoing a new profound paradigm shift which has been promoted by multi-modal large language model (MLLM), i.e. from the paradigm learning a domain model (LaDM) shifts to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Linrui Xu , Ling Zhao , Wang Guo , Qiujun Li , Kewang Long , Kaiqi Zou , Yuhan Wang , Haifeng Li

Multimodal Large Language Models (MLLMs) have achieved remarkable success in vision-language tasks but their remote sensing (RS) counterpart are relatively under explored. Unlike natural images, RS imagery presents unique challenges that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Abduljaleel Adejumo , Faegheh Yeganli , Clifford Broni-bediako , Aoran Xiao , Naoto Yokoya , Mennatullah Siam

Multi-modal large language models (MLLMs) have rapidly advanced in visual tasks, yet their spatial understanding remains limited to single images, leaving them ill-suited for physical-world applications that require multi-frame reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Runsen Xu , Weiyao Wang , Hao Tang , Xingyu Chen , Xiaodong Wang , Fu-Jen Chu , Matt Feiszli , Kevin J. Liang
‹ Prev 1 2 3 10 Next ›