English
Related papers

Related papers: EarthGPT: A Universal Multi-modal Large Language M…

200 papers

The remarkable achievements of ChatGPT and GPT-4 have sparked a wave of interest and research in the field of large language models for Artificial General Intelligence (AGI). These models provide intelligent solutions close to human…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Xiang Li , Congcong Wen , Yuan Hu , Zhenghang Yuan , Xiao Xiang Zhu

Recent advances in multimodal large language models (MLLMs) have accelerated progress in domain-oriented AI, yet their development in geoscience and remote sensing (RS) remains constrained by distinctive challenges: wide-ranging…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Aoran Xiao , Shihao Cheng , Yonghao Xu , Yexian Ren , Hongruixuan Chen , Naoto Yokoya

Multimodal large language models (MLLMs) have emerged as a prominent area of interest within the research community, given their proficiency in handling and reasoning with non-textual data, including images and videos. This study seeks to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Zhenhua Xu , Yujia Zhang , Enze Xie , Zhen Zhao , Yong Guo , Kwan-Yee. K. Wong , Zhenguo Li , Hengshuang Zhao

Recently, Multimodal Large Language Models (MLLMs) have gained significant attention for their remarkable ability to process and analyze non-textual data, such as images, videos, and audio. Notably, several adaptations of general-domain…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Wenhui Zhu , Xin Li , Xiwen Chen , Peijie Qiu , Vamsi Krishna Vasa , Xuanzhao Dong , Yanxi Chen , Natasha Lepore , Oana Dumitrascu , Yi Su , Yalin Wang

Multimodal Large Language Models (MLLMs) show promise for medical applications, yet progress in dermatology lags due to limited training data, narrow task coverage, and lack of clinically-grounded supervision that mirrors expert diagnostic…

Computation and Language · Computer Science 2026-01-06 Jinghan Ru , Siyuan Yan , Yuguo Yin , Yuexian Zou , Zongyuan Ge

Recent advancements in Large Vision-Language Models (VLMs) have shown great promise in natural image domains, allowing users to hold a dialogue about given visual content. However, such general-domain VLMs perform poorly for Remote Sensing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Kartik Kuckreja , Muhammad Sohail Danish , Muzammal Naseer , Abhijit Das , Salman Khan , Fahad Shahbaz Khan

The application of Vision-Language Models (VLMs) in remote sensing (RS) image understanding has achieved notable progress, demonstrating the basic ability to recognize and describe geographical entities. However, existing RS-VLMs are mostly…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Xianzhi Ma , Jianhui Li , Changhua Pei , Hao Liu

This survey and application guide to multimodal large language models(MLLMs) explores the rapidly developing field of MLLMs, examining their architectures, applications, and impact on AI and Generative Models. Starting with foundational…

Artificial Intelligence · Computer Science 2025-12-02 Chia Xin Liang , Pu Tian , Caitlyn Heqi Yin , Yao Yua , Wei An-Hou , Li Ming , Xinyuan Song , Tianyang Wang , Ziqian Bi , Ming Liu

Reliable interpretation of multimodal data in dentistry is essential for automated oral healthcare, yet current multimodal large language models (MLLMs) struggle to capture fine-grained dental visual details and lack sufficient reasoning…

Multimodal Large Language Models (MLLMs) exhibit impressive capabilities across a variety of tasks, especially when equipped with carefully designed visual prompts. However, existing studies primarily focus on logical reasoning and visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Dingning Liu , Cheng Wang , Peng Gao , Renrui Zhang , Xinzhu Ma , Yuan Meng , Zhihui Wang

Multi-modal large language models (MLLMs) have achieved remarkable success in fine-grained visual understanding across a range of tasks. However, they often encounter significant challenges due to inadequate alignment for fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Wei Wang , Zhaowei Li , Qi Xu , Linfeng Li , YiQing Cai , Botian Jiang , Hang Song , Xingcan Hu , Pengyu Wang , Li Xiao

Generating lifelike human motions from descriptive texts has experienced remarkable research focus in the recent years, propelled by the emerging requirements of digital humans.Despite impressive advances, existing approaches are often…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Yuan Wang , Di Huang , Yaqi Zhang , Wanli Ouyang , Jile Jiao , Xuetao Feng , Yan Zhou , Pengfei Wan , Shixiang Tang , Dan Xu

Multimodal Large Language Models (MLLMs) inherit the superior text understanding capabilities of LLMs and extend these capabilities to multimodal scenarios. These models achieve excellent results in the general domain of multimodal tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jinlong He , Pengfei Li , Gang Liu , Shenjun Zhong

Large models (LMs), such as ChatGPT, have made a significant impact across diverse domains and hold great potential to facilitate the evolution of network intelligence. Wireless-native multi-modal large models (WMLMs) can sense and…

Networking and Internet Architecture · Computer Science 2025-12-01 Zhuoran Duan , Yuhao Wei , Guoshun Nan , Zijun Wang , Yan Yan , Lihua Xiong , Yuhan Ran , Ji Zhang , Jian Li , Qimei Cui , Xiaofeng Tao , Tony Q. S. Quek

Large language models (LLMs) and multimodal models have become powerful general-purpose reasoning systems. However, radio-frequency (RF) signals, which underpin wireless systems, are still not natively supported by these models. Existing…

Signal Processing · Electrical Eng. & Systems 2026-02-17 Hang Zou , Yu Tian , Bohao Wang , Lina Bariah , Samson Lasaulce , Chongwen Huang , Mérouane Debbah

The rapid advancement of Large Language Models (LLMs) has opened new possibilities in Multi-Robot Systems (MRS), enabling enhanced communication, task allocation and planning, and human-robot interaction. Unlike traditional single-robot and…

Robotics · Computer Science 2026-05-05 Peihan Li , Zijian An , Shams Abrar , Lifeng Zhou

In this paper, we introduce the task of visual grounding for remote sensing data (RSVG). RSVG aims to localize the referred objects in remote sensing (RS) images with the guidance of natural language. To retrieve rich information from RS…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Yang Zhan , Zhitong Xiong , Yuan Yuan

Earth vision has achieved milestones in geospatial object recognition but lacks exploration in object-relational reasoning, limiting comprehensive scene understanding. To address this, a progressive Earth vision-language understanding and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Junjue Wang , Yanfei Zhong , Zihang Chen , Zhuo Zheng , Ailong Ma , Liangpei Zhang

Multimodal Large Language Models (MLLMs) have demonstrated impressive progress in single-image grounding and general multi-image understanding. Recently, some methods begin to address multi-image grounding. However, they are constrained by…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Shurong Zheng , Yousong Zhu , Hongyin Zhao , Fan Yang , Yufei Zhan , Ming Tang , Jinqiao Wang

The multimodal fusion of images and scene captions has been extensively explored and applied in various fields. However, when dealing with complex remote sensing (RS) scenes, existing studies have predominantly concentrated on architectural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Ziyi Wang , Xianping Ma , Ziyao Wang , Hongyang Zhang , Man On Pun