English
Related papers

Related papers: Foundation Models for Remote Sensing: An Analysis …

200 papers

Multimodal Large Language Models (MLLMs) inherit the superior text understanding capabilities of LLMs and extend these capabilities to multimodal scenarios. These models achieve excellent results in the general domain of multimodal tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jinlong He , Pengfei Li , Gang Liu , Shenjun Zhong

The revolutionary capabilities of large language models (LLMs) have paved the way for multimodal large language models (MLLMs) and fostered diverse applications across various specialized domains. In the remote sensing (RS) field, however,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Dilxat Muhtar , Zhenshi Li , Feng Gu , Xueliang Zhang , Pengfeng Xiao

The use of Multimodal Large Language Models (MLLMs) as an end-to-end solution for Embodied AI and Autonomous Driving has become a prevailing trend. While MLLMs have been extensively studied for visual semantic understanding tasks, their…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yun Li , Yiming Zhang , Tao Lin , Xiangrui Liu , Wenxiao Cai , Zheng Liu , Bo Zhao

Multi-modal large language models (MLLMs) have enabled numerous advances in understanding and reasoning in domains like vision, but we have not yet seen this broad success for time-series. Although prior works on time-series MLLMs have…

Machine Learning · Computer Science 2024-12-05 Winnie Chow , Lauren Gardiner , Haraldur T. Hallgrímsson , Maxwell A. Xu , Shirley You Ren

Multimodal Large Language Models (MLLMs) that directly process RGB inputs for tasks like 3D localization and navigation have shown remarkable potential. However, we argue that these RGB-only approaches are fundamentally flawed in their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Gongjie Zhang , Wenhao Li , Quanhao Qian , Jiuniu Wang , Deli Zhao , Shijian Lu , Ran Xu

Humans possess spatial reasoning abilities that enable them to understand spaces through multimodal observations, such as vision and sound. Large multimodal reasoning models extend these abilities by learning to perceive and reason, showing…

Humans build viewpoint-independent cognitive maps through navigation, enabling intuitive reasoning about object permanence and spatial relations. We argue that multimodal large language models (MLLMs), despite extensive video training, lack…

Machine Learning · Computer Science 2025-12-02 Jacob Thompson , Emiliano Garcia-Lopez , Yonatan Bisk

We investigate the generalization boundaries of current Multimodal Large Language Models (MLLMs) via comprehensive evaluation under out-of-distribution scenarios and domain-specific tasks. We evaluate their zero-shot generalization across…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Xingxuan Zhang , Jiansheng Li , Wenjing Chu , Junjia Hai , Renzhe Xu , Yuqing Yang , Shikai Guan , Jiazheng Xu , Peng Cui

Large Language Models (LLMs) have been found to struggle with systematic reasoning. Even on tasks where they appear to perform well, their performance often depends on shortcuts, rather than on genuine reasoning abilities, leading them to…

Artificial Intelligence · Computer Science 2025-06-03 Irtaza Khalid , Amir Masoud Nourollah , Steven Schockaert

Large Multimodal Models (LMMs) have achieved remarkable progress in general-purpose vision--language understanding, yet they remain limited in tasks requiring precise object-level grounding, fine-grained spatial reasoning, and controllable…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yuqian Yuan , Wenqiao Zhang , Juekai Lin , Yu Zhong , Mingjian Gao , Binhe Yu , Yunqi Cao , Wentong Li , Yueting Zhuang , Beng Chin Ooi

Objectives: The rapid advancement of Multimodal Large Language Models (MLLMs) has significantly enhanced their reasoning capabilities, enabling a wide range of intelligent applications. However, these advancements also raise critical…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Xian Zhang , Xiang Cheng

Spatial understanding is a critical capability for vision foundation models. While recent advances in large vision models or vision-language models (VLMs) have expanded recognition capabilities, most benchmarks emphasize localization…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Vahid Mirjalili , Ramin Giahi , Sriram Kollipara , Akshay Kekuda , Kehui Yao , Kai Zhao , Jianpeng Xu , Kaushiki Nag , Sinduja Subramaniam , Topojoy Biswas , Evren Korpeoglu , Kannan Achan

Remote sensing has evolved from simple image acquisition to complex systems capable of integrating and processing visual and textual data. This review examines the development and application of multi-modal language models (MLLMs) in remote…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Xintian Sun , Benji Peng , Charles Zhang , Fei Jin , Qian Niu , Junyu Liu , Keyu Chen , Ming Li , Pohsun Feng , Ziqian Bi , Ming Liu , Xinyuan Song , Yichao Zhang

Large language models (LLMs) and multimodal large language models (MLLMs) have significantly advanced artificial intelligence. However, visual reasoning, reasoning involving both visual and textual inputs, remains underexplored. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 I-Sheng Fang , Jun-Cheng Chen

Large Language Models (LLMs) have shown remarkable performance across diverse tasks without domain-specific training, fueling interest in their potential for time-series forecasting. While LLMs have shown potential in zero-shot forecasting…

Machine Learning · Computer Science 2025-06-03 Junwoo Park , Hyuck Lee , Dohyun Lee , Daehoon Gwak , Jaegul Choo

The rapid advancement of Large Language Models (LLMs), particularly those trained on multilingual corpora, has intensified the need for a deeper understanding of their performance across a diverse range of languages and model sizes. Our…

Computation and Language · Computer Science 2025-01-13 Rhitabrat Pokharel , Sina Bagheri Nezhad , Ameeta Agrawal , Suresh Singh

Multimodal Large Language Models (MLLMs) have made notable advances in visual understanding, yet their abilities to recognize objects modified by specific attributes remain an open question. To address this, we explore MLLMs' reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Jiaxuan Li , Junwen Mo , MinhDuc Vo , Akihiro Sugimoto , Hideki Nakayama

The advantages of pre-trained large language models (LLMs) are apparent in a variety of language processing tasks. But can a language model's knowledge be further harnessed to effectively disambiguate objects and navigate decision-making…

Robotics · Computer Science 2024-01-09 Connie Jiang , Yiqing Xu , David Hsu

Recent advances in Multimodal Large Language Models (MLLMs) have significantly improved 2D visual understanding, prompting interest in their application to complex 3D reasoning tasks. However, it remains unclear whether these models can…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Xiaoyu Zhan , Wenxuan Huang , Hao Sun , Xinyu Fu , Changfeng Ma , Shaosheng Cao , Bohan Jia , Shaohui Lin , Zhenfei Yin , Lei Bai , Wanli Ouyang , Yuanqi Li , Jie Guo , Yanwen Guo

Multi-modal large language models (MLLMs) have demonstrated remarkable vision-language capabilities, primarily due to the exceptional in-context understanding and multi-task learning strengths of large language models (LLMs). The advent of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jianing Li , Xi Nan , Ming Lu , Li Du , Shanghang Zhang