English
Related papers

Related papers: MM-UAVBench: How Well Do Multimodal Large Language…

200 papers

Multimodal Large Language Models (MLLMs) have made significant strides in natural images and satellite remote sensing images. However, understanding low-altitude drone scenarios remains a challenge. Existing datasets primarily focus on a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yang Zhan , Yuan Yuan

Multi-view understanding, the ability to reconcile visual information across diverse viewpoints for effective navigation, manipulation, and 3D scene comprehension, is a fundamental challenge in Multi-Modal Large Language Models (MLLMs) to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Chun-Hsiao Yeh , Chenyu Wang , Shengbang Tong , Ta-Ying Cheng , Ruoyu Wang , Tianzhe Chu , Yuexiang Zhai , Yubei Chen , Shenghua Gao , Yi Ma

Vision-Language Models (VLMs), leveraging their powerful visual perception and reasoning capabilities, have been widely applied in Unmanned Aerial Vehicle (UAV) tasks. However, the spatial intelligence capabilities of existing VLMs in UAV…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Lingfeng Zhang , Yuchen Zhang , Hongsheng Li , Haoxiang Fu , Yingbo Tang , Hangjun Ye , Long Chen , Xiaojun Liang , Xiaoshuai Hao , Wenbo Ding

Recent evaluations of Large Multimodal Models (LMMs) have explored their capabilities in various domains, with only few benchmarks specifically focusing on urban environments. Moreover, existing urban benchmarks have been limited to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Baichuan Zhou , Haote Yang , Dairong Chen , Junyan Ye , Tianyi Bai , Jinhua Yu , Songyang Zhang , Dahua Lin , Conghui He , Weijia Li

Large Vision-Language Models (LVLMs) show significant strides in general-purpose multimodal applications such as visual dialogue and embodied navigation. However, existing multimodal evaluation benchmarks cover a limited number of…

Uncrewed Aerial Vehicles (UAVs) are widely deployed across diverse applications due to their mobility and agility. Recent advances in Large Language Models (LLMs) offer a transformative opportunity to enhance UAV intelligence beyond…

Robotics · Computer Science 2026-03-03 Yousef Emami , Hao Zhou , Radha Reddy , Atefeh Hajijamali Arani , Biliang Wang , Kai Li , Luis Almeida , Zhu Han

Recent breakthroughs in multimodal large language models (MLLMs) have endowed AI systems with unified perception, reasoning and natural-language interaction across text, image and video streams. Meanwhile, Unmanned Aerial Vehicle (UAV)…

Multimodal Large Language Models (MLLMs) have shown promise in single-agent vision tasks, yet benchmarks for evaluating multi-agent collaborative perception remain scarce. This gap is critical, as multi-drone systems provide enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Jirong Zha , Yuxuan Fan , Tianyu Zhang , Geng Chen , Yingfeng Chen , Chen Gao , Xinlei Chen

Multimodal Large Language Models (MLLMs) have achieved significant advances in integrating visual and linguistic information, yet their ability to reason about complex and real-world scenarios remains limited. The existing benchmarks are…

Low-altitude mobility, exemplified by unmanned aerial vehicles (UAVs), has introduced transformative advancements across various domains, like transportation, logistics, and agriculture. Leveraging flexible perspectives and rapid…

Multimodal large language models (MLLMs) have demonstrated powerful capabilities in general spatial understanding and reasoning. However, their fine-grained spatial understanding and reasoning capabilities in complex urban scenarios have…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Jun Zhang , Jie Feng , Long Chen , Junhui Wang , Zhicheng Liu , Depeng Jin , Yong Li

In recent years, unmanned aerial vehicles (UAVs) have become increasingly popular in our daily lives and have attracted significant research interest in software engineering. At the same time, large language models (LLMs) have made notable…

Software Engineering · Computer Science 2025-12-15 Yihua Chen , Xingle Que , Jiashuo Zhang , Jiachi Chen , Ting Cui , Guangshun Li , Ting Chen

Vision-language models (VLMs) are essential to Embodied AI, enabling robots to perceive, reason, and act in complex environments. They also serve as the foundation for the recent Vision-Language-Action (VLA) models. Yet most evaluations of…

Spatial reasoning is a fundamental capability of multimodal large language models (MLLMs), yet their performance in open aerial environments remains underexplored. In this work, we present Open3D-VQA, a novel benchmark for evaluating MLLMs'…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Weichen Zhang , Zile Zhou , Xin Zeng , Xuchen Liu , Jianjie Fang , Chen Gao , Yong Li , Jinqiang Cui , Xinlei Chen , Xiao-Ping Zhang

Autonomous aerial systems increasingly rely on large language models (LLMs) for mission planning, perception, and decision-making, yet the lack of standardized and physically grounded benchmarks limits systematic evaluation of their…

Artificial Intelligence · Computer Science 2025-11-17 Mohamed Amine Ferrag , Abderrahmane Lakas , Merouane Debbah

Astronomical image interpretation presents a significant challenge for applying multimodal large language models (MLLMs) to specialized scientific tasks. Existing benchmarks focus on general multimodal capabilities but fail to capture the…

Instrumentation and Methods for Astrophysics · Physics 2025-10-22 Jinghang Shi , Xiaoyu Tang , Yang Huang , Yuyang Li , Xiao Kong , Yanxia Zhang , Caizhan Yue

Built on the power of LLMs, numerous multimodal large language models (MLLMs) have recently achieved remarkable performance on various vision-language tasks. However, most existing MLLMs and benchmarks primarily focus on single-image input…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Haowei Liu , Xi Zhang , Haiyang Xu , Yaya Shi , Chaoya Jiang , Ming Yan , Ji Zhang , Fei Huang , Chunfeng Yuan , Bing Li , Weiming Hu

Spatial cognition is fundamental to real-world multimodal intelligence, allowing models to effectively interact with the physical environment. While multimodal large language models (MLLMs) have made significant strides, existing benchmarks…

Artificial Intelligence · Computer Science 2026-05-08 Peiran Xu , Sudong Wang , Yao Zhu , Jianing Li , Gege Qi , Yunjian Zhang

The emergence of large language models (LLMs) opens new frontiers for unmanned aerial vehicle (UAVs), yet existing systems remain confined to predefined tasks due to hardware-software co-design challenges. This paper presents the first…

Robotics · Computer Science 2025-03-12 Ji Zhao , Xiao Lin

Large Vision-Language Models (LVLMs) and Multimodal Large Language Models (MLLMs) have demonstrated outstanding performance in various general multimodal applications and have shown increasing promise in specialized domains. However, their…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Chenwei Lin , Hanjia Lyu , Xian Xu , Jiebo Luo
‹ Prev 1 2 3 10 Next ›