English
Related papers

Related papers: Holistic Evaluation of Multimodal LLMs on Spatial …

200 papers

How to integrate and verify spatial intelligence in foundation models remains an open challenge. Current practice often proxies Visual-Spatial Intelligence (VSI) with purely textual prompts and VQA-style scoring, which obscures geometry,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Guanlin Wu , Boyan Su , Yang Zhao , Pu Wang , Yichen Lin , Hao Frank Yang

Multimodal large language models (MLLMs), building upon the foundation of powerful large language models (LLMs), have recently demonstrated exceptional capabilities in generating not only texts but also images given interleaved multimodal…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Bohao Li , Yuying Ge , Yixiao Ge , Guangzhi Wang , Rui Wang , Ruimao Zhang , Ying Shan

In the rapid development of artificial intelligence, solving complex AI tasks is a crucial technology in intelligent mobile networks. Despite the good performance of specialized AI models in intelligent mobile networks, they are unable to…

Artificial Intelligence · Computer Science 2023-10-16 Lei Yao , Yong Zhang , Zilong Yan , Jialu Tian

Spatial intelligence unfolds through a perception-action loop: agents act to acquire observations, and reason about how observations vary as a function of action. Rather than passively processing what is seen, they actively uncover what is…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yining Hong , Jiageng Liu , Han Yin , Manling Li , Leonidas Guibas , Li Fei-Fei , Jiajun Wu , Yejin Choi

Despite significant advancements in general AI, its effectiveness in the medical domain is limited by the lack of specialized medical knowledge. To address this, we formulate GMAI-VL-5.5M, a multimodal medical dataset created by converting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Tianbin Li , Yanzhou Su , Wei Li , Bin Fu , Zhe Chen , Ziyan Huang , Guoan Wang , Chenglong Ma , Ying Chen , Ming Hu , Yanjun Li , Pengcheng Chen , Xiaowei Hu , Zhongying Deng , Yuanfeng Ji , Jin Ye , Yu Qiao , Junjun He

Recent advancements in Generative AI offer promising capabilities for spatial analysis. Despite their potential, the integration of generative AI with established GIS platforms remains underexplored. In this study, we propose a framework…

Artificial Intelligence · Computer Science 2024-11-25 Temitope Akinboyewa , Zhenlong Li , Huan Ning , M. Naser Lessani

The recent swift development of LLMs like GPT-4, Gemini, and GPT-3.5 offers a transformative opportunity in medicine and healthcare, especially in digital diagnostics. This study evaluates each model diagnostic abilities by interpreting a…

Computation and Language · Computer Science 2024-05-14 Gaurav Kumar Gupta , Aditi Singh , Sijo Valayakkad Manikandan , Abul Ehtesham

We propose SETI (Systematicity Evaluation of Textual Inference), a novel and comprehensive benchmark designed for evaluating pre-trained language models (PLMs) for their systematicity capabilities in the domain of textual inference.…

Computation and Language · Computer Science 2023-05-25 Xiyan Fu , Anette Frank

Large Multimodal Models (LMMs) have achieved strong performance across a range of vision and language tasks. However, their spatial reasoning capabilities are under-investigated. In this paper, we construct a novel VQA dataset, Spatial-MM,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Fatemeh Shiri , Xiao-Yu Guo , Mona Golestan Far , Xin Yu , Gholamreza Haffari , Yuan-Fang Li

The Multimodal Large Language Model (MLLM) is currently experiencing rapid growth, driven by the advanced capabilities of LLMs. Unlike earlier specialists, existing MLLMs are evolving towards a Multimodal Generalist paradigm. Initially…

Large language models (LLMs) excel at explicit reasoning, but their implicit computational strategies remain underexplored. Decades of psychophysics research show that humans intuitively process and integrate noisy signals using…

Computation and Language · Computer Science 2025-12-03 Julian Ma , Jun Wang , Zafeirios Fountas

The rapid development of Generative AI is bringing innovative changes to education and assessment. As the prevalence of students utilizing AI for assignments increases, concerns regarding academic integrity and the validity of assessments…

Artificial Intelligence · Computer Science 2025-12-18 Seok-Hyun Ga , Chun-Yen Chang

Large Language Models (LLMs) have rapidly advanced, with Gemini-3-Pro setting a new performance milestone. In this work, we explore collective intelligence as an alternative to monolithic scaling, and demonstrate that open-source LLMs'…

Artificial Intelligence · Computer Science 2026-02-12 Shengji Tang , Weihao Lin , Peng Ye , Jingqi Ye , Hao Li , Yiqun Zhang , Xiaosong Wang , Bo Zhang , Shuyue Hu , Tao Chen , Lei Bai , Wanli Ouyang

As the field progresses toward Artificial General Intelligence (AGI), there is a pressing need for more comprehensive and insightful evaluation frameworks that go beyond aggregate performance metrics. This paper introduces a unified rating…

GeoAI is evolving rapidly, fueled by diverse geospatial datasets like traffic patterns, environmental data, and crowdsourced OpenStreetMap (OSM) information. While sophisticated AI models are being developed, existing benchmarks are often…

Machine Learning · Computer Science 2025-12-18 Julia Moska , Oleksii Furman , Kacper Kozaczko , Szymon Leszkiewicz , Jakub Polczyk , Piotr Gramacki , Piotr Szymański

4D spatial intelligence involves perceiving and processing how objects move or change over time. Humans naturally possess 4D spatial intelligence, supporting a broad spectrum of spatial reasoning abilities. To what extent can Multimodal…

For human cognitive process, spatial reasoning and perception are closely entangled, yet the nature of this interplay remains underexplored in the evaluation of multimodal large language models (MLLMs). While recent MLLM advancements show…

Computation and Language · Computer Science 2025-08-28 Chengzu Li , Wenshan Wu , Huanyu Zhang , Qingtao Li , Zeyu Gao , Yan Xia , José Hernández-Orallo , Ivan Vulić , Furu Wei

Specialized clinical AI assistants are rapidly entering medical practice, often framed as safer or more reliable than general-purpose large language models (LLMs). Yet, unlike frontier models, these clinical tools are rarely subjected to…

Computation and Language · Computer Science 2025-12-02 Krithik Vishwanath , Mrigayu Ghosh , Anton Alyakin , Daniel Alexander Alber , Yindalon Aphinyanaphongs , Eric Karl Oermann

Recent advancements in Spatial Intelligence (SI) have predominantly relied on Vision-Language Models (VLMs), yet a critical question remains: does spatial understanding originate from visual encoders or the fundamental reasoning backbone?…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Zhongbin Guo , Zhen Yang , Yushan Li , Xinyue Zhang , Wenyu Gao , Jiacheng Wang , Chengzhi Li , Xiangrui Liu , Ping Jian

Recently spatial-temporal intelligence of Visual-Language Models (VLMs) has attracted much attention due to its importance for autonomous driving, embodied AI and general AI. Existing spatial-temporal benchmarks mainly focus on egocentric…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Qinghongbing Xie , Zhaoyuan Xia , Feng Zhu , Lijun Gong , Ziyue Li , Rui Zhao , Long Zeng