English
Related papers

Related papers: Do Vision-Language Models Have Internal World Mode…

200 papers

Engineering design is undergoing a transformative shift with the advent of AI, marking a new era in how we approach product, system, and service planning. Large language models have demonstrated impressive capabilities in enabling this…

Artificial Intelligence · Computer Science 2024-12-10 Cyril Picard , Kristen M. Edwards , Anna C. Doris , Brandon Man , Giorgio Giannone , Md Ferdous Alam , Faez Ahmed

Large language models (LLMs) can perform reasoning computations both internally within their latent space and externally by generating explicit token sequences like chains of thought. Significant progress in enhancing reasoning abilities…

Computation and Language · Computer Science 2025-04-16 Thilo Hagendorff , Sarah Fabi

Recent advances in creative AI have enabled the synthesis of high-fidelity images and videos conditioned on language instructions. Building on these developments, text-to-video diffusion models have evolved into embodied world models (EWMs)…

Robotics · Computer Science 2025-05-20 Hu Yue , Siyuan Huang , Yue Liao , Shengcong Chen , Pengfei Zhou , Liliang Chen , Maoqing Yao , Guanghui Ren

We introduce WorldVQA, a benchmark designed to evaluate the atomic visual world knowledge of Multimodal Large Language Models (MLLMs). Unlike current evaluations, which often conflate visual knowledge retrieval with reasoning, WorldVQA…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Runjie Zhou , Youbo Shao , Haoyu Lu , Bowei Xing , Tongtong Bai , Yujie Chen , Jie Zhao , Lin Sui , Haotian Yao , Zijia Zhao , Hao Yang , Haoning Wu , Zaida Zhou , Jinguo Zhu , Zhiqi Huang , Yiping Bao , Yangyang Liu , Y. Charles , Xinyu Zhou

Language and Vision-Language Models (LLMs/VLMs) have revolutionized the field of AI by their ability to generate human-like text and understand images, but ensuring their reliability is crucial. This paper aims to evaluate the ability of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Tobias Groot , Matias Valdenegro-Toro

Color serves as a fundamental dimension of human visual perception and a primary means of communicating about objects and scenes. As vision-language models (VLMs) become increasingly prevalent, understanding whether they name colors like…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Alexandra Gomez-Villa , Pablo Hernández-Cámara , Muhammad Atif Butt , Valero Laparra , Jesus Malo , Javier Vazquez-Corral

Recent advancements in Large Language Models (LLMs) and Vision-Language Models (VLMs) have made them powerful tools in embodied navigation, enabling agents to leverage commonsense and spatial reasoning for efficient exploration in…

Vision-language models (VLMs) show promise as tools for inferring affect from visual stimuli at scale; it is not yet clear how closely their outputs align with human affective ratings. We benchmarked nine VLMs, ranging from state-of-the-art…

As the application of Embodied AI Agents in avatars, wearable devices, and robotic systems continues to deepen, their core research challenges have gradually shifted from physical environment interaction to the accurate understanding of…

Robotics · Computer Science 2026-01-07 Biyuan Liu , Daigang Xu , Lei Jiang , Wenjun Guo , Ping Chen

Vision-and-Language Navigation (VLN) refers to the task of enabling autonomous robots to navigate unfamiliar environments by following natural language instructions. While recent Large Vision-Language Models (LVLMs) have shown promise in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Vebjørn Haug Kåsene , Pierre Lison

Vision-language models (VLMs) are increasingly used to evaluate multimodal content, including presentation slides, yet their slide-specific understanding remains underexplored {despite their growing role as critics in agentic, model-forward…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hyeonsu Kang , Emily Bao , Anjan Goswami

Large multimodal models exhibit remarkable intelligence, yet their embodied cognitive abilities during motion in open-ended urban 3D space remain to be explored. We introduce a benchmark to evaluate whether video-large language models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Baining Zhao , Jianjie Fang , Zichao Dai , Ziyou Wang , Jirong Zha , Weichen Zhang , Chen Gao , Yue Wang , Jinqiang Cui , Xinlei Chen , Yong Li

Modern Vision-Language Models (VLMs) achieve strong semantic recognition, yet remain brittle on elementary spatial relations such as left of, on, behind, and between. One cause of this failure arises before language reasoning begins: the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Renjie Gu , Kaichen Zhou , Yan Luo , Mengyu Wang

Large Vision-Language Models (VLMs) have achieved unprecedented success in several objective multimodal reasoning tasks. However, to further enhance their capabilities of empathetic and effective communication with humans, improving how…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Sree Bhattacharyya , James Z. Wang

When answering questions about images, humans naturally point, label, and draw to explain their reasoning. In contrast, modern vision-language models (VLMs) such as Gemini-3-Pro and GPT-5 only respond with text, which can be difficult for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Brandon Collins , Logan Bolton , Hung Huy Nguyen , Mohammad Reza Taesiri , Trung Bui , Anh Totti Nguyen

Visual Language Models (VLMs) are now increasingly being merged with Large Language Models (LLMs) to enable new capabilities, particularly in terms of improved interactivity and open-ended responsiveness. While these are remarkable…

Large-scale pretrained language models (LMs) are said to ``lack the ability to connect utterances to the world'' (Bender and Koller, 2020), because they do not have ``mental models of the world' '(Mitchell and Krakauer, 2023). If so, one…

Computation and Language · Computer Science 2024-07-10 Jiaang Li , Yova Kementchedjhieva , Constanza Fierro , Anders Søgaard

Language provides a natural interface to specify and evaluate performance on visual tasks. To realize this possibility, vision language models (VLMs) must successfully integrate visual and linguistic information. Our work compares VLMs to a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Stephanie Fu , Tyler Bonnen , Devin Guillory , Trevor Darrell

Vision-Language Models (VLMs) enable multimodal reasoning for robotic perception and interaction, but their deployment in real-world systems remains constrained by latency, limited onboard resources, and privacy risks of cloud offloading.…

Robotics · Computer Science 2026-01-22 Sarat Ahmad , Maryam Hafeez , Syed Ali Raza Zaidi

Visual Question-Answering (VQA) has become key to user experience, particularly after improved generalization capabilities of Vision-Language Models (VLMs). But evaluating VLMs for an application requirement using a standardized framework…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Neelabh Sinha , Vinija Jain , Aman Chadha