English
Related papers

Related papers: World Models in Words: Auditing Physical State-Tra…

200 papers

Autonomous driving systems depend on on models that can reason about high-level scene contexts and accurately predict the dynamics of their surrounding environment. Vision- Language Models (VLMs) have recently emerged as promising tools for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Stefan Englmeier , Katharina Winter , Fabian B. Flohr

Vision-Language Models like GPT-4, LLaVA, and CogVLM have surged in popularity recently due to their impressive performance in several vision-language tasks. Current evaluation methods, however, overlook an essential component: uncertainty,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Vasily Kostumov , Bulat Nutfullin , Oleg Pilipenko , Eugene Ilyushin

Vision-Language Models (VLMs) achieve strong cross-modal performance, yet recent evidence suggests they over-rely on textual descriptions while under-utilizing visual evidence -- a phenomenon termed ``text shortcut learning.'' We propose an…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Lijie Zhou

Industrial diagrams such as piping and instrumentation diagrams (P&IDs) are essential for the design, operation, and maintenance of industrial plants. Converting these diagrams into digital form is an important step toward building digital…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Sanjukta Ghosh

Vision-Language Models (VLMs) have demonstrated notable promise in autonomous driving by offering the potential for multimodal reasoning through pretraining on extensive image-text pairs. However, adapting these models from broad web-scale…

Robotics · Computer Science 2025-06-18 Yupeng Zhou , Can Cui , Juntong Peng , Zichong Yang , Juanwu Lu , Jitesh H Panchal , Bin Yao , Ziran Wang

Most production-level deployments for Visual Question Answering (VQA) tasks are still build as processing pipelines of independent steps including image pre-processing, object- and text detection, Optical Character Recognition (OCR) and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Bianca Lamm , Janis Keuper

This work investigates a fundamental question: Do Video-Language Models (VidLMs) robustly account for video content, temporal sequence, and motion? Our investigation shows that, surprisingly, they often do not. We introduce REVEAL{}, a…

Vision-Language Models (VLMs) exhibit strong visual reasoning capabilities, yet they still struggle with 3D understanding. In particular, VLMs often fail to infer a text-consistent goal 6D pose of a target object in a 3D scene. However, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Sangwon Baik , Gunhee Kim , Mingi Choi , Hanbyul Joo

Visual Language Models (VLMs) are now increasingly being merged with Large Language Models (LLMs) to enable new capabilities, particularly in terms of improved interactivity and open-ended responsiveness. While these are remarkable…

Solving complex, long-horizon robotic manipulation tasks requires a deep understanding of physical interactions, reasoning about their long-term consequences, and precise high-level planning. Vision-Language Models (VLMs) offer a general…

Robotics · Computer Science 2026-02-24 Yanting Yang , Shenyuan Gao , Qingwen Bu , Li Chen , Dimitris N. Metaxas

Psychophysical experiments remain the most reliable approach for perceptual image quality assessment (IQA), yet their cost and limited scalability encourage automated approaches. We investigate whether Vision Language Models (VLMs) can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Imran Mehmood , Imad Ali Shah , Ming Ronnier Luo , Brian Deegan

The use of Large Language Models (LLMs) to support patients in addressing medical questions is becoming increasingly prevalent. However, most of the measures currently used to evaluate the performance of these models in this context only…

Human-Computer Interaction · Computer Science 2026-04-22 Abu Noman Md Sakib , Md. Main Oddin Chisty , Zijie Zhang

Solving complex long-horizon robotic manipulation problems requires sophisticated high-level planning capabilities, the ability to reason about the physical world, and reactively choose appropriate motor skills. Vision-language models…

Robotics · Computer Science 2025-02-25 Yunhai Feng , Jiaming Han , Zhuoran Yang , Xiangyu Yue , Sergey Levine , Jianlan Luo

This report provides an architecture-led analysis of two modern vision-language models (VLMs), Qwen2.5-VL-7B-Instruct and Llama-4-Scout-17B-16E-Instruct, and explains how their architectural properties map to a practical video-to-artifact…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Thomson Tong , Diba Darooneh

Vision-Language Models (VLMs) are increasingly deployed in autonomous driving and embodied AI systems, where reliable perception is critical for safe semantic reasoning and decision-making. While recent VLMs demonstrate strong performance…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Guo Cheng

Recent advances in Vision-Language Models (VLMs) have improved performance in multi-modal learning, raising the question of whether these models truly understand the content they process. Crucially, can VLMs detect when a reasoning process…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yang Shi , Yifeng Xie , Minzhe Guo , Liangsi Lu , Mingxuan Huang , Jingchao Wang , Zhihong Zhu , Boyan Xu , Zhiqi Huang

Real world deployments often expose modern object recognition models to domain shifts that precipitate a severe drop in accuracy. Such shifts encompass (i) variations in low level image statistics, (ii) changes in object pose and viewpoint,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Junghyun Park , Tuan Anh Nguyen , Dugki Min

Recent advances in vision-language models (VLMs) have improved image captioning for cultural heritage. However, inferring structured cultural metadata (e.g., creator, origin, period) from visual input remains underexplored. We introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Yuechen Jiang , Enze Zhang , Md Mohsinul Kabir , Qianqian Xie , Stavroula Golfomitsou , Konstantinos Arvanitis , Sophia Ananiadou

As Vision-Language Models (VLMs) become integral to educational decision-making, ensuring their fairness is paramount. However, current text-centric evaluations neglect the visual modality, leaving an unregulated channel for latent social…

Artificial Intelligence · Computer Science 2026-04-15 Ruijia Li , Mingzi Zhang , Zengyi Yu , Yuang Wei , Bo Jiang

Autonomous driving systems often infer pedestrian yielding behavior from geometric and kinematic cues alone, limiting their ability to reason about visual scene context and age-dependent behavioral variability. This limitation can produce…

Systems and Control · Electrical Eng. & Systems 2026-04-28 Qingwen Pu , Kun Xie , Yuxiang Liu