English
Related papers

Related papers: Shape vs. Context: Examining Human--AI Gaps in Amb…

200 papers

Recent advances in vision-language models (VLMs) have enabled impressive multi-modal reasoning and understanding. Yet, whether these models truly grasp visual persuasion-how visual cues shape human attitudes and decisions-remains unclear.…

Computation and Language · Computer Science 2025-11-24 Gyuwon Park

Offering a promising solution to the scalability challenges associated with human evaluation, the LLM-as-a-judge paradigm is rapidly gaining traction as an approach to evaluating large language models (LLMs). However, there are still many…

Computation and Language · Computer Science 2025-08-19 Aman Singh Thakur , Kartik Choudhary , Venkat Srinik Ramayapally , Sankaran Vaidyanathan , Dieuwke Hupkes

Leveraging large-scale Text-to-Image (TTI) models have become a common technique for generating exemplar or training dataset in the fields of image synthesis, video editing, 3D reconstruction. However, semantic structural visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Bumsoo Kim , Wonseop Shin , Kyuchul Lee , Yonghoon Jung , Sanghyun Seo

Vision-language models (VLMs) achieve strong benchmark results, yet can exhibit systematic perceptual weaknesses: structured, large changes to pixel values can cause confident yet nonsensical predictions, even when the underlying scene…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Nicoleta-Nina Basoc , Adrian Cosma , Emilian Radoi

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng

Despite the ubiquity of large language models (LLMs) in AI research, the question of embodiment in LLMs remains underexplored, distinguishing them from embodied systems in robotics where sensory perception directly informs physical action.…

Computation and Language · Computer Science 2024-05-28 Philipp Wicke , Lennart Wachowiak

Recent advances in vision-language models (VLMs) have improved image captioning for cultural heritage. However, inferring structured cultural metadata (e.g., creator, origin, period) from visual input remains underexplored. We introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Yuechen Jiang , Enze Zhang , Md Mohsinul Kabir , Qianqian Xie , Stavroula Golfomitsou , Konstantinos Arvanitis , Sophia Ananiadou

Large vision-language models frequently struggle to accurately predict responses provided by multiple human annotators, particularly when those responses exhibit human uncertainty. In this study, we focus on the Visual Question Answering…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Jian Lan , Diego Frassinelli , Barbara Plank

This research investigates both explicit and implicit social biases exhibited by Vision-Language Models (VLMs). The key distinction between these bias types lies in the level of awareness: explicit bias refers to conscious, intentional…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Jen-tse Huang , Jiantong Qin , Jianping Zhang , Youliang Yuan , Wenxuan Wang , Jieyu Zhao

Vision-Language Models (VLMs) are increasingly deployed in diverse cultural contexts, yet their internal biases remain poorly understood. In this work, we propose a novel framework to systematically evaluate how VLMs encode cultural…

Computers and Society · Computer Science 2025-05-28 Avinash Madasu , Vasudev Lal , Phillip Howard

This work investigates the capabilities of current vision-language models (VLMs) in visual understanding and attribute measurement of primitive shapes using a benchmark focused on controlled 2D shape configurations with variations in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Ankit Yadav , Lingqiao Liu , Yuankai Qi

Vision-Language(-Action) Models (VLMs) are increasingly applied to interactive environments, yet existing benchmarks often overlook the complex physical reasoning required for point-and-click puzzle games. This paper introduces…

Artificial Intelligence · Computer Science 2026-05-19 Maximilian Triebel , Marco Menner , Dominik Helfenstein

Recent advances in multimodal models have raised questions about whether vision-and-language models (VLMs) integrate cross-modal information in ways that reflect human cognition. One well-studied test case in this domain is the bouba-kiki…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Tom Kouwenhoven , Kiana Shahrasbi , Tessa Verhoef

Gaps arise between a language model's use of concepts and people's expectations. This gap is critical when LLMs generate text to help people communicate via Augmentative and Alternative Communication (AAC) tools. In this work, we introduce…

Computation and Language · Computer Science 2025-11-11 Shadab Choudhury , Asha Kumar , Lara J. Martin

People increasingly turn to large language models (LLMs) to interpret ambiguous social situations: a delayed text reply, an unusually cold supervisor, a teacher's mixed signals, or a boundary-crossing friend. Yet in many such cases, no…

Human-Computer Interaction · Computer Science 2026-04-28 Qiming Yuan , Linyi Han , Nam Ling , Cihan Ruan

Large language models (LLMs) are increasingly used to simulate human behavior in experimental settings, but they systematically diverge from human decisions in complex decision-making environments, where participants must anticipate others'…

Artificial Intelligence · Computer Science 2026-01-06 Letian Kong , Qianran , Jin , Renyu Zhang

Large-scale Vision-Language Models (LVLMs) are being deployed in real-world settings that require visual inference. As capabilities improve, applications in navigation, education, and accessibility are becoming practical. These settings…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Kazuki Hayashi , Shintaro Ozaki , Yusuke Sakai , Hidetaka Kamigaito , Taro Watanabe

The use of Vision-Language Models (VLMs) in automated driving applications is becoming increasingly common, with the aim of leveraging their reasoning and generalisation capabilities to handle long tail scenarios. However, these models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Nikos Theodoridis , Reenu Mohandas , Ganesh Sistu , Anthony Scanlan , Ciarán Eising , Tim Brophy

Robots in shared workspaces must interpret human actions from partial, ambiguous observations, where overconfident early predictions can lead to unsafe or disruptive interaction. This challenge is amplified in egocentric views, where…

Robotics · Computer Science 2026-03-13 Zhaoda Du , Michael Bowman , Qiaojie Zheng , Xiaoli Zhang

Color-word associations play a fundamental role in human cognition and design applications. Large Language Models (LLMs) have become widely available and have demonstrated intelligent behaviors in various benchmarks with natural…

Computation and Language · Computer Science 2025-05-08 Makoto Fukushima , Shusuke Eshita , Hiroshige Fukuhara