English
Related papers

Related papers: Seeing Culture: A Benchmark for Visual Reasoning a…

200 papers

The ability to process information from multiple modalities and to reason through it step-by-step remains a critical challenge in advancing artificial intelligence. However, existing reasoning benchmarks focus on text-only reasoning, or…

Artificial Intelligence · Computer Science 2025-07-01 Yulun Jiang , Yekun Chai , Maria Brbić , Michael Moor

Daily scenarios are characterized by visual richness, requiring Multimodal Large Language Models (MLLMs) to filter noise and identify decisive visual clues for accurate reasoning. Yet, current benchmarks predominantly aim at evaluating…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Xiaomin Li , Tala Wang , Zichen Zhong , Ying Zhang , Zirui Zheng , Takashi Isobe , Dezhuang Li , Huchuan Lu , You He , Xu Jia

Background: The rapid integration of foundation models into clinical practice and public health necessitates a rigorous evaluation of their true clinical reasoning capabilities beyond narrow examination success. Current benchmarks,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Dingyu Wang , Zimu Yuan , Jiajun Liu , Shanggui Liu , Nan Zhou , Tianxing Xu , Di Huang , Dong Jiang

Museums serve as repositories of cultural heritage and historical artifacts from diverse epochs, civilizations, and regions, preserving well-documented collections that encapsulate vast knowledge, which, when systematically structured into…

Multimodal Large Language Models (MLLMs) show reasoning promise, yet their visual perception is a critical bottleneck. Strikingly, MLLMs can produce correct answers even while misinterpreting crucial visual elements, masking these…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Aditya Kanade , Tanuja Ganu

Recent advancements in Vision Language Models (VLMs) have expanded their capabilities to interactive agent tasks, yet existing benchmarks remain limited to single-agent or text-only environments. In contrast, real-world scenarios often…

Artificial Intelligence · Computer Science 2026-04-14 Zelai Xu , Zhexuan Xu , Xiangmin Yi , Huining Yuan , Mo Guang , Kaiwen Long , Xinlei Chen , Yi Wu , Chao Yu , Yu Wang

While Multimodal Large Language Models (MLLMs) excel on benchmarks, their processing paradigm differs from the human ability to integrate visual information. Unlike humans who naturally bridge details and high-level concepts, models tend to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Ming Zhong , Yuanlei Wang , Liuzhou Zhang , Arctanx An , Renrui Zhang , Hao Liang , Ming Lu , Ying Shen , Wentao Zhang

Large Language Models (LLMs) have achieved remarkable success in general benchmarks, yet their competence in commodity supply chains (CSCs) -- a domain governed by institutional rule systems and feasibility constraints -- remains…

Computation and Language · Computer Science 2026-01-06 Yaxin Cui , Yuanqiang Zeng , Jiapeng Yan , Keling Lin , Kai Ji , Jianhui Zeng , Sheng Zhang , Xin Luo , Binzhu Su , Chaolai Shen , Jiahao Yu

Scientific research demands sophisticated reasoning over multimodal data, a challenge especially prevalent in biology. Despite recent advances in multimodal large language models (MLLMs) for AI-assisted research, existing multimodal…

Humans can imagine and manipulate visual images mentally, a capability known as spatial visualization. While many multi-modal benchmarks assess reasoning on visible visual information, the ability to infer unseen relationships through…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Siting Wang , Minnan Pei , Luoyang Sun , Cheng Deng , Yuchen Li , Kun Shao , Zheng Tian , Haifeng Zhang , Jun Wang

Chinese ancient documents, invaluable carriers of millennia of Chinese history and culture, hold rich knowledge across diverse fields but face challenges in digitization and understanding, i.e., traditional methods only scan images, while…

Existing multilingual vision-language (VL) benchmarks often only cover a handful of languages. Consequently, evaluations of large vision-language models (LVLMs) predominantly target high-resource languages, underscoring the need for…

Computation and Language · Computer Science 2025-02-19 Fabian David Schmidt , Florian Schneider , Chris Biemann , Goran Glavaš

A challenge in advancing Visual-Language Models (VLMs) is determining whether their failures on abstract reasoning tasks, such as Bongard problems, stem from flawed perception or faulty top-down reasoning. To disentangle these factors, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Enrico Vompa , Tanel Tammet , Mohit Vaishnav

As large vision language models(LVLMs) rapidly advance, concerns about their potential to learn and generate social biases and stereotypes are increasing. Previous studies on LVLM's stereotypes face two primary limitations: metrics that…

Computation and Language · Computer Science 2025-05-28 Junhyuk Choi , Minju Kim , Yeseon Hong , Bugeun Kim

Learning commonsense reasoning from visual contexts and scenes in real-world is a crucial step toward advanced artificial intelligence. However, existing video reasoning benchmarks are still inadequate since they were mainly designed for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Andong Wang , Bo Wu , Sunli Chen , Zhenfang Chen , Haotian Guan , Wei-Ning Lee , Li Erran Li , Chuang Gan

Recent advancements in Vision-Language Models (VLMs) have revolutionized general visual understanding. However, their application in the food domain remains constrained by benchmarks that rely on coarse-grained categories, single-view…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Song Jin , Juntian Zhang , Xun Zhang , Zeying Tian , Fei Jiang , Guojun Yin , Wei Lin , Yong Liu , Rui Yan

We propose Perceptual Taxonomy, a structured process of scene understanding that first recognizes objects and their spatial configurations, then infers task-relevant properties such as material, affordance, function, and physical attributes…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Jonathan Lee , Xingrui Wang , Jiawei Peng , Luoxin Ye , Zehan Zheng , Tiezheng Zhang , Tao Wang , Wufei Ma , Siyi Chen , Yu-Cheng Chou , Prakhar Kaushik , Alan Yuille

Visual understanding goes well beyond object recognition. With one glance at an image, we can effortlessly imagine the world beyond the pixels: for instance, we can infer people's actions, goals, and mental states. While this task is easy…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Rowan Zellers , Yonatan Bisk , Ali Farhadi , Yejin Choi

Vision-Language Models (VLMs) have achieved remarkable progress in complex visual understanding across scientific and reasoning tasks. While performance benchmarking has advanced our understanding of these capabilities, the critical…

Artificial Intelligence · Computer Science 2026-01-27 Asif Azad , Mohammad Sadat Hossain , MD Sadik Hossain Shanto , M Saifur Rahman , Md Rizwan Parvez

Recent advances in vision-language models (VLMs) emphasize long chain-of-thought reasoning; yet, we find that their performance on visual tasks is primarily limited by a lack of visual perception as opposed to reasoning itself. In this…

Computation and Language · Computer Science 2026-05-20 Juncheng Wu , Hardy Chen , Haoqin Tu , Xianfeng Tang , Freda Shi , Hui Liu , Hanqing Lu , Cihang Xie , Yuyin Zhou