中文
相关论文

相关论文: Seeing Symbols, Missing Cultures: Probing Vision-L…

200 篇论文

Modern vision-language models (VLMs) often fail at cultural competency evaluations and benchmarks. Given the diversity of applications built upon VLMs, there is renewed interest in understanding how they encode cultural nuances. While…

Large vision-language models (VLMs) can assist visually impaired people by describing images from their daily lives. Current evaluation datasets may not reflect diverse cultural user backgrounds or the situational context of this use case.…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Antonia Karamolegkou , Phillip Rust , Yong Cao , Ruixiang Cui , Anders Søgaard , Daniel Hershcovich

Vision-Language Models (VLMs) have demonstrated impressive capabilities across a range of tasks, yet concerns about their potential biases exist. This work investigates the extent to which prominent VLMs exhibit cultural biases by…

计算机视觉与模式识别 · 计算机科学 2025-08-01 Ram Mohan Rao Kadiyala , Siddhant Gupta , Jebish Purbey , Srishti Yadav , Suman Debnath , Alejandro Salamanca , Desmond Elliott

The rapid adoption of large vision-language models (LVLMs) in recent years has been accompanied by growing fairness concerns due to their propensity to reinforce harmful societal stereotypes. While significant attention has been paid to…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Phillip Howard , Xin Su , Kathleen C. Fraser

Investigating value alignment in Large Language Models (LLMs) based on cultural context has become a critical area of research. However, similar biases have not been extensively explored in large vision-language models (VLMs). As the scale…

计算与语言 · 计算机科学 2025-02-24 Srishti Yadav , Zhi Zhang , Daniel Hershcovich , Ekaterina Shutova

Cultural context profoundly shapes how people interpret online content, yet vision-language models (VLMs) remain predominantly trained through Western or English-centric lenses. This limits their fairness and cross-cultural robustness in…

计算与语言 · 计算机科学 2026-02-13 Mo Wang , Kaixuan Ren , Pratik Jalan , Ahmed Ashraf , Tuong Vy Vu , Rahul Seetharaman , Shah Nawaz , Usman Naseem

Visualizations help communicate data insights, but deceptive data representations can distort their interpretation and propagate misinformation. While recent Vision Language Models (VLMs) perform well on many chart understanding tasks,…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Harsh Nishant Lalai , Raj Sanjay Shah , Hanspeter Pfister , Sashank Varma , Grace Guo

Vision-language models (VLMs) have advanced human-AI interaction but struggle with cultural understanding, often misinterpreting symbols, gestures, and artifacts due to biases in predominantly Western-centric training data. In this paper,…

人工智能 · 计算机科学 2025-01-03 Shudong Liu , Yiqiao Jin , Cheng Li , Derek F. Wong , Qingsong Wen , Lichao Sun , Haipeng Chen , Xing Xie , Jindong Wang

Vision-language models (VLMs) can respond to queries about images in many languages. However, beyond language, culture affects how we see things. For example, individuals from Western cultures focus more on the central figure in an image…

计算与语言 · 计算机科学 2025-03-04 Amith Ananthram , Elias Stengel-Eskin , Mohit Bansal , Kathleen McKeown

Recent advances in vision-language models (VLMs) have improved image captioning for cultural heritage. However, inferring structured cultural metadata (e.g., creator, origin, period) from visual input remains underexplored. We introduce a…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Yuechen Jiang , Enze Zhang , Md Mohsinul Kabir , Qianqian Xie , Stavroula Golfomitsou , Konstantinos Arvanitis , Sophia Ananiadou

Vision-Language Models (VLMs) excel at visual description yet remain under-validated for cultural interpretation. Existing benchmarks assess perception without interpretation, and common evaluation proxies, such as automated metrics and…

计算与语言 · 计算机科学 2026-02-26 Haorui Yu , Xuehang Wen , Fengrui Zhang , Qiufeng Yi

Recent research on Vision Language Models (VLMs) suggests that they rely on inherent biases learned during training to respond to questions about visual properties of an image. These biases are exacerbated when VLMs are asked highly…

计算机视觉与模式识别 · 计算机科学 2025-09-11 Saurav Sengupta , Nazanin Moradinasab , Jiebei Liu , Donald E. Brown

Visual language is a system of communication that conveys information through symbols, shapes, and spatial arrangements. Diagrams are a typical example of a visual language depicting complex concepts and their relationships in the form of…

计算与语言 · 计算机科学 2025-05-27 Yifan Hou , Buse Giledereli , Yilei Tu , Mrinmaya Sachan

Foundation models and vision-language pre-training have notably advanced Vision Language Models (VLMs), enabling multimodal processing of visual and linguistic data. However, their performance has been typically assessed on general scene…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Shravan Nayak , Kanishk Jain , Rabiul Awal , Siva Reddy , Sjoerd van Steenkiste , Lisa Anne Hendricks , Karolina Stańczak , Aishwarya Agrawal

Vision-Language Models (VLMs) are increasingly deployed in diverse cultural contexts, yet their internal biases remain poorly understood. In this work, we propose a novel framework to systematically evaluate how VLMs encode cultural…

计算机与社会 · 计算机科学 2025-05-28 Avinash Madasu , Vasudev Lal , Phillip Howard

As Vision-Language Models (VLMs) achieve widespread deployment across diverse cultural contexts, ensuring their cultural competence becomes critical for responsible AI systems. While prior work has evaluated cultural awareness in text-only…

计算与语言 · 计算机科学 2025-08-26 Arka Mukherjee , Shreya Ghosh

We study cultural and socioeconomic diversity in contrastive vision-language models (VLMs). Using a broad range of benchmark datasets and evaluation metrics, we bring to attention several important findings. First, the common filtering of…

计算机视觉与模式识别 · 计算机科学 2024-10-25 Angéline Pouget , Lucas Beyer , Emanuele Bugliarello , Xiao Wang , Andreas Peter Steiner , Xiaohua Zhai , Ibrahim Alabdulmohsin

Vision language models (VLMs) are designed to extract relevant visuospatial information from images. Some research suggests that VLMs can exhibit humanlike scene understanding, while other investigations reveal difficulties in their ability…

Vision-language models (VLMs) have demonstrated impressive performance by effectively integrating visual and textual information to solve complex tasks. However, it is not clear how these models reason over the visual and textual data…

人工智能 · 计算机科学 2025-04-15 Pouya Pezeshkpour , Moin Aminnaseri , Estevam Hruschka

In a globalized world, cultural elements from diverse origins frequently appear together within a single visual scene. We refer to these as culture mixing scenarios, yet how Large Vision-Language Models (LVLMs) perceive them remains…

‹ 上一页 1 2 3 10 下一页 ›