English
Related papers

Related papers: SocialCounterfactuals: Probing and Mitigating Inte…

200 papers

While vision-language models (VLMs) have achieved remarkable performance improvements recently, there is growing evidence that these models also posses harmful biases with respect to social attributes such as gender and race. Prior studies…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Phillip Howard , Avinash Madasu , Tiep Le , Gustavo Lujan Moreno , Vasudev Lal

Vision-Language Models (VLMs) are increasingly deployed in socially consequential settings, raising concerns about social bias driven by demographic cues. A central challenge in measuring such social bias is attribution under visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Haodong Chen , Qiang Huang , Jiaqi Zhao , Qiuping Jiang , Xiaojun Chang , Jun Yu

Large Vision-Language Models (LVLMs) have grown increasingly powerful in recent years, but can also exhibit harmful biases. Prior studies investigating such biases have primarily focused on demographic traits related to the visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Phillip Howard , Xin Su , Kathleen C. Fraser

With the advent of Large Language Models (LLMs) possessing increasingly impressive capabilities, a number of Large Vision-Language Models (LVLMs) have been proposed to augment LLMs with visual inputs. Such models condition generated text on…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Phillip Howard , Anahita Bhiwandiwalla , Kathleen C. Fraser , Svetlana Kiritchenko

With the advent of Large Language Models (LLMs) possessing increasingly impressive capabilities, a number of Large Vision-Language Models (LVLMs) have been proposed to augment LLMs with visual inputs. Such models condition generated text on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Phillip Howard , Kathleen C. Fraser , Anahita Bhiwandiwalla , Svetlana Kiritchenko

Vision-Language Pre-training (VLP) models have achieved state-of-the-art performance in numerous cross-modal tasks. Since they are optimized to capture the statistical properties of intra- and inter-modality, there remains risk to learn…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Yi Zhang , Junyang Wang , Jitao Sang

Vision-Language Models (VLMs) excel at multimodal reasoning, yet it remains unclear whether their answers are grounded in visual evidence or driven by learned language and world priors. Counting provides a precise testbed: when visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Reem Alzahrani , Hassan Alshanqiti , Bushra Bin Hemid , Zaid Alyafeai , Abdelrahman Eldesokey , Bernard Ghanem

Text-to-image diffusion models have been adopted into key commercial workflows, such as art generation and image editing. Characterising the implicit social biases they exhibit, such as gender and racial stereotypes, is a necessary first…

Computers and Society · Computer Science 2023-12-19 Adhithya Prakash Saravanan , Rafal Kocielnik , Roy Jiang , Pengrui Han , Anima Anandkumar

Vision Language Models (VLMs) are increasingly deployed across downstream tasks, yet their training data often encode social biases that surface in outputs. Unlike humans, who interpret images through contextual and social cues, VLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Adit Desai , Sudipta Roy , Mohna Chakraborty

Diffusion-based text-to-image models have rapidly gained popularity for their ability to generate detailed and realistic images from textual descriptions. However, these models often reflect the biases present in their training data,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Hidir Yesiltepe , Kiymet Akdemir , Pinar Yanardag

Large Vision-Language Models (LVLMs) have been widely adopted in various applications; however, they exhibit significant gender biases. Existing benchmarks primarily evaluate gender bias at the demographic group level, neglecting individual…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Yisong Xiao , Aishan Liu , QianJia Cheng , Zhenfei Yin , Siyuan Liang , Jiapeng Li , Jing Shao , Xianglong Liu , Dacheng Tao

Vision-Language Models (VLMs) have shown strong multimodal reasoning capabilities on Visual-Question-Answering (VQA) benchmarks. However, their robustness against textual misinformation remains under-explored. While existing research has…

Computation and Language · Computer Science 2026-01-28 Chi Zhang , Wenxuan Ding , Jiale Liu , Mingrui Wu , Qingyun Wu , Ray Mooney

Recent advances in large vision-language models (LVLMs) have amplified concerns about fairness, yet existing evaluations remain confined to demographic attributes and often conflate fairness with refusal behavior. This paper broadens the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Zaiying Zhao , Toshihiko Yamasaki

Large vision-language models (VLMs) can jointly interpret images and text, but they are also prone to absorbing and reproducing harmful social stereotypes when visual cues such as age, gender, race, clothing, or occupation are present. To…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Aravind Narayanan , Vahid Reza Khazaie , Shaina Raza

The emergence of Large Vision-Language Models (LVLMs) marks significant strides towards achieving general artificial intelligence. However, these advancements are accompanied by concerns about biased outputs, a challenge that has yet to be…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Sibo Wang , Xiangkui Cao , Jie Zhang , Zheng Yuan , Shiguang Shan , Xilin Chen , Wen Gao

Counterfactual examples have proven to be valuable in the field of natural language processing (NLP) for both evaluating and improving the robustness of language models to spurious correlations in datasets. Despite their demonstrated…

Machine Learning · Computer Science 2023-11-01 Tiep Le , Vasudev Lal , Phillip Howard

Computer vision models have been known to encode harmful biases, leading to the potentially unfair treatment of historically marginalized groups, such as people of color. However, there remains a lack of datasets balanced along demographic…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Nicholas Lui , Bryan Chia , William Berrios , Candace Ross , Douwe Kiela

Visual counterfactual explanations are ideal hypothetical images that change the decision-making of the classifier with high confidence toward the desired class while remaining visually plausible and close to the initial image. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Tung Luu , Nam Le , Duc Le , Bac Le

Text-to-Image (T2I) models have transformed visual content creation, producing highly realistic images from natural language prompts. However, concerns persist around their potential to replicate and magnify existing societal biases. To…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Sedat Porikli , Vedat Porikli

As machine learning-enabled Text-to-Image (TTI) systems are becoming increasingly prevalent and seeing growing adoption as commercial services, characterizing the social biases they exhibit is a necessary first step to lowering their risk…

Computers and Society · Computer Science 2023-11-13 Alexandra Sasha Luccioni , Christopher Akiki , Margaret Mitchell , Yacine Jernite
‹ Prev 1 2 3 10 Next ›