English
Related papers

Related papers: BioPro: On Difference-Aware Gender Fairness for Vi…

200 papers

Recent breakthroughs in self supervised training have led to a new class of pretrained vision language models. While there have been investigations of bias in multimodal models, they have mostly focused on gender and racial bias, giving…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Sepehr Janghorbani , Gerard de Melo

Fairness is a fundamental principle in medical ethics. Vision Language Models (VLMs) have shown significant potential in the medical field due to their ability to leverage both visual and linguistic contexts, reducing the need for large…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Peiran Wang , Linjie Tong , Jiaxiang Liu , Zuozhu Liu

Large Vision Language Models (LVLMs) such as LLaVA have demonstrated impressive capabilities as general-purpose chatbots that can engage in conversations about a provided input image. However, their responses are influenced by societal…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Neale Ratzlaff , Matthew Lyle Olson , Musashi Hinck , Shao-Yen Tseng , Vasudev Lal , Phillip Howard

An emerging definition of fairness in machine learning requires that models are oblivious to demographic user information, e.g., a user's gender or age should not influence the model. Personalized recommender systems are particularly prone…

Information Retrieval · Computer Science 2023-08-30 Bjørnar Vassøy , Helge Langseth , Benjamin Kille

Machine Learning models have been deployed across many different aspects of society, often in situations that affect social welfare. Although these models offer streamlined solutions to large problems, they may contain biases and treat…

Machine Learning · Computer Science 2021-06-22 Tal Feldman , Ashley Peake

Ensuring fairness in machine learning is a critical and challenging task, as biased data representations often lead to unfair predictions. To address this, we propose Deep Fair Learning, a framework that integrates nonlinear sufficient…

Machine Learning · Statistics 2025-04-10 Enze Shi , Linglong Kong , Bei Jiang

Machine learning decision systems are getting omnipresent in our lives. From dating apps to rating loan seekers, algorithms affect both our well-being and future. Typically, however, these systems are not infallible. Moreover, complex…

Machine Learning · Statistics 2022-02-15 Jakub Wiśniewski , Przemysław Biecek

Confounding bias is a crucial problem when applying machine learning to practice, especially in clinical practice. We consider the problem of learning representations independent to multiple biases. In literature, this is mostly solved by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Xianjing Liu , Bo Li , Esther Bron , Wiro Niessen , Eppo Wolvius , Gennady Roshchupkin

Vision-Language Models (VLMs) have demonstrated impressive capabilities across a range of tasks, yet concerns about their potential biases exist. This work investigates the extent to which prominent VLMs exhibit cultural biases by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ram Mohan Rao Kadiyala , Siddhant Gupta , Jebish Purbey , Srishti Yadav , Suman Debnath , Alejandro Salamanca , Desmond Elliott

Algorithmic decision making based on computer vision and machine learning technologies continue to permeate our lives. But issues related to biases of these models and the extent to which they treat certain segments of the population…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Vishnu Suresh Lokhande , Aditya Kumar Akash , Sathya N. Ravi , Vikas Singh

Fairness is a critical concern in deep learning, especially in healthcare, where these models influence diagnoses and treatment decisions. Although fairness has been investigated in the vision-only domain, the fairness of medical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yan Luo , Min Shi , Muhammad Osama Khan , Muhammad Muneeb Afzal , Hao Huang , Shuaihang Yuan , Yu Tian , Luo Song , Ava Kouhana , Tobias Elze , Yi Fang , Mengyu Wang

Vision-Language Models (VLMs) are increasingly deployed in socially consequential settings, raising concerns about social bias driven by demographic cues. A central challenge in measuring such social bias is attribution under visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Haodong Chen , Qiang Huang , Jiaqi Zhao , Qiuping Jiang , Xiaojun Chang , Jun Yu

Vision-language models (VLMs) pre-trained on extensive datasets can inadvertently learn biases by correlating gender information with specific objects or scenarios. Current methods, which focus on modifying inputs and monitoring changes in…

Artificial Intelligence · Computer Science 2025-06-09 Zhaotian Weng , Zijun Gao , Jerone Andrews , Jieyu Zhao

Vision-Language (V-L) pre-trained models such as CLIP show prominent capabilities in various downstream tasks. Despite this promise, V-L models are notoriously limited by their inherent social biases. A typical demonstration is that V-L…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Haoyu Zhang , Yangyang Guo , Mohan Kankanhalli

Deep learning models often learn to make predictions that rely on sensitive social attributes like gender and race, which poses significant fairness risks, especially in societal applications, e.g., hiring, banking, and criminal justice.…

Machine Learning · Computer Science 2022-11-03 Yi Zhang , Jitao Sang , Junyang Wang

Internet search affects people's cognition of the world, so mitigating biases in search results and learning fair models is imperative for social good. We study a unique gender bias in image search in this work: the search images are often…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Jialu Wang , Yang Liu , Xin Eric Wang

Large Language Models (LLMs) can generate biased responses. Yet previous direct probing techniques contain either gender mentions or predefined gender stereotypes, which are challenging to comprehensively collect. Hence, we propose an…

Computation and Language · Computer Science 2024-02-20 Xiangjue Dong , Yibo Wang , Philip S. Yu , James Caverlee

Medical artificial intelligence systems have achieved remarkable diagnostic capabilities, yet they consistently exhibit performance disparities across demographic groups, causing real-world harm to underrepresented populations. While recent…

Machine Learning · Computer Science 2025-10-24 Shiqi Dai , Wei Dai , Jiaee Cheong , Paul Pu Liang

Mitigating the discrimination of machine learning models has gained increasing attention in medical image analysis. However, rare works focus on fair treatments for patients with multiple sensitive demographic ones, which is a crucial yet…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Wenlong Deng , Yuan Zhong , Qi Dou , Xiaoxiao Li

Vision-language models are growing in popularity and public visibility to generate, edit, and caption images at scale; but their outputs can perpetuate and amplify societal biases learned during pre-training on uncurated image-text pairs…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Brandon Smith , Miguel Farinha , Siobhan Mackenzie Hall , Hannah Rose Kirk , Aleksandar Shtedritski , Max Bain