English
Related papers

Related papers: Model-Agnostic Gender Debiased Image Captioning

200 papers

Exposure bias describes the phenomenon that a language model trained under the teacher forcing schema may perform poorly at the inference stage when its predictions are conditioned on its previous predictions unseen from the training…

Computation and Language · Computer Science 2020-04-02 Yifan Xu , Kening Zhang , Haoyu Dong , Yuezhou Sun , Wenlong Zhao , Zhuowen Tu

Gender bias in Language and Vision datasets and models has the potential to perpetuate harmful stereotypes and discrimination. We analyze gender bias in two Language and Vision datasets. Consistent with prior work, we find that both…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Sophia Harrison , Eleonora Gualdoni , Gemma Boleda

Machine learning model bias can arise from dataset composition: correlated sensitive features can distort the downstream classification model's decision boundary and lead to performance differences along these features. Existing de-biasing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Miao Zhang , Zee fryer , Ben Colman , Ali Shahriyari , Gaurav Bharaj

Text-to-Image (T2I) models have recently gained significant attention due to their ability to generate high-quality images and are consequently used in a wide range of applications. However, there are concerns about the gender bias of these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Yunbo Lyu , Zhou Yang , Yuqing Niu , Jing Jiang , David Lo

Image captioning, which generates natural language descriptions of the visual information in an image, is a crucial task in vision-language research. Previous models have typically addressed this task by aligning the generative capabilities…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Qian Cao , Xu Chen , Ruihua Song , Xiting Wang , Xinting Huang , Yuchen Ren

Speech models may be affected by performance imbalance in different population subgroups, raising concerns about fair treatment across these groups. Prior attempts to mitigate unfairness either focus on user-defined subgroups, potentially…

Computation and Language · Computer Science 2024-09-17 Alkis Koudounas , Flavio Giobergia , Eliana Pastor , Elena Baralis

Neural Machine Translation models tend to perpetuate gender bias present in their training data distribution. Context-aware models have been previously suggested as a means to mitigate this type of bias. In this work, we examine this claim…

Computation and Language · Computer Science 2024-06-19 Harritxu Gete , Thierry Etchegoyhen

Large Language Models (LLMs) have made substantial progress in the past several months, shattering state-of-the-art benchmarks in many domains. This paper investigates LLMs' behavior with respect to gender stereotypes, a known issue for…

Computation and Language · Computer Science 2023-08-30 Hadas Kotek , Rikker Dockum , David Q. Sun

As Large Language Models (LLMs) are increasingly used across different applications, concerns about their potential to amplify gender biases in various tasks are rising. Prior research has often probed gender bias using explicit gender cues…

Computation and Language · Computer Science 2025-08-06 Shahed Masoudian , Gustavo Escobedo , Hannah Strauss , Markus Schedl

The power of machine learning systems not only promises great technical progress, but risks societal harm. As a recent example, researchers have shown that popular word embedding algorithms exhibit stereotypical biases, such as gender bias.…

Machine Learning · Computer Science 2019-06-11 Marc-Etienne Brunet , Colleen Alkalay-Houlihan , Ashton Anderson , Richard Zemel

Generative AI, such as large language models, has undergone rapid development within recent years. As these models become increasingly available to the public, concerns arise about perpetuating and amplifying harmful biases in applications.…

Computation and Language · Computer Science 2024-09-04 Sara Sterlie , Nina Weng , Aasa Feragen

The embedding spaces of image models have been shown to encode a range of social biases such as racism and sexism. Here, we investigate specific factors that contribute to the emergence of these biases in Vision Transformers (ViT).…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Jannik Brinkmann , Paul Swoboda , Christian Bartelt

Neural language models often fail to generate diverse and informative texts, limiting their applicability in real-world problems. While previous approaches have proposed to address these issues by identifying and penalizing undesirable…

Computation and Language · Computer Science 2023-09-25 Jimin Hong , ChaeHun Park , Jaegul Choo

Deep learning based visual-linguistic multimodal models such as Contrastive Language Image Pre-training (CLIP) have become increasingly popular recently and are used within text-to-image generative models such as DALL-E and Stable…

Computers and Society · Computer Science 2023-09-12 Abhishek Mandal , Suzanne Little , Susan Leavy

Dataset bias is a significant problem in training fair classifiers. When attributes unrelated to classification exhibit strong biases towards certain classes, classifiers trained on such dataset may overfit to these bias attributes,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Zaiying Zhao , Soichiro Kumano , Toshihiko Yamasaki

Media platforms, technological systems, and search engines act as conduits and gatekeepers for all kinds of information. They often influence, reflect, and reinforce gender stereotypes, including those that represent occupations. This study…

Computers and Society · Computer Science 2019-12-12 Vivek Singh , Mary Chayko , Raj Inamdar , Diana Floegel

Recent advances in machine learning leverage massive datasets of unlabeled images from the web to learn general-purpose image representations for tasks from image classification to face recognition. But do unsupervised computer vision…

Computers and Society · Computer Science 2021-01-28 Ryan Steed , Aylin Caliskan

As the use of natural language processing increases in our day-to-day life, the need to address gender bias inherent in these systems also amplifies. This is because the inherent bias interferes with the semantic structure of the output of…

Computation and Language · Computer Science 2022-05-13 Neeraja Kirtane , Tanvi Anand

Language models (LMs) have become pivotal in the realm of technological advancements. While their capabilities are vast and transformative, they often include societal biases encoded in the human-produced datasets used for their training.…

Computation and Language · Computer Science 2024-01-30 Iñigo Parra

Diffusion-based text-to-image models have rapidly gained popularity for their ability to generate detailed and realistic images from textual descriptions. However, these models often reflect the biases present in their training data,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Hidir Yesiltepe , Kiymet Akdemir , Pinar Yanardag