English
Related papers

Related papers: Generating Clues for Gender based Occupation De-bi…

200 papers

Technology for language generation has advanced rapidly, spurred by advancements in pre-training large models on massive amounts of data and the need for intelligent agents to communicate in a natural manner. While techniques can…

Computation and Language · Computer Science 2021-06-24 Emily Sheng , Kai-Wei Chang , Premkumar Natarajan , Nanyun Peng

Masked language models pick up gender biases during pre-training. Such biases are usually attributed to a certain model architecture and its pre-training corpora, with the implicit assumption that other variations in the pre-training…

Computation and Language · Computer Science 2022-11-29 Kenan Tang , Hanchun Jiang

Different methods have been proposed to develop meta-embeddings from a given set of source embeddings. However, the source embeddings can contain unfair gender-related biases, and how these influence the meta-embeddings has not been studied…

Computation and Language · Computer Science 2022-10-07 Masahiro Kaneko , Danushka Bollegala , Naoaki Okazaki

Text style can reveal sensitive attributes of the author (e.g. race or age) to the reader, which can, in turn, lead to privacy violations and bias in both human and algorithmic decisions based on text. For example, the style of writing in…

Machine Learning · Computer Science 2021-09-13 Fatemehsadat Mireshghallah , Taylor Berg-Kirkpatrick

In recent times, voice assistants have become a part of our day-to-day lives, allowing information retrieval by voice synthesis, voice recognition, and natural language processing. These voice assistants can be found in many modern-day…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-03 Kashav Piya , Srijal Shrestha , Cameran Frank , Estephanos Jebessa , Tauheed Khan Mohd

Introduction: Healthcare AI models often inherit biases from their training data. While efforts have primarily targeted bias in structured data, mental health heavily depends on unstructured data. This study aims to detect and mitigate…

In this paper, we address the limitations of existing text-to-image diffusion models in generating demographically fair results when given human-related descriptions. These models often struggle to disentangle the target language context…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Jia Li , Lijie Hu , Jingfeng Zhang , Tianhang Zheng , Hua Zhang , Di Wang

Vision-language models can encode societal biases and stereotypes, but there are challenges to measuring and mitigating these multimodal harms due to lacking measurement robustness and feature degradation. To address these challenges, we…

Machine Learning · Computer Science 2022-10-27 Hugo Berg , Siobhan Mackenzie Hall , Yash Bhalgat , Wonsuk Yang , Hannah Rose Kirk , Aleksandar Shtedritski , Max Bain

Despite their impressive performance in a wide range of NLP tasks, Large Language Models (LLMs) have been reported to encode worrying-levels of gender biases. Prior work has proposed debiasing methods that require human labelled examples,…

Computation and Language · Computer Science 2024-02-21 Daisuke Oba , Masahiro Kaneko , Danushka Bollegala

Recent studies have revealed that the widely-used Pre-trained Language Models (PLMs) propagate societal biases from the large unmoderated pre-training corpora. Existing solutions require debiasing training processes and datasets for…

Computation and Language · Computer Science 2023-07-25 Somayeh Ghanbarzadeh , Yan Huang , Hamid Palangi , Radames Cruz Moreno , Hamed Khanpour

Automated computer vision systems have been applied in many domains including security, law enforcement, and personal devices, but recent reports suggest that these systems may produce biased results, discriminating against people in…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Jungseock Joo , Kimmo Kärkkäinen

Text-to-image diffusion models, which are theoretically equivalent to score-based generative models, generate images through a multi-step denoising process guided by text embeddings extracted from pretrained vision-language models such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Seung Hyuk Lee , Songkuk Kim

AI agents are increasingly deployed and used to make automated decisions that affect our lives on a daily basis. It is imperative to ensure that these systems embed ethical principles and respect human values. We focus on how we can attest…

Artificial Intelligence · Computer Science 2019-09-11 Xavier Ferrer Aran , Jose M. Such , Natalia Criado

The rise of concern around Natural Language Processing (NLP) technologies containing and perpetuating social biases has led to a rich and rapidly growing area of research. Gender bias is one of the central biases being analyzed, but to date…

Computation and Language · Computer Science 2022-05-06 Hannah Devinney , Jenny Björklund , Henrik Björklund

We analyze 6.7 million case law documents to determine the presence of gender bias within our judicial system. We find that current bias detectino methods in NLP are insufficient to determine gender bias in our case law database and propose…

Computation and Language · Computer Science 2021-06-30 Noa Baker Gillis

Human biases have been shown to influence the performance of models and algorithms in various fields, including Natural Language Processing. While the study of this phenomenon is garnering focus in recent years, the available resources are…

Computation and Language · Computer Science 2024-08-15 Ana Sofia Evans , Helena Moniz , Luísa Coheur

We propose DeCoDi, a debiasing procedure for text-to-image diffusion-based models that changes the inference procedure, does not significantly change image quality, has negligible compute overhead, and can be applied in any diffusion-based…

Over the last few years, Contextualized Pre-trained Neural Language Models, such as BERT, GPT, have shown significant gains in various NLP tasks. To enhance the robustness of existing pre-trained models, one way is adversarial examples…

Computation and Language · Computer Science 2021-10-05 Wenqian Ye , Fei Xu , Yaojia Huang , Cassie Huang , Ji A

Group bias in natural language processing tasks manifests as disparities in system error rates across texts authorized by different demographic groups, typically disadvantaging minority groups. Dataset balancing has been shown to be…

Computation and Language · Computer Science 2022-05-17 Xudong Han , Timothy Baldwin , Trevor Cohn

Models trained on datasets with texture bias usually perform poorly on out-of-distribution samples since biased representations are embedded into the model. Recently, various image translation and debiasing methods have attempted to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Myeongkyun Kang , Dongkyu Won , Miguel Luna , Philip Chikontwe , Kyung Soo Hong , June Hong Ahn , Sang Hyun Park