English
Related papers

Related papers: GECOBench: A Gender-Controlled Text Dataset and Be…

200 papers

Pretrained machine learning models are known to perpetuate and even amplify existing biases in data, which can result in unfair outcomes that ultimately impact user experience. Therefore, it is crucial to understand the mechanisms behind…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Laura Cabello , Emanuele Bugliarello , Stephanie Brandl , Desmond Elliott

Automatic machine learning systems can inadvertently accentuate and perpetuate inappropriate human biases. Past work on examining inappropriate biases has largely focused on just individual systems. Further, there is no benchmark dataset…

Computation and Language · Computer Science 2018-05-14 Svetlana Kiritchenko , Saif M. Mohammad

Recent research demonstrates that word embeddings, trained on the human-generated corpus, have strong gender biases in embedding spaces, and these biases can result in the discriminative results from the various downstream tasks. Whereas…

Computation and Language · Computer Science 2020-11-04 Seungjae Shin , Kyungwoo Song , JoonHo Jang , Hyemi Kim , Weonyoung Joo , Il-Chul Moon

Recent studies have revealed that the widely-used Pre-trained Language Models (PLMs) propagate societal biases from the large unmoderated pre-training corpora. Existing solutions require debiasing training processes and datasets for…

Computation and Language · Computer Science 2023-07-25 Somayeh Ghanbarzadeh , Yan Huang , Hamid Palangi , Radames Cruz Moreno , Hamed Khanpour

In this paper, we quantify, analyze and mitigate gender bias exhibited in ELMo's contextualized word vectors. First, we conduct several intrinsic analyses and find that (1) training data for ELMo contains significantly more male than female…

Computation and Language · Computer Science 2019-04-09 Jieyu Zhao , Tianlu Wang , Mark Yatskar , Ryan Cotterell , Vicente Ordonez , Kai-Wei Chang

Artificial Intelligence has the capacity to amplify and perpetuate societal biases and presents profound ethical implications for society. Gender bias has been identified in the context of employment advertising and recruitment tools, due…

Computation and Language · Computer Science 2020-05-19 Susan Leavy , Gerardine Meaney , Karen Wade , Derek Greene

To tackle the rising phenomenon of hate speech, efforts have been made towards data curation and analysis. When it comes to analysis of bias, previous work has focused predominantly on race. In our work, we further investigate bias in hate…

Computation and Language · Computer Science 2022-05-19 Antonis Maronikolakis , Philip Baader , Hinrich Schütze

Pre-trained language models trained on large-scale data have learned serious levels of social biases. Consequently, various methods have been proposed to debias pre-trained models. Debiasing methods need to mitigate only discriminatory bias…

Computation and Language · Computer Science 2023-09-19 Masahiro Kaneko , Danushka Bollegala , Naoaki Okazaki

Gender prediction has typically focused on lexical and social network features, yielding good performance, but making systems highly language-, topic-, and platform-dependent. Cross-lingual embeddings circumvent some of these limitations,…

Computation and Language · Computer Science 2018-05-09 Rob van der Goot , Nikola Ljubešić , Ian Matroos , Malvina Nissim , Barbara Plank

Word embeddings learnt from massive text collections have demonstrated significant levels of discriminative biases such as gender, racial or ethnic biases, which in turn bias the down-stream NLP applications that use those word embeddings.…

Computation and Language · Computer Science 2019-06-04 Masahiro Kaneko , Danushka Bollegala

We examine whether neural natural language processing (NLP) systems reflect historical biases in training data. We define a general benchmark to quantify gender bias in a variety of neural NLP tasks. Our empirical evaluation with…

Computation and Language · Computer Science 2019-06-03 Kaiji Lu , Piotr Mardziel , Fangjing Wu , Preetam Amancharla , Anupam Datta

The field of 'explainable' artificial intelligence (XAI) has produced highly cited methods that seek to make the decisions of complex machine learning (ML) methods 'understandable' to humans, for example by attributing 'importance' scores…

Machine Learning · Computer Science 2023-12-08 Benedict Clark , Rick Wilming , Stefan Haufe

With the rise of human-machine communication, machines are increasingly designed with humanlike characteristics, such as gender, which can inadvertently trigger cognitive biases. Many conversational agents (CAs), such as voice assistants…

Human-Computer Interaction · Computer Science 2024-01-09 Weizi Liu

Human gender bias is reflected in language and text production. Because state-of-the-art machine translation (MT) systems are trained on large corpora of text, mostly generated by humans, gender bias can also be found in MT. For instance…

Computation and Language · Computer Science 2021-07-27 Jonas-Dario Troles , Ute Schmid

Most machine learning methods are known to capture and exploit biases of the training data. While some biases are beneficial for learning, others are harmful. Specifically, image captioning models tend to exaggerate biases present in…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Lisa Anne Hendricks , Kaylee Burns , Kate Saenko , Trevor Darrell , Anna Rohrbach

Understanding the sources of variability in annotations is crucial for developing fair NLP systems, especially for tasks like sexism detection where demographic bias is a concern. This study investigates the extent to which annotator…

Computation and Language · Computer Science 2025-07-29 Hadi Mohammadi , Tina Shahedi , Pablo Mosteiro , Massimo Poesio , Ayoub Bagheri , Anastasia Giachanou

Strategies based on Explainable Artificial Intelligence - XAI have emerged in computing to promote a better understanding of predictions made by black box models. Most XAI measures used today explain these types of models, generating…

Machine Learning · Computer Science 2021-11-18 José Ribeiro , Raíssa Silva , Lucas Cardoso , Ronnie Alves

The rapid growth of Speech Emotion Recognition (SER) has diverse global applications, from improving human-computer interactions to aiding mental health diagnostics. However, SER models might contain social bias toward gender, leading to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-06 Yi-Cheng Lin , Haibin Wu , Huang-Cheng Chou , Chi-Chun Lee , Hung-yi Lee

Gender bias is not only prevalent in Large Language Models (LLMs) and their training data, but also firmly ingrained into the structural aspects of language itself. Therefore, adapting linguistic structures within LLM training data to…

Computation and Language · Computer Science 2024-07-08 Marion Bartl , Susan Leavy

Technology for open-ended language generation, a key application of artificial intelligence, has advanced to a great extent in recent years. Large-scale language models, which are trained on large corpora of text, are being used in a wide…

Computation and Language · Computer Science 2023-05-12 Saketh Reddy Karra , Son The Nguyen , Theja Tulabandhula