English
Related papers

Related papers: Gender Bias in Transformer Models: A comprehensive…

200 papers

Successful deployment of artificial intelligence (AI) in various settings has led to numerous positive outcomes for individuals and society. However, AI systems have also been shown to harm parts of the population due to biased predictions.…

Computers and Society · Computer Science 2023-07-21 Ondrej Bohdal , Timothy Hospedales , Philip H. S. Torr , Fazl Barez

Researchers have devised numerous ways to quantify social biases vested in pretrained language models. As some language models are capable of generating coherent completions given a set of textual prompts, several prompting datasets have…

Computation and Language · Computer Science 2022-05-25 Afra Feyza Akyürek , Muhammed Yusuf Kocyigit , Sejin Paik , Derry Wijaya

Large Language Models (LLMs) are finding applications in all aspects of life, but their susceptibility to biases, particularly gender stereotyping, raises ethical concerns. This study introduces a novel methodology, a persona-based…

Computers and Society · Computer Science 2025-02-18 Rajesh Ranjan , Shailja Gupta , Surya Naranyan Singh

Machine learning models are trained to find patterns in data. NLP models can inadvertently learn socially undesirable patterns when training on gender biased text. In this work, we propose a general framework that decomposes gender bias in…

Computation and Language · Computer Science 2020-05-05 Emily Dinan , Angela Fan , Ledell Wu , Jason Weston , Douwe Kiela , Adina Williams

The measurement of bias in machine learning often focuses on model performance across identity subgroups (such as man and woman) with respect to groundtruth labels. However, these methods do not directly measure the associations that a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Osman Aka , Ken Burke , Alex Bäuerle , Christina Greer , Margaret Mitchell

Transformers have achieved superior performances in many tasks in natural language processing and computer vision, which also triggered great interest in the time series community. Among multiple advantages of Transformers, the ability to…

Machine Learning · Computer Science 2023-05-15 Qingsong Wen , Tian Zhou , Chaoli Zhang , Weiqi Chen , Ziqing Ma , Junchi Yan , Liang Sun

This paper examines how international AI governance frameworks address gender issues and gender-based harms. The analysis covers binding regulations, such as the EU AI Act; soft law instruments, like the UNESCO Recommendations on AI Ethics;…

Computers and Society · Computer Science 2025-12-11 Jelena Cupac

Artificial Intelligence (AI) has paved the way for revolutionary decision-making processes, which if harnessed appropriately, can contribute to advancements in various sectors, from healthcare to economics. However, its black box nature…

Neural machine translation (NMT) models often suffer from gender biases that harm users and society at large. In this work, we explore how bridging the gap between languages for which parallel data is not available affects gender bias in…

Computation and Language · Computer Science 2023-05-29 Lena Cabrera , Jan Niehues

While several previous studies have analyzed gender bias in research, we are still missing a comprehensive analysis of gender differences in the AI community, covering diverse topics and different development trends. Using the AI Scholar…

Computation and Language · Computer Science 2025-06-23 Yiwen Ding , Jiarui Liu , Zhiheng Lyu , Kun Zhang , Bernhard Schoelkopf , Zhijing Jin , Rada Mihalcea

Large Language Models (LLMs), such as GPT-4 and BERT, have rapidly gained traction in natural language processing (NLP) and are now integral to financial decision-making. However, their deployment introduces critical challenges,…

Computers and Society · Computer Science 2024-10-29 Hui Zhong , Songsheng Chen , Mian Liang

In this paper, we propose a novel gender bias detection method by utilizing attention map for transformer-based models. We 1) give an intuitive gender bias judgement method by comparing the different relation degree between the genders and…

Computation and Language · Computer Science 2021-11-01 Bingbing Li , Hongwu Peng , Rajat Sainju , Junhuan Yang , Lei Yang , Yueying Liang , Weiwen Jiang , Binghui Wang , Hang Liu , Caiwen Ding

Transformers have made significant strides across various artificial intelligence domains, including natural language processing, computer vision, and audio processing. This success has naturally garnered considerable interest from both…

Image and Video Processing · Electrical Eng. & Systems 2024-08-12 Elyas Rashno , Amir Eskandari , Aman Anand , Farhana Zulkernine

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the biases to downstream…

Computation and Language · Computer Science 2024-02-22 Yingji Li , Mengnan Du , Rui Song , Xin Wang , Ying Wang

AI-generated text detectors have recently gained adoption in educational and professional contexts. Prior research has uncovered isolated cases of bias, particularly against English Language Learners (ELLs) however, there is a lack of…

Artificial Intelligence · Computer Science 2025-12-15 Priyam Basu , Yunfeng Zhang , Vipul Raheja

Human-AI collaboration is increasingly relevant in consequential areas where AI recommendations support human discretion. However, human-AI teams' effectiveness, capability, and fairness highly depend on human perceptions of AI. Positive…

Human-Computer Interaction · Computer Science 2025-06-06 Domenique Zipperling , Luca Deck , Julia Lanzl , Niklas Kühl

The paradigm of pretrained deep learning models has recently emerged in artificial intelligence practice, allowing deployment in numerous societal settings with limited computational resources, but also embedding biases and enabling…

Computers and Society · Computer Science 2019-09-10 Lav R. Varshney , Nitish Shirish Keskar , Richard Socher

Bias is a disproportionate prejudice in favor of one side against another. Due to the success of transformer-based Masked Language Models (MLMs) and their impact on many NLP tasks, a systematic evaluation of bias in these models is needed…

Computation and Language · Computer Science 2024-04-11 Jeongrok Yu , Seong Ug Kim , Jacob Choi , Jinho D. Choi

The presence of social biases in large language models (LLMs) has become a significant concern in AI research. These biases, often embedded in training data, can perpetuate harmful stereotypes and distort decision-making processes. When…

Information Retrieval · Computer Science 2025-11-04 Amirabbas Afzali , Amirreza Velae , Iman Ahmadi , Mohammad Aliannejadi

Political biases in Large Language Model (LLM)-based artificial intelligence (AI) systems, such as OpenAI's ChatGPT or Google's Gemini, have been previously reported. While several prior studies have attempted to quantify these biases using…

Computers and Society · Computer Science 2025-03-17 David Rozado