中文
相关论文

相关论文: Gender Bias in Transformer Models: A comprehensive…

200 篇论文

Transformer-based pretrained large language models (PLM) such as BERT and GPT have achieved remarkable success in NLP tasks. However, PLMs are prone to encoding stereotypical biases. Although a burgeoning literature has emerged on…

计算与语言 · 计算机科学 2024-06-18 Yi Yang , Hanyu Duan , Ahmed Abbasi , John P. Lalor , Kar Yan Tam

Machine learning models are central to people's lives and impact society in ways as fundamental as determining how people access information. The gravity of these models imparts a responsibility to model developers to ensure that they are…

应用统计 · 统计学 2020-07-13 Cyrus DiCiccio , Sriram Vasudevan , Kinjal Basu , Krishnaram Kenthapadi , Deepak Agarwal

Gender bias is rampant in AI systems, causing bad user experience, injustices, and mental harm to women. School curricula fail to educate AI creators on this topic, leaving them unprepared to mitigate gender bias in AI. In this paper, we…

Numerous debiasing techniques have been proposed to mitigate the gender bias that is prevalent in pretrained language models. These are often evaluated on datasets that check the extent to which the model is gender-neutral in its…

计算与语言 · 计算机科学 2023-10-24 Mahdi Zakizadeh , Kaveh Eskandari Miandoab , Mohammad Taher Pilehvar

The rapid advancement of large language models (LLMs) and their growing integration into daily life underscore the importance of evaluating and ensuring their fairness. In this work, we examine fairness within the domain of emotional theory…

计算与语言 · 计算机科学 2026-03-03 Maureen Herbert , Katie Sun , Angelica Lim , Yasaman Etesam

Societal biases present in pre-trained large language models are a critical issue as these models have been shown to propagate biases in countless downstream applications, rendering them unfair towards specific groups of people. Since…

计算与语言 · 计算机科学 2023-06-08 Himanshu Thakur , Atishay Jain , Praneetha Vaddamanu , Paul Pu Liang , Louis-Philippe Morency

The gender bias present in the data on which language models are pre-trained gets reflected in the systems that use these models. The model's intrinsic gender bias shows an outdated and unequal view of women in our culture and encourages…

计算与语言 · 计算机科学 2022-09-09 Neeraja Kirtane , V Manushree , Aditya Kane

This paper studies interpretable and fair artificial intelligence architectures for understanding English reading. Introduced transformer-based models, integrating advanced attention mechanisms and gradient-based feature attribution. The…

计算与语言 · 计算机科学 2026-04-28 Ping Li

Large Language Models(LLMs) have revolutionized various applications in natural language processing (NLP) by providing unprecedented text generation, translation, and comprehension capabilities. However, their widespread deployment has…

计算与语言 · 计算机科学 2024-09-26 Rajesh Ranjan , Shailja Gupta , Surya Narayan Singh

Transformer based models are the modern work horses for neural machine translation (NMT), reaching state of the art across several benchmarks. Despite their impressive accuracy, we observe a systemic and rudimentary class of errors made by…

计算与语言 · 计算机科学 2021-04-19 Adithya Renduchintala , Adina Williams

Large Language Models (LLMs) are being adopted across a wide range of tasks, including decision-making processes in industries where bias in AI systems is a significant concern. Recent research indicates that LLMs can harbor implicit biases…

计算与语言 · 计算机科学 2024-10-18 Divyanshu Kumar , Umang Jain , Sahil Agarwal , Prashanth Harshangi

It is a well-known fact that current AI-based language technology -- language models, machine translation systems, multilingual dictionaries and corpora -- focuses on the world's 2-3% most widely spoken languages. Recent research efforts…

计算与语言 · 计算机科学 2023-07-26 Gábor Bella , Paula Helm , Gertraud Koch , Fausto Giunchiglia

Pretrained language models are publicly available and constantly finetuned for various real-life applications. As they become capable of grasping complex contextual information, harmful biases are likely increasingly intertwined with those…

计算与语言 · 计算机科学 2023-06-28 Sophie Jentzsch , Cigdem Turan

As Machine Translation (MT) has become increasingly more powerful, accessible, and widespread, the potential for the perpetuation of bias has grown alongside its advances. While overt indicators of bias have been studied in machine…

计算与语言 · 计算机科学 2021-08-25 Chloe Ciora , Nur Iren , Malihe Alikhani

Language Models have ushered a new age of AI gaining traction within the NLP community as well as amongst the general population. AI's ability to make predictions, generations and its applications in sensitive decision-making scenarios,…

计算与语言 · 计算机科学 2023-11-28 Ananya Malik

The significant advancements in applying Artificial Intelligence (AI) to healthcare decision-making, medical diagnosis, and other domains have simultaneously raised concerns about the fairness and bias of AI systems. This is particularly…

计算机与社会 · 计算机科学 2024-01-30 Emilio Ferrara

Fairness in artificial intelligence (AI) has become a growing concern due to discriminatory outcomes in AI-based decision-making systems. While various methods have been proposed to mitigate bias, most rely on complete demographic…

计算机与社会 · 计算机科学 2025-11-18 Zichong Wang , Zhipeng Yin , Roland H. C. Yap , Wenbin Zhang

As the capabilities of generative language models continue to advance, the implications of biases ingrained within these models have garnered increasing attention from researchers, practitioners, and the broader public. This article…

计算机与社会 · 计算机科学 2023-11-14 Emilio Ferrara

Bias issues of neural networks garner significant attention along with its promising advancement. Among various bias issues, mitigating two predominant biases is crucial in advancing fair and trustworthy AI: (1) ensuring neural networks…

机器学习 · 计算机科学 2025-02-18 Jiazhi Li , Mahyar Khayatkhoei , Jiageng Zhu , Hanchen Xie , Mohamed E. Hussein , Wael AbdAlmageed

Gender, race and social biases have recently been detected as evident examples of unfairness in applications of Natural Language Processing. A key path towards fairness is to understand, analyse and interpret our data and algorithms. Recent…

计算与语言 · 计算机科学 2021-05-06 Christine Basta , Marta R. Costa-jussà