English
Related papers

Related papers: Gender Bias in Transformer Models: A comprehensive…

200 papers

With language models being deployed increasingly in the real world, it is essential to address the issue of the fairness of their outputs. The word embedding representations of these language models often implicitly draw unwanted…

Computation and Language · Computer Science 2021-06-17 Gauri Gupta , Krithika Ramesh , Sanjay Singh

Ethics regarding social bias has recently thrown striking issues in natural language processing. Especially for gender-related topics, the need for a system that reduces the model bias has grown in areas such as image captioning, content…

Computation and Language · Computer Science 2019-05-29 Won Ik Cho , Ji Won Kim , Seok Min Kim , Nam Soo Kim

Neural Machine Translation systems built on top of Transformer-based architectures are routinely improving the state-of-the-art in translation quality according to word-overlap metrics. However, a growing number of studies also highlight…

Computation and Language · Computer Science 2022-10-18 Shanya Sharma , Manan Dey , Koustuv Sinha

Speech technologies are deployed in high-stakes settings, yet fairness concerns remain fragmented across tasks and disciplines. Existing surveys either adopt a general machine-learning perspective that overlooks speech-specific properties…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-05 Yi-Cheng Lin , Yun-Shao Tsai , Kuan-Yu Chen , Hsiao-Ying Huang , Huang-Cheng Chou , Hung-yi Lee

Machine Learning models have been deployed across many different aspects of society, often in situations that affect social welfare. Although these models offer streamlined solutions to large problems, they may contain biases and treat…

Machine Learning · Computer Science 2021-06-22 Tal Feldman , Ashley Peake

Gender bias in pretrained language models (PLMs) poses significant social and ethical challenges. Despite growing awareness, there is a lack of comprehensive investigation into how different models internally represent and propagate such…

Computation and Language · Computer Science 2025-03-11 Mahdi Zakizadeh , Mohammad Taher Pilehvar

Recent advancements in large language models have demonstrated that extended inference through techniques can markedly improve performance, yet these gains come with increased computational costs and the propagation of inherent biases found…

Computation and Language · Computer Science 2025-02-10 Edward Hong Wang , Cynthia Xin Wen

While existing studies have recognised explicit biases in generative models, including occupational gender biases, the nuances of gender stereotypes and expectations of relationships between users and AI companions remain underexplored. In…

Artificial Intelligence · Computer Science 2025-02-28 Clare Grogan , Jackie Kay , María Pérez-Ortiz

Transformers are crucial across many AI fields, such as large language models, computer vision, and reinforcement learning. This prominence stems from the architecture's perceived universality and scalability compared to alternatives. This…

Machine Learning · Computer Science 2025-12-23 Amirreza Abbasi , Mohsen Hooshmand

Gender bias in artificial intelligence has become an important issue, particularly in the context of language models used in communication-oriented applications. This study examines the extent to which Large Language Models (LLMs) exhibit…

Computation and Language · Computer Science 2024-11-18 Michael Döll , Markus Döhring , Andreas Müller

The benefits and capabilities of pre-trained language models (LLMs) in current and future innovations are vital to any society. However, introducing and using LLMs comes with biases and discrimination, resulting in concerns about equality,…

Computers and Society · Computer Science 2023-12-05 Vithya Yogarajan , Gillian Dobbie , Te Taka Keegan , Rostam J. Neuwirth

AI-based systems are widely employed nowadays to make decisions that have far-reaching impacts on individuals and society. Their decisions might affect everyone, everywhere and anytime, entailing concerns about potential human rights…

Recently there has been a growing concern about machine bias, where trained statistical models grow to reflect controversial societal asymmetries, such as gender or racial bias. A significant number of AI tools have recently been suggested…

Computers and Society · Computer Science 2019-03-12 Marcelo O. R. Prates , Pedro H. C. Avelar , Luis Lamb

Considerable efforts to measure and mitigate gender bias in recent years have led to the introduction of an abundance of tasks, datasets, and metrics used in this vein. In this position paper, we assess the current paradigm of gender bias…

Computation and Language · Computer Science 2022-10-21 Hadas Orgad , Yonatan Belinkov

Text embedding is becoming an increasingly popular AI methodology, especially among businesses, yet the potential of text embedding models to be biased is not well understood. This paper examines the degree to which a selection of popular…

Artificial Intelligence · Computer Science 2024-06-19 Vasyl Rakivnenko , Nestor Maslej , Jessica Cervi , Volodymyr Zhukov

Gender bias has been a focal point in the study of bias in machine translation and language models. Existing machine translation gender bias evaluations are primarily focused on male and female genders, limiting the scope of the evaluation.…

Computation and Language · Computer Science 2024-07-24 Yijie Chen , Yijin Liu , Fandong Meng , Jinan Xu , Yufeng Chen , Jie Zhou

Pretrained multilingual models exhibit the same social bias as models processing English texts. This systematic review analyzes emerging research that extends bias evaluation and mitigation approaches into multilingual and non-English…

Computation and Language · Computer Science 2025-09-08 Lance Calvin Lim Gamboa , Yue Feng , Mark Lee

In this paper, we elaborate on how AI can support diversity and inclusion and exemplify research projects conducted in that direction. We start by looking at the challenges and progress in making large language models (LLMs) more…

In this paper, as a case study, we present a systematic study of gender bias in machine translation with Google Translate. We translated sentences containing names of occupations from Hungarian, a language with gender-neutral pronouns, into…

Machine Learning · Statistics 2021-12-21 Anna Farkas , Renáta Németh

While Large Language Models achieve state-of-the-art results across a wide range of NLP tasks, they remain prone to systematic biases. Among these, gender bias is particularly salient in MT, due to systematic differences across languages in…

Computation and Language · Computer Science 2026-03-19 Chiara Manna , Hosein Mohebbi , Afra Alishahi , Frédéric Blain , Eva Vanmassenhove