English
Related papers

Related papers: AI Gender Bias, Disparities, and Fairness: Does Tr…

200 papers

With the widespread and pervasive use of Artificial Intelligence (AI) for automated decision-making systems, AI bias is becoming more apparent and problematic. One of its negative consequences is discrimination: the unfair, or unequal…

Computers and Society · Computer Science 2021-06-07 Xavier Ferrer , Tom van Nuenen , Jose M. Such , Mark Coté , Natalia Criado

The rapid development of AI tools and implementation of LLMs within downstream tasks has been paralleled by a surge in research exploring how the outputs of such AI/LLM systems embed biases, a research topic which was already being…

Computers and Society · Computer Science 2025-08-18 Sourojit Ghosh , Kyra Wilson

Fairness in artificial intelligence (AI) has become a growing concern due to discriminatory outcomes in AI-based decision-making systems. While various methods have been proposed to mitigate bias, most rely on complete demographic…

Computers and Society · Computer Science 2025-11-18 Zichong Wang , Zhipeng Yin , Roland H. C. Yap , Wenbin Zhang

The applications of Artificial Intelligence (AI) surround decisions on increasingly many aspects of human lives. Society responds by imposing legal and social expectations for the accountability of such automated decision systems (ADSs).…

Machine Learning · Computer Science 2022-08-18 Furkan Gursoy , Ioannis A. Kakadiaris

Bias detection and mitigation is an active area of research in machine learning. This work extends previous research done by the authors to provide a rigorous and more complete analysis of the bias found in AI predictive models. Admissions…

Artificial Intelligence · Computer Science 2024-12-04 Kelly Van Busum , Shiaofen Fang

The integration of AI in education holds immense potential for personalizing learning experiences and transforming instructional practices. However, AI systems can inadvertently encode and amplify biases present in educational data, leading…

Machine Learning · Computer Science 2025-11-04 Zhipeng Yin , Sribala Vidyadhari Chinta , Zichong Wang , Matthew Gonzalez , Wenbin Zhang

Generative AI (GenAI) models present new challenges in regulating against discriminatory behavior. In this paper, we argue that GenAI fairness research still has not met these challenges; instead, a significant gap remains between existing…

Machine Learning · Computer Science 2024-12-31 Thomas P. Zollo , Nikita Rajaneesh , Richard Zemel , Talia B. Gillis , Emily Black

With the widespread use of AI systems and applications in our everyday lives, it is important to take fairness issues into consideration while designing and engineering these types of systems. Such systems can be used in many sensitive…

Machine Learning · Computer Science 2022-01-26 Ninareh Mehrabi , Fred Morstatter , Nripsuta Saxena , Kristina Lerman , Aram Galstyan

Massive efforts are made to reduce biases in both data and algorithms in order to render AI applications fair. These efforts are propelled by various high-profile cases where biased algorithmic decision-making caused harm to women, people…

Machine Learning · Computer Science 2022-09-01 Thilo Hagendorff , Leonie Bossert , Tse Yip Fai , Peter Singer

Gender, race and social biases have recently been detected as evident examples of unfairness in applications of Natural Language Processing. A key path towards fairness is to understand, analyse and interpret our data and algorithms. Recent…

Computation and Language · Computer Science 2021-05-06 Christine Basta , Marta R. Costa-jussà

Web search engines influence perception of social reality by filtering and ranking information. However, their outputs are often subjected to bias that can lead to skewed representation of subjects such as professional occupations or…

Information Retrieval · Computer Science 2021-06-29 Mykola Makhortykh , Aleksandra Urman , Roberto Ulloa

As Machine Learning technologies become increasingly used in contexts that affect citizens, companies as well as researchers need to be confident that their application of these methods will not have unexpected social implications, such as…

Machine Learning · Computer Science 2025-03-06 Simon Caton , Christian Haas

Objectives: Leveraging artificial intelligence (AI) in conjunction with electronic health records (EHRs) holds transformative potential to improve healthcare. Yet, addressing bias in AI, which risks worsening healthcare disparities, cannot…

Artificial Intelligence · Computer Science 2026-01-08 Feng Chen , Liqin Wang , Julie Hong , Jiaqi Jiang , Li Zhou

Ensuring fairness in AI systems is critical, especially in high-stakes domains such as lending, hiring, and healthcare. This urgency is reflected in emerging global regulations that mandate fairness assessments and independent bias audits.…

Machine Learning · Computer Science 2025-08-19 Varsha Ramineni , Hossein A. Rahmani , Emine Yilmaz , David Barber

We present a method for quantitative, in-depth analyses of fairness issues in AI systems with an application to credit scoring. To this aim we use BRIO, a tool for the evaluation of AI systems with respect to social unfairness and, more in…

The importance of addressing fairness and bias in artificial intelligence (AI) systems cannot be over-emphasized. Mainstream media has been awashed with news of incidents around stereotypes and other types of bias in many of these systems…

Computation and Language · Computer Science 2024-09-10 Tosin Adewumi , Lama Alkhaled , Namrata Gurung , Goya van Boven , Irene Pagliai

Group bias in natural language processing tasks manifests as disparities in system error rates across texts authorized by different demographic groups, typically disadvantaging minority groups. Dataset balancing has been shown to be…

Computation and Language · Computer Science 2022-05-17 Xudong Han , Timothy Baldwin , Trevor Cohn

The emergence and growth of research on issues of ethics in AI, and in particular algorithmic fairness, has roots in an essential observation that structural inequalities in society are reflected in the data used to train predictive models…

Computers and Society · Computer Science 2020-02-28 Caitlin Kuhlman , Latifa Jackson , Rumi Chunara

Teaching unbiased decision-making is crucial for addressing biased decision-making in daily life. Although both raising awareness of personal biases and providing guidance on unbiased decision-making are essential, the latter topics remains…

Human-Computer Interaction · Computer Science 2024-04-09 Mingzhe Yang , Hiromi Arai , Naomi Yamashita , Yukino Baba

Gender bias in artificial intelligence (AI) has emerged as a pressing concern with profound implications for individuals' lives. This paper presents a comprehensive survey that explores gender bias in Transformer models from a linguistic…

Computation and Language · Computer Science 2023-06-21 Praneeth Nemani , Yericherla Deepak Joel , Palla Vijay , Farhana Ferdousi Liza