English
Related papers

Related papers: Bias Neutralization Framework: Measuring Fairness …

200 papers

Fairness AI aims to detect and alleviate bias across the entire AI development life cycle, encompassing data curation, modeling, evaluation, and deployment-a pivotal aspect of ethical AI implementation. Addressing data bias, particularly…

Machine Learning · Computer Science 2023-12-21 Christina Hastings Blow , Lijun Qian , Camille Gibson , Pamela Obiomon , Xishuang Dong

One of the difficulties of artificial intelligence is to ensure that model decisions are fair and free of bias. In research, datasets, metrics, techniques, and tools are applied to detect and mitigate algorithmic unfairness and bias. This…

Large language models (LLMs) are now widely deployed in user-facing applications, reaching hundreds of millions worldwide. As they become integrated into everyday tasks, growing reliance on their outputs raises significant concerns. In…

Computers and Society · Computer Science 2025-10-16 Robin Staab , Jasper Dekoninck , Maximilian Baader , Martin Vechev

Large language models (LLMs) have achieved impressive performance on various natural language generation tasks. Nonetheless, they suffer from generating negative and harmful contents that are biased against certain demographic groups (e.g.,…

Machine Learning · Computer Science 2024-06-05 Tianci Liu , Haoyu Wang , Shiyang Wang , Yu Cheng , Jing Gao

Many internet applications are powered by machine learned models, which are usually trained on labeled datasets obtained through either implicit / explicit user feedback signals or human judgments. Since societal biases may be present in…

Machine Learning · Computer Science 2020-08-18 Sriram Vasudevan , Krishnaram Kenthapadi

Biased AI-generated medical advice and misdiagnoses can jeopardize patient safety, making the integrity of AI in healthcare more critical than ever. As Large Language Models (LLMs) take on a growing role in medical decision-making,…

Computation and Language · Computer Science 2024-10-10 Pardis Sadat Zahraei , Zahra Shakeri

Double-blind peer review mechanism has become the skeleton of academic research across multiple disciplines including computer science, yet several studies have questioned the quality of peer reviews and raised concerns on potential biases…

Computers and Society · Computer Science 2022-11-14 Jiayao Zhang , Hongming Zhang , Zhun Deng , Dan Roth

This paper presents exploratory work on whether and to what extent biases against queer and trans people are encoded in large language models (LLMs) such as BERT. We also propose a method for reducing these biases in downstream tasks:…

Computation and Language · Computer Science 2022-07-11 Virginia K. Felkner , Ho-Chun Herbert Chang , Eugene Jang , Jonathan May

Large Language Models (LLMs) are increasingly deployed in critical domains, yet they often exhibit biases inherited from training data, leading to fairness concerns. This work focuses on the problem of effectively detecting fairness…

Software Engineering · Computer Science 2025-06-04 Madhusudan Srinivasan , Jubril Abdel

Large language models (LLMs) have achieved impressive performance, leading to their widespread adoption as decision-support tools in resource-constrained contexts like hiring and admissions. There is, however, scientific consensus that AI…

Large language models (LLMs) have emerged as a powerful technology, and thus, we have seen widespread adoption and use on software engineering teams. Most often, LLMs are designed as "general purpose" technologies meant to represent the…

Software Engineering · Computer Science 2025-12-08 Brittany Johnson , Erin Reddick , Angela D. R. Smith

In an era where AI-driven hiring is transforming recruitment practices, concerns about fairness and bias have become increasingly important. To explore these issues, we introduce a benchmark, FAIRE (Fairness Assessment In Resume…

Computation and Language · Computer Science 2025-04-03 Athena Wen , Tanush Patil , Ansh Saxena , Yicheng Fu , Sean O'Brien , Kevin Zhu

We present a framework for quantifying and mitigating algorithmic bias in mechanisms designed for ranking individuals, typically used as part of web-scale search and recommendation systems. We first propose complementary measures to…

Information Retrieval · Computer Science 2019-09-04 Sahin Cem Geyik , Stuart Ambler , Krishnaram Kenthapadi

The rapid advancement of Large Language Models (LLMs) has sparked intense debate regarding the prevalence of bias in these models and its mitigation. Yet, as exemplified by both results on debiasing methods in the literature and reports of…

Computation and Language · Computer Science 2024-05-14 David F. Jenny , Yann Billeter , Mrinmaya Sachan , Bernhard Schölkopf , Zhijing Jin

Existing debiasing methods inevitably make unreasonable or undesired predictions as they are designated and evaluated to achieve parity across different social groups but leave aside individual facts, resulting in modified existing…

Computation and Language · Computer Science 2024-07-02 Ruizhe Chen , Yichen Li , Zikai Xiao , Zuozhu Liu

Large Language Models (LLMs) have showcased remarkable impacts across a wide spectrum of natural language processing tasks. Fine-tuning these pretrained models on downstream datasets provides further significant performance gains; however,…

Computation and Language · Computer Science 2026-03-19 Zhikai Li , Xiaoxuan Liu , Banghua Zhu , Zhen Dong , Qingyi Gu , Kurt Keutzer

With the increasing role of Natural Language Processing (NLP) in various applications, challenges concerning bias and stereotype perpetuation are accentuated, which often leads to hate speech and harm. Despite existing studies on sexism and…

Computation and Language · Computer Science 2024-06-19 Mae Sosto , Alberto Barrón-Cedeño

Artificial Intelligence (AI) is increasingly used in hiring, with large language models (LLMs) having the potential to influence or even make hiring decisions. However, this raises pressing concerns about bias, fairness, and trust,…

Computers and Society · Computer Science 2025-08-26 Pooja S. B. Rao , Laxminarayen Nagarajan Venkatesan , Mauro Cherubini , Dinesh Babu Jayagopi

Large Vision-Language Models (LVLMs) have demonstrated outstanding performance across various multimodal tasks. However, they suffer from a problem known as language prior, where responses are generated based solely on textual patterns…

Artificial Intelligence · Computer Science 2025-02-11 Kang-il Lee , Minbeom Kim , Seunghyun Yoon , Minsung Kim , Dongryeol Lee , Hyukhun Koh , Kyomin Jung

Large Language Models are cognitively biased judges. Large Language Models (LLMs) have recently been shown to be effective as automatic evaluators with simple prompting and in-context learning. In this work, we assemble 15 LLMs of four…

Computation and Language · Computer Science 2024-09-26 Ryan Koo , Minhwa Lee , Vipul Raheja , Jong Inn Park , Zae Myung Kim , Dongyeop Kang