English
Related papers

Related papers: LiFT: A Scalable Framework for Measuring Fairness …

200 papers

Bias and fairness risks in Large Language Models (LLMs) vary substantially across deployment contexts, yet existing approaches lack systematic guidance for selecting appropriate evaluation metrics. We present a decision framework that maps…

Computation and Language · Computer Science 2026-05-12 Dylan Bouchard

The potential for machine learning (ML) systems to amplify social inequities and unfairness is receiving increasing popular and academic attention. A surge of recent work has focused on the development of algorithmic tools to assess and…

Human-Computer Interaction · Computer Science 2019-01-09 Kenneth Holstein , Jennifer Wortman Vaughan , Hal Daumé , Miro Dudík , Hanna Wallach

NLP models often rely on superficial cues known as dataset biases to achieve impressive performance, and can fail on examples where these biases do not hold. Recent work sought to develop robust, unbiased models by filtering biased examples…

Computation and Language · Computer Science 2023-05-31 Yuval Reif , Roy Schwartz

Machine Learning (ML) systems are increasingly used to support decision-making processes that affect individuals. However, these systems often rely on biased data, which can lead to unfair outcomes against specific groups. With the growing…

Machine Learning · Computer Science 2026-04-14 Joana Simões , João Correia

Large Language Models (LLMs) are increasingly used for recommendation tasks due to their general-purpose capabilities. While LLMs perform well in rich-context settings, their behavior in cold-start scenarios, where only limited signals such…

Information Retrieval · Computer Science 2025-09-09 Alexandre Andre , Gauthier Roy , Eva Dyer , Kai Wang

The integration of Large Language Models (LLMs) into various software applications raises concerns about their potential biases. Typically, those models are trained on a vast amount of data scrapped from forums, websites, social media and…

Software Engineering · Computer Science 2025-07-24 Sergio Morales , Robert Clarisó , Jordi Cabot

Data collected in the real world often encapsulates historical discrimination against disadvantaged groups and individuals. Existing fair machine learning (FairML) research has predominantly focused on mitigating discriminative bias in the…

Machine Learning · Computer Science 2024-06-19 Zhining Liu , Ruizhong Qiu , Zhichen Zeng , Yada Zhu , Hendrik Hamann , Hanghang Tong

While algorithmic fairness is a thriving area of research, in practice, mitigating issues of bias often gets reduced to enforcing an arbitrarily chosen fairness metric, either by enforcing fairness constraints during the optimization step,…

Machine Learning · Computer Science 2023-10-02 Emily Black , Rakshit Naidu , Rayid Ghani , Kit T. Rodolfa , Daniel E. Ho , Hoda Heidari

As machine learning (ML) systems increasingly shape access to credit, jobs, and other opportunities, the fairness of algorithmic decisions has become a central concern. Yet it remains unclear when enforcing fairness constraints in these…

Machine Learning · Statistics 2026-03-10 Yi Yang , Xiangyu Chang , Pei-yu Chen

The need to assess LLMs for bias and fairness is critical, with current evaluations often being narrow, missing a broad categorical view. In this paper, we propose evaluating the bias and fairness of LLMs from a group fairness lens using a…

Computation and Language · Computer Science 2025-12-04 Guanqun Bi , Yuqiang Xie , Lei Shen , Yanan Cao

As Large Language Models (LLMs) have risen in prominence over the past few years, there has been concern over the potential biases in LLMs inherited from the training data. Previous studies have examined how LLMs exhibit implicit bias, such…

Computation and Language · Computer Science 2025-12-30 Lake Yin , Fan Huang

The widespread adoption of large language models (LLMs) underscores the urgent need to ensure their fairness. However, LLMs frequently present dominant viewpoints while ignoring alternative perspectives from minority parties, resulting in…

Computation and Language · Computer Science 2024-02-20 Tianlin Li , Xiaoyu Zhang , Chao Du , Tianyu Pang , Qian Liu , Qing Guo , Chao Shen , Yang Liu

Unintended biases in machine learning (ML) models are among the major concerns that must be addressed to maintain public trust in ML. In this paper, we address process fairness of ML models that consists in reducing the dependence of models…

Machine Learning · Computer Science 2021-08-06 Guilherme Alves , Maxime Amblard , Fabien Bernier , Miguel Couceiro , Amedeo Napoli

Machine learning models built on datasets containing discriminative instances attributed to various underlying factors result in biased and unfair outcomes. It's a well founded and intuitive fact that existing bias mitigation strategies…

Machine Learning · Computer Science 2022-10-25 Bhushan Chaudhari , Akash Agarwal , Tanmoy Bhowmik

Graphs are mathematical tools that can be used to represent complex real-world systems, such as financial markets and social networks. Hence, machine learning (ML) over graphs has attracted significant attention recently. However, it has…

Machine Learning · Computer Science 2023-03-22 O. Deniz Kose , Yanning Shen , Gonzalo Mateos

While the need for well-trained, fair ML systems is increasing ever more, measuring fairness for modern models and datasets is becoming increasingly difficult as they grow at an unprecedented pace. One key challenge in scaling common…

Artificial Intelligence · Computer Science 2022-01-19 Alex Bäuerle , Aybuke Gul Turker , Ken Burke , Osman Aka , Timo Ropinski , Christina Greer , Mani Varadarajan

Large Language Models (LLMs) have demonstrated remarkable success across various domains but often lack fairness considerations, potentially leading to discriminatory outcomes against marginalized populations. Unlike fairness in traditional…

Computation and Language · Computer Science 2024-08-09 Thang Doan Viet , Zichong Wang , Minh Nhat Nguyen , Wenbin Zhang

Although several fairness definitions and bias mitigation techniques exist in the literature, all existing solutions evaluate fairness of Machine Learning (ML) systems after the training stage. In this paper, we take the first steps towards…

Machine Learning · Computer Science 2024-01-17 Arumoy Shome , Luis Cruz , Arie van Deursen

Large Language Models (LLMs) have demonstrated remarkable success across various domains. However, despite their promising performance in numerous real-world applications, most of these algorithms lack fairness considerations. Consequently,…

Computation and Language · Computer Science 2024-12-20 Zhibo Chu , Zichong Wang , Wenbin Zhang

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

Machine Learning · Statistics 2026-04-21 Yixiao Lin , James Booth