English
Related papers

Related papers: Evaluating Fairness Using Permutation Tests

200 papers

An increasing awareness of biased patterns in natural language processing resources, like BERT, has motivated many metrics to quantify `bias' and `fairness'. But comparing the results of different metrics and the works that evaluate with…

Computation and Language · Computer Science 2021-12-15 Pieter Delobelle , Ewoenam Kwaku Tokpo , Toon Calders , Bettina Berendt

With the rapid growth in language processing applications, fairness has emerged as an important consideration in data-driven solutions. Although various fairness definitions have been explored in the recent literature, there is lack of…

Machine Learning · Computer Science 2022-03-17 Satyapriya Krishna , Rahul Gupta , Apurv Verma , Jwala Dhamala , Yada Pruksachatkun , Kai-Wei Chang

The analysis of discrimination has long interested economists and lawyers. In recent years, the literature in computer science and machine learning has become interested in the subject, offering an interesting re-reading of the topic. These…

Econometrics · Economics 2022-12-21 Arthur Charpentier

This research seeks to benefit the software engineering society by proposing comparative separation, a novel group fairness notion to evaluate the fairness of machine learning software on comparative judgment test data. Fairness issues have…

Software Engineering · Computer Science 2026-01-13 Xiaoyin Xi , Neeku Capak , Kate Stockwell , Zhe Yu

Despite the rapid development and great success of machine learning models, extensive studies have exposed their disadvantage of inheriting latent discrimination and societal bias from the training data. This phenomenon hinders their…

Machine Learning · Computer Science 2021-12-30 Tianxiang Zhao , Enyan Dai , Kai Shu , Suhang Wang

With the growing utilization of machine learning in healthcare, there is increasing potential to enhance healthcare outcomes. However, this also brings the risk of perpetuating biases in data and model design that can harm certain…

Machine Learning · Computer Science 2023-08-15 Shaina Raza , Parisa Osivand Pour , Syed Raza Bashir

Deep generative models have made much progress in improving training stability and quality of generated data. Recently there has been increased interest in the fairness of deep-generated data. Fairness is important in many applications,…

Machine Learning · Computer Science 2021-07-19 Christopher T. H Teo , Ngai-Man Cheung

Mitigating bias in training on biased datasets is an important open problem. Several techniques have been proposed, however the typical evaluation regime is very limited, considering very narrow data conditions. For instance, the effect of…

Machine Learning · Computer Science 2022-10-18 Xudong Han , Aili Shen , Trevor Cohn , Timothy Baldwin , Lea Frermann

The effectiveness of machine learning in evaluating the creditworthiness of loan applicants has been demonstrated for a long time. However, there is concern that the use of automated decision-making processes may result in unequal treatment…

Machine Learning · Computer Science 2023-06-23 Darie Moldovan

Optimizing prediction accuracy can come at the expense of fairness. Towards minimizing discrimination against a group, fair machine learning algorithms strive to equalize the behavior of a model across different groups, by imposing a…

Machine Learning · Statistics 2020-06-17 Hongyan Chang , Ta Duy Nguyen , Sasi Kumar Murakonda , Ehsan Kazemi , Reza Shokri

Ensuring long-term fairness is crucial when developing automated decision making systems, specifically in dynamic and sequential environments. By maximizing their reward without consideration of fairness, AI agents can introduce disparities…

Machine Learning · Computer Science 2025-01-03 Sahand Rezaei-Shoshtari , Hanna Yurchyk , Scott Fujimoto , Doina Precup , David Meger

Fine-tuning pre-trained models is a widely employed technique in numerous real-world applications. However, fine-tuning these models on new tasks can lead to unfair outcomes. This is due to the absence of generalization guarantees for…

Machine Learning · Computer Science 2024-03-04 Yixuan Zhang , Feng Zhou

In a world of daily emerging scientific inquisition and discovery, the prolific launch of machine learning across industries comes to little surprise for those familiar with the potential of ML. Neither so should the congruent expansion of…

Artificial Intelligence · Computer Science 2021-12-13 Brianna Richardson , Juan E. Gilbert

We provide a psychometric-grounded exposition of bias and fairness as applied to a typical machine learning pipeline for affective computing. We expand on an interpersonal communication framework to elucidate how to identify sources of bias…

Machine Learning · Computer Science 2023-05-05 Brandon M Booth , Louis Hickman , Shree Krishna Subburaj , Louis Tay , Sang Eun Woo , Sidney K. DMello

Algorithmic decision making systems are ubiquitous across a wide variety of online as well as offline services. These systems rely on complex learning methods and vast amounts of data to optimize the service functionality, satisfaction of…

Machine Learning · Statistics 2017-03-27 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi

Artificial Intelligence (AI) has demonstrated remarkable capabilities in domains such as recruitment, finance, healthcare, and the judiciary. However, biases in AI systems raise ethical and societal concerns, emphasizing the need for…

Accurately measuring discrimination is crucial to faithfully assessing fairness of trained machine learning (ML) models. Any bias in measuring discrimination leads to either amplification or underestimation of the existing disparity.…

Machine Learning · Computer Science 2025-03-25 Sami Zhioua , Ruta Binkyte , Ayoub Ouni , Farah Barika Ktata

The increasing use of Machine Learning (ML) software can lead to unfair and unethical decisions, thus fairness bugs in software are becoming a growing concern. Addressing these fairness bugs often involves sacrificing ML performance, such…

Software Engineering · Computer Science 2026-03-17 Zichong Wang , Yang Zhou , David Lo , Wenbin Zhang

With AI systems widely applied to assist humans in decision-making processes such as talent hiring, school admission, and loan approval; there is an increasing need to ensure that the decisions made are fair. One major challenge for…

Machine Learning · Computer Science 2026-05-05 Zhe Yu , Xiaoyin Xi , Pranam Prakash Shetty

Deep learning is increasingly being used in high-stake decision making applications that affect individual lives. However, deep learning models might exhibit algorithmic discrimination behaviors with respect to protected groups, potentially…

Machine Learning · Computer Science 2020-03-20 Mengnan Du , Fan Yang , Na Zou , Xia Hu