English
Related papers

Related papers: A Differentiable Distance Approximation for Fairer…

200 papers

We propose an experimental method for measuring bias in face recognition systems. Existing methods to measure bias depend on benchmark datasets that are collected in the wild and annotated for protected (e.g., race, gender) and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Hao Liang , Pietro Perona , Guha Balakrishnan

With the growing utilization of machine learning in healthcare, there is increasing potential to enhance healthcare outcomes. However, this also brings the risk of perpetuating biases in data and model design that can harm certain…

Machine Learning · Computer Science 2023-08-15 Shaina Raza , Parisa Osivand Pour , Syed Raza Bashir

Algorithmic fairness has conventionally adopted the mathematically convenient perspective of racial color-blindness (i.e., difference unaware treatment). However, we contend that in a range of important settings, group difference awareness…

Computers and Society · Computer Science 2025-08-12 Angelina Wang , Michelle Phan , Daniel E. Ho , Sanmi Koyejo

Model explanations such as saliency maps can improve user trust in AI by highlighting important features for a prediction. However, these become distorted and misleading when explaining predictions of images that are subject to systematic…

Human-Computer Interaction · Computer Science 2022-03-02 Wencan Zhang , Mariella Dimiccoli , Brian Y. Lim

Currently, there is a surge of interest in fair Artificial Intelligence (AI) and Machine Learning (ML) research which aims to mitigate discriminatory bias in AI algorithms, e.g. along lines of gender, age, and race. While most research in…

Computers and Society · Computer Science 2021-07-29 Clarice Wang , Kathryn Wang , Andrew Bian , Rashidul Islam , Kamrun Naher Keya , James Foulds , Shimei Pan

The high-quality, realistic images generated by generative models pose significant challenges for exposing them.So far, data-driven deep neural networks have been justified as the most efficient forensics tools for the challenges. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Feng Ding , Jun Zhang , Xinan He , Jianfeng Xu

Machine learning models are increasingly used in high-stakes decision-making systems. In such applications, a major concern is that these models sometimes discriminate against certain demographic groups such as individuals with certain…

Machine Learning · Computer Science 2023-06-06 Andrew Lowy , Devansh Gupta , Meisam Razaviyayn

As algorithmic decision-making systems become more prevalent in society, ensuring the fairness of these systems is becoming increasingly important. Whilst there has been substantial research in building fair algorithmic decision-making…

Machine Learning · Computer Science 2023-10-30 Madeleine Waller , Odinaldo Rodrigues , Oana Cocarascu

The performance of deep neural networks for image recognition tasks such as predicting a smiling face is known to degrade with under-represented classes of sensitive attributes. We address this problem by introducing fairness-aware…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Tobias Hänel , Nishant Kumar , Dmitrij Schlesinger , Mengze Li , Erdem Ünal , Abouzar Eslami , Stefan Gumhold

Benchmarking competitions are central to the development of artificial intelligence (AI) in medical imaging, defining performance standards and shaping methodological progress. However, it remains unclear whether these benchmarks provide…

The demographic disparity of biometric systems has led to serious concerns regarding their societal impact as well as applicability of such systems in private and public domains. A quantitative evaluation of demographic fairness is an…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ketan Kotwal , Sebastien Marcel

Generative AI, such as large language models, has undergone rapid development within recent years. As these models become increasingly available to the public, concerns arise about perpetuating and amplifying harmful biases in applications.…

Computation and Language · Computer Science 2024-09-04 Sara Sterlie , Nina Weng , Aasa Feragen

We show that deep networks trained to satisfy demographic parity often do so through a form of race or gender awareness, and that the more we force a network to be fair, the more accurately we can recover race or gender from the internal…

Machine Learning · Computer Science 2022-11-22 Michael Lohaus , Matthäus Kleindessner , Krishnaram Kenthapadi , Francesco Locatello , Chris Russell

As AI systems become more embedded in everyday life, the development of fair and unbiased models becomes more critical. Considering the social impact of AI systems is not merely a technical challenge but a moral imperative. As evidenced in…

Machine Learning · Computer Science 2025-10-03 Aida Tayebi , Ali Khodabandeh Yalabadi , Mehdi Yazdani-Jahromi , Ozlem Ozmen Garibay

Algorithms learn rules and associations based on the training data that they are exposed to. Yet, the very same data that teaches machines to understand and predict the world, contains societal and historic biases, resulting in biased…

Machine Learning · Computer Science 2021-04-08 Paul Tiwald , Alexandra Ebert , Daniel T. Soukup

Decision making in crucial applications such as lending, hiring, and college admissions has witnessed increasing use of algorithmic models and techniques as a result of a confluence of factors such as ubiquitous connectivity, ability to…

Artificial Intelligence · Computer Science 2020-09-08 G Roshan Lal , Sahin Cem Geyik , Krishnaram Kenthapadi

Fairness in machine learning seeks to mitigate model bias against individuals based on sensitive features such as sex or age, often caused by an uneven representation of the population in the training data due to selection bias. Notably,…

Machine Learning · Computer Science 2024-10-10 Yasin I. Tepeli , Joana P. Gonçalves

Unsupervised anomaly detection is a critical task in many high-social-impact applications such as finance, healthcare, social media, and cybersecurity, where demographics involving age, gender, race, disease, etc, are used frequently. In…

Machine Learning · Computer Science 2025-05-19 Feng Xiao , Xiaoying Tang , Jicong Fan

Data-driven algorithms are only as good as the data they work with, while data sets, especially social data, often fail to represent minorities adequately. Representation Bias in data can happen due to various reasons ranging from…

Databases · Computer Science 2023-03-21 Nima Shahbazi , Yin Lin , Abolfazl Asudeh , H. V. Jagadish

Machine learning models often make predictions based on biased features such as gender, race, and other social attributes, posing significant fairness risks, especially in societal applications, such as hiring, banking, and criminal…

Machine Learning · Computer Science 2024-08-28 Yi Zhang , Dongyuan Lu , Jitao Sang