English
Related papers

Related papers: Metrics for Dataset Demographic Bias: A Case Study…

200 papers

While machine learning approaches to visual emotion recognition offer great promise, current methods consider training and testing models on small scale datasets covering limited visual emotion concepts. Our analysis identifies an important…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Rameswar Panda , Jianming Zhang , Haoxiang Li , Joon-Young Lee , Xin Lu , Amit K. Roy-Chowdhury

Introduction: Healthcare AI models often inherit biases from their training data. While efforts have primarily targeted bias in structured data, mental health heavily depends on unstructured data. This study aims to detect and mitigate…

While extremely useful (e.g., for COVID-19 forecasting and policy-making, urban mobility analysis and marketing, and obtaining business insights), location data collected from mobile devices often contain data from a biased population…

Machine Learning · Computer Science 2024-02-20 Sepanta Zeighami , Cyrus Shahabi

The significant advancements in applying Artificial Intelligence (AI) to healthcare decision-making, medical diagnosis, and other domains have simultaneously raised concerns about the fairness and bias of AI systems. This is particularly…

Computers and Society · Computer Science 2024-01-30 Emilio Ferrara

We investigate the prominent class of fair representation learning methods for bias mitigation. Using causal reasoning to define and formalise different sources of dataset bias, we reveal important implicit assumptions inherent to these…

Machine Learning · Computer Science 2025-02-11 Charles Jones , Fabio de Sousa Ribeiro , Mélanie Roschewitz , Daniel C. Castro , Ben Glocker

Human biases have been shown to influence the performance of models and algorithms in various fields, including Natural Language Processing. While the study of this phenomenon is garnering focus in recent years, the available resources are…

Computation and Language · Computer Science 2024-08-15 Ana Sofia Evans , Helena Moniz , Luísa Coheur

Artificial intelligence (AI) models are increasingly autonomous in decision-making, making pursuing responsible AI more critical than ever. Responsible AI (RAI) is defined by its commitment to transparency, privacy, safety, inclusiveness,…

Computers and Society · Computer Science 2025-01-28 Gemma Galdon Clavell , Rubén González-Sendino , Paola Vazquez

In medical image analysis, model predictions can be affected by sensitive attributes, such as race and gender, leading to fairness concerns and potential biases in diagnostic outcomes. To mitigate this, we present a causal modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Bowei Tian , Yexiao He , Meng Liu , Yucong Dai , Ziyao Wang , Shwai He , Guoheng Sun , Zheyu Shen , Wanghao Ye , Yongkai Wu , Ang Li

Despite the progress made in deepfake detection research, recent studies have shown that biases in the training data for these detectors can result in varying levels of performance across different demographic groups, such as race and…

Machine Learning · Computer Science 2025-01-03 Uzoamaka Ezeakunne , Chrisantus Eze , Xiuwen Liu

Motivated by the recital (67) of the current corrigendum of the AI Act in the European Union, we propose and present measures and mitigation strategies for discrimination in tabular datasets. We specifically focus on datasets that contain…

Machine Learning · Computer Science 2024-11-05 Manh Khoi Duong , Stefan Conrad

Predictive artificial intelligence (AI) offers an opportunity to improve clinical practice and patient outcomes, but risks perpetuating biases if fairness is inadequately addressed. However, the definition of "fairness" remains unclear. We…

As machine learning systems become increasingly integrated into human-centered domains such as healthcare, ensuring fairness while maintaining high predictive performance is critical. Existing bias mitigation techniques often impose a…

Machine Learning · Computer Science 2025-11-11 Xuwei Tan , Yuanlong Wang , Thai-Hoang Pham , Ping Zhang , Xueru Zhang

Recent advancements in GANs and diffusion models have enabled the creation of high-resolution, hyper-realistic images. However, these models may misrepresent certain social groups and present bias. Understanding bias in these models remains…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Cristian Muñoz , Sara Zannone , Umar Mohammed , Adriano Koshiyama

A significant level of stigma and inequality exists in mental healthcare, especially in under-served populations. Inequalities are reflected in the data collected for scientific purposes. When not properly accounted for, machine learning…

Fairness in artificial intelligence (AI) has become a growing concern due to discriminatory outcomes in AI-based decision-making systems. While various methods have been proposed to mitigate bias, most rely on complete demographic…

Computers and Society · Computer Science 2025-11-18 Zichong Wang , Zhipeng Yin , Roland H. C. Yap , Wenbin Zhang

We present a novel approach to mitigate bias in facial expression recognition (FER) models. Our method aims to reduce sensitive attribute information such as gender, age, or race, in the embeddings produced by FER models. We employ a kernel…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Mojtaba Kolahdouzi , Ali Etemad

Large-scale human mobility datasets play increasingly critical roles in many algorithmic systems, business processes and policy decisions. Unfortunately there has been little focus on understanding bias and other fundamental shortcomings of…

Computers and Society · Computer Science 2025-08-04 Katinka den Nijs , Elisa Omodei , Vedran Sekara

Applications based on Machine Learning models have now become an indispensable part of the everyday life and the professional world. A critical question then recently arised among the population: Do algorithmic decisions convey any type of…

Machine Learning · Statistics 2020-04-07 Philippe Besse , Eustasio del Barrio , Paula Gordaliza , Jean-Michel Loubes , Laurent Risser

Multimodal Large Language Models (MLLMs) have recently been explored as face verification systems that determine whether two face images are of the same person. Unlike dedicated face recognition systems, MLLMs approach this task through…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Ünsal Öztürk , Hatef Otroshi Shahreza , Sébastien Marcel

Considerable efforts to measure and mitigate gender bias in recent years have led to the introduction of an abundance of tasks, datasets, and metrics used in this vein. In this position paper, we assess the current paradigm of gender bias…

Computation and Language · Computer Science 2022-10-21 Hadas Orgad , Yonatan Belinkov