English
Related papers

Related papers: Uncovering Bias in Foundation Models: Impact, Test…

200 papers

The increasing amount of applications of Artificial Intelligence (AI) has led researchers to study the social impact of these technologies and evaluate their fairness. Unfortunately, current fairness metrics are hard to apply in multi-class…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Iris Dominguez-Catena , Daniel Paternain , Mikel Galar

Concerns regarding fairness and bias have been raised in recent years due to the growing use of machine learning models in crucial decision-making processes, especially when it comes to delicate characteristics like gender. In order to…

Machine Learning · Computer Science 2024-08-30 Saish Shinde

Fairness in artificial intelligence and machine learning (AI/ML) models is becoming critically important, especially as decisions made by these systems impact diverse groups. In education, a vital sector for all countries, the widespread…

Machine Learning · Computer Science 2024-10-10 Nga Pham , Minh Kha Do , Tran Vu Dai , Pham Ngoc Hung , Anh Nguyen-Duc

The deep integration of foundation models (FM) with federated learning (FL) enhances personalization and scalability for diverse downstream tasks, making it crucial in sensitive domains like healthcare. Achieving group fairness has become…

Machine Learning · Computer Science 2025-06-24 Yuning Yang , Han Yu , Tianrun Gao , Xiaodong Xu , Guangyu Wang

In recent years, the integration of multimodal machine learning in wellbeing assessment has offered transformative potential for monitoring mental health. However, with the rapid advancement of Vision-Language Models (VLMs), their…

Artificial Intelligence · Computer Science 2026-04-28 Sophie Chiang , Tom Brennan , Fethiye Irmak Dogan , Jiaee Cheong , Hatice Gunes

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

Machine Learning · Statistics 2026-04-21 Yixiao Lin , James Booth

Although many fairness criteria have been proposed to ensure that machine learning algorithms do not exhibit or amplify our existing social biases, these algorithms are trained on datasets that can themselves be statistically biased. In…

Machine Learning · Computer Science 2023-05-04 Yiqiao Liao , Parinaz Naghizadeh

As Machine Learning technologies become increasingly used in contexts that affect citizens, companies as well as researchers need to be confident that their application of these methods will not have unexpected social implications, such as…

Machine Learning · Computer Science 2025-03-06 Simon Caton , Christian Haas

Traditional deep learning (DL) models have two ubiquitous limitations. First, they assume training samples are independent and identically distributed (i.i.d), an assumption often violated in real-world datasets where samples have…

Machine Learning · Computer Science 2024-12-31 Son Nguyen , Adam Wang , Albert Montillo

Numerous studies have shown that machine learning algorithms can latch onto protected attributes such as race and gender and generate predictions that systematically discriminate against one or more groups. To date the majority of bias and…

Machine Learning · Computer Science 2022-05-18 Matheus Schmitz , Rehan Ahmed , Jimi Cao

Audio deepfake detection systems are increasingly deployed in high-stakes security applications, yet their fairness across demographic groups remains critically underexamined. Prior work measures gender disparity but does not investigate…

Sound · Computer Science 2026-05-12 Aishwarya Fursule , Shruti Kshirsagar , Anderson R. Avila

Training models with robust group fairness properties is crucial in ethically sensitive application areas such as medical diagnosis. Despite the growing body of work aiming to minimise demographic bias in AI, this problem remains…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Raman Dutt , Ondrej Bohdal , Sotirios A. Tsaftaris , Timothy Hospedales

Face recognition systems are widely deployed in safety-critical applications, including law enforcement, yet they exhibit bias across a range of socio-demographic dimensions, such as gender and race. Conventional wisdom dictates that model…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Samuel Dooley , Rhea Sanjay Sukthanker , John P. Dickerson , Colin White , Frank Hutter , Micah Goldblum

Machine learning models are extensively being used to make decisions that have a significant impact on human life. These models are trained over historical data that may contain information about sensitive attributes such as race, sex,…

Machine Learning · Computer Science 2020-10-22 Ramanujam Madhavan , Mohit Wadhwa

This work describes a large-scale analysis of sentiment associations in popular word embedding models along the lines of gender and ethnicity but also along the less frequently studied dimensions of socioeconomic status, age, sexual…

Computers and Society · Computer Science 2020-07-01 David Rozado

Although significant progress has been made in face recognition, demographic bias still exists in face recognition systems. For instance, it usually happens that the face recognition performance for a certain demographic group is lower than…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Fu-En Wang , Chien-Yi Wang , Min Sun , Shang-Hong Lai

Although Vision-Language Models (VLMs) have achieved remarkable success, the knowledge mechanisms underlying their social biases remain a black box, where fairness- and ethics-related problems harm certain groups of people in society. It is…

Computation and Language · Computer Science 2026-02-12 Jian Lan , Udo Schlegel , Tanveer Hannan , Gengyuan Zhang , Haokun Chen , Thomas Seidl

In this paper, we introduce FairSense-AI: a multimodal framework designed to detect and mitigate bias in both text and images. By leveraging Large Language Models (LLMs) and Vision-Language Models (VLMs), FairSense-AI uncovers subtle forms…

Computation and Language · Computer Science 2025-03-06 Shaina Raza , Mukund Sayeeganesh Chettiar , Matin Yousefabadi , Tahniat Khan , Marcelo Lotif

Machine learning models are increasingly used in critical decision-making applications. However, these models are susceptible to replicating or even amplifying bias present in real-world data. While there are various bias mitigation methods…

Machine Learning · Computer Science 2024-01-05 Shih-Chi Ma , Tatiana Ermakova , Benjamin Fabian

To ensure unbiased and ethical automated predictions, fairness must be a core principle in machine learning applications. Fairness in machine learning aims to mitigate biases present in the training data and model imperfections that could…

Machine Learning · Computer Science 2024-12-03 Jan Pablo Burgard , João Vitor Pamplona