English
Related papers

Related papers: Uncovering Bias in Foundation Models: Impact, Test…

200 papers

Machine learning actively impacts our everyday life in almost all endeavors and domains such as healthcare, finance, and energy. As our dependence on the machine learning increases, it is inevitable that these algorithms will be used to…

Machine Learning · Computer Science 2021-02-23 Ankit Kulshrestha , Ilya Safro

With the widespread use of AI systems and applications in our everyday lives, it is important to take fairness issues into consideration while designing and engineering these types of systems. Such systems can be used in many sensitive…

Machine Learning · Computer Science 2022-01-26 Ninareh Mehrabi , Fred Morstatter , Nripsuta Saxena , Kristina Lerman , Aram Galstyan

Rapid advancements of large language models (LLMs) have enabled the processing, understanding, and generation of human-like text, with increasing integration into systems that touch our social sphere. Despite this success, these models can…

Computation and Language · Computer Science 2024-07-16 Isabel O. Gallegos , Ryan A. Rossi , Joe Barrow , Md Mehrab Tanjim , Sungchul Kim , Franck Dernoncourt , Tong Yu , Ruiyi Zhang , Nesreen K. Ahmed

Foundation models pretrained on physiological data such as photoplethysmography (PPG) signals are increasingly used to improve heart rate (HR) prediction across diverse settings. Fine-tuning these models for local deployment is often seen…

Machine Learning · Computer Science 2025-09-23 Lovely Yeswanth Panchumarthi , Saurabh Kataria , Yi Wu , Xiao Hu , Alex Fedorov , Hyunjung Gloria Kwak

With the aim of studying how current multimodal AI algorithms based on heterogeneous sources of information are affected by sensitive elements and inner biases in the data, this demonstrator experiments over an automated recruitment testbed…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Alejandro Peña , Ignacio Serna , Aythami Morales , Julian Fierrez

The escalating integration of machine learning in high-stakes fields such as healthcare raises substantial concerns about model fairness. We propose an interpretable framework - Fairness-Aware Interpretable Modeling (FAIM), to improve model…

Machine Learning · Computer Science 2024-03-11 Mingxuan Liu , Yilin Ning , Yuhe Ke , Yuqing Shang , Bibhas Chakraborty , Marcus Eng Hock Ong , Roger Vaughan , Nan Liu

Machine learning methods based on AdaBoost have been widely applied to various classification problems across many mission-critical applications including healthcare, law and finance. However, there is a growing concern about the unfairness…

Machine Learning · Computer Science 2024-01-09 Xiaobin Song , Zeyuan Liu , Benben Jiang

Understanding and removing bias from the decisions made by machine learning models is essential to avoid discrimination against unprivileged groups. Despite recent progress in algorithmic fairness, there is still no clear answer as to which…

A central goal of algorithmic fairness is to reduce bias in automated decision making. An unavoidable tension exists between accuracy gains obtained by using sensitive information (e.g., gender or ethnic group) as part of a statistical…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Amon Elders , Massimiliano Pontil

Face recognition and verification are two computer vision tasks whose performance has progressed with the introduction of deep representations. However, ethical, legal, and technical challenges due to the sensitive character of face data…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Alexandre Fournier-Montgieux , Michael Soumm , Adrian Popescu , Bertrand Luvison , Hervé Le Borgne

The increasing application of Artificial Intelligence and Machine Learning models poses potential risks of unfair behavior and, in light of recent regulations, has attracted the attention of the research community. Several researchers…

Machine Learning · Computer Science 2023-02-17 Giandomenico Cornacchia , Vito Walter Anelli , Fedelucio Narducci , Azzurra Ragone , Eugenio Di Sciascio

Fairness has been a critical issue that affects the adoption of deep learning models in real practice. To improve model fairness, many existing methods have been proposed and evaluated to be effective in their own contexts. However, there…

Machine Learning · Computer Science 2024-03-26 Junjie Yang , Jiajun Jiang , Zeyu Sun , Junjie Chen

Fairness AI aims to detect and alleviate bias across the entire AI development life cycle, encompassing data curation, modeling, evaluation, and deployment-a pivotal aspect of ethical AI implementation. Addressing data bias, particularly…

Machine Learning · Computer Science 2023-12-21 Christina Hastings Blow , Lijun Qian , Camille Gibson , Pamela Obiomon , Xishuang Dong

This paper investigates the parameter space of machine learning (ML) algorithms in aggravating or mitigating fairness bugs. Data-driven software is increasingly applied in social-critical applications where ensuring fairness is of paramount…

Software Engineering · Computer Science 2022-02-15 Saeid Tizpaz-Niari , Ashish Kumar , Gang Tan , Ashutosh Trivedi

As Large Language Models (LLMs) have risen in prominence over the past few years, there has been concern over the potential biases in LLMs inherited from the training data. Previous studies have examined how LLMs exhibit implicit bias, such…

Computation and Language · Computer Science 2025-12-30 Lake Yin , Fan Huang

The growing capability and accessibility of machine learning has led to its application to many real-world domains and data about people. Despite the benefits algorithmic systems may bring, models can reflect, inject, or exacerbate implicit…

Machine Learning · Computer Science 2021-10-28 Ángel Alexander Cabrera , Will Epperson , Fred Hohman , Minsuk Kahng , Jamie Morgenstern , Duen Horng Chau

Machine learning models are vulnerable to biases that result in unfair treatment of individuals from different populations. Recent work that aims to test a model's fairness at the individual level either relies on domain knowledge to choose…

Machine Learning · Statistics 2022-10-13 Giuseppe Castiglione , Ga Wu , Christopher Srinivasa , Simon Prince

Fairness in deep learning models trained with high-dimensional inputs and subjective labels remains a complex and understudied area. Facial emotion recognition, a domain where datasets are often racially imbalanced, can lead to models that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Alex Fan , Xingshuo Xiao , Peter Washington

The presence of decision-making algorithms in society is rapidly increasing nowadays, while concerns about their transparency and the possibility of these algorithms becoming new sources of discrimination are arising. In fact, many relevant…

Computer Vision and Pattern Recognition · Computer Science 2020-04-16 Alejandro Peña , Ignacio Serna , Aythami Morales , Julian Fierrez

Ensuring fairness in transaction fraud detection models is vital due to the potential harms and legal implications of biased decision-making. Despite extensive research on algorithmic fairness, there is a notable gap in the study of bias in…

Machine Learning · Computer Science 2024-09-09 Parameswaran Kamalaruban , Yulu Pi , Stuart Burrell , Eleanor Drage , Piotr Skalski , Jason Wong , David Sutton