English
Related papers

Related papers: Applications and Challenges of Fairness APIs in Ma…

200 papers

Fairness and bias are crucial concepts in artificial intelligence, yet they are relatively ignored in machine learning applications in clinical psychiatry. We computed fairness metrics and present bias mitigation strategies using a model…

Machine Learning · Computer Science 2022-05-25 Pablo Mosteiro , Jesse Kuiper , Judith Masthoff , Floortje Scheepers , Marco Spruit

AI is increasingly playing a pivotal role in businesses and organizations, impacting the outcomes and interests of human users. Automated Machine Learning (AutoML) streamlines the machine learning model development process by automating…

Human-Computer Interaction · Computer Science 2023-12-21 Sundaraparipurnan Narayanan

Legislation and public sentiment throughout the world have promoted fairness metrics, explainability, and interpretability as prescriptions for the responsible development of ethical artificial intelligence systems. Despite the importance…

Artificial Intelligence · Computer Science 2022-03-08 Erick Galinkin

Machine Learning algorithms (ML) impact virtually every aspect of human lives and have found use across diverse sectors including healthcare, finance, and education. Often, ML algorithms have been found to exacerbate societal biases present…

Machine Learning · Computer Science 2025-06-02 Jonathan Vasquez , Carlotta Domeniconi , Huzefa Rangwala

AI systems are increasingly used in high-stakes domains such as credit rating, where fairness concerns are critical. Existing fairness assessments are typically conducted by AI experts or regulators using predefined protected attributes and…

Computers and Society · Computer Science 2026-02-10 Lin Luo , Satwik Ghanta , Yuri Nakao , Mathieu Chollet , Simone Stumpf

Artificial Intelligence has gained a lot of traction in the recent years, with machine learning notably starting to see more applications across a varied range of fields. One specific machine learning application that is of interest to us…

Software Engineering · Computer Science 2023-05-10 Teodor Rares Begu

Software systems are increasingly making decisions on behalf of humans, raising concerns about the fairness of such decisions. Such concerns are usually attributed to flaws in algorithmic design or biased data, but we argue that they are…

Software Engineering · Computer Science 2021-04-09 Ali Farahani , Liliana Pasquale , Amel Bennaceur , Thomas Welsh , Bashar Nuseibeh

Today, artificial intelligence systems driven by machine learning algorithms can be in a position to take important, and sometimes legally binding, decisions about our everyday lives. In many cases, however, these systems and their actions…

Machine Learning · Computer Science 2022-08-26 Kacper Sokol , Raul Santos-Rodriguez , Peter Flach

Background: Machine Learning (ML) systems rely on data to make predictions, the systems have many added components compared to traditional software systems such as the data processing pipeline, serving pipeline, and model training. Existing…

Software Engineering · Computer Science 2022-09-22 Tuan Dung Lai , Anj Simmons , Scott Barnett , Jean-Guy Schneider , Rajesh Vasa

Applications based on Machine Learning models have now become an indispensable part of the everyday life and the professional world. A critical question then recently arised among the population: Do algorithmic decisions convey any type of…

Machine Learning · Statistics 2020-04-07 Philippe Besse , Eustasio del Barrio , Paula Gordaliza , Jean-Michel Loubes , Laurent Risser

Face recognition systems are widely deployed in safety-critical applications, including law enforcement, yet they exhibit bias across a range of socio-demographic dimensions, such as gender and race. Conventional wisdom dictates that model…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Samuel Dooley , Rhea Sanjay Sukthanker , John P. Dickerson , Colin White , Frank Hutter , Micah Goldblum

Machine learning based systems are reaching society at large and in many aspects of everyday life. This phenomenon has been accompanied by concerns about the ethical issues that may arise from the adoption of these technologies. ML fairness…

Machine Learning · Computer Science 2021-01-01 Luca Oneto , Silvia Chiappa

The increasing use of Artificial Intelligence (AI) in critical societal domains has amplified concerns about fairness, particularly regarding unequal treatment across sensitive attributes such as race, gender, and socioeconomic status.…

Machine Learning · Computer Science 2025-12-09 Munshi Mahbubur Rahman , Shimei Pan , James R. Foulds

Bias in AI systems can lead to unfair and discriminatory outcomes, especially when left untested before deployment. Although fairness testing aims to identify and mitigate such bias, existing tools are often difficult to use, requiring…

Software Engineering · Computer Science 2025-12-08 Keeryn Johnson , Cleyton Magalhaes , Ronnie de Souza Santos

Bias and fairness risks in Large Language Models (LLMs) vary substantially across deployment contexts, yet existing approaches lack systematic guidance for selecting appropriate evaluation metrics. We present a decision framework that maps…

Computation and Language · Computer Science 2026-05-12 Dylan Bouchard

As libraries explore large language models (LLMs) for use in virtual reference services, a key question arises: Can LLMs serve all users equitably, regardless of demographics or social status? While they offer great potential for scalable…

Computation and Language · Computer Science 2025-11-24 Haining Wang , Jason Clark , Yueru Yan , Star Bradley , Ruiyang Chen , Yiqiong Zhang , Hengyi Fu , Zuoyu Tian

Mitigating social bias in large language models (LLMs) has become an increasingly important research objective. However, existing debiasing methods often incur high human and computational costs, exhibit limited effectiveness, and struggle…

Computation and Language · Computer Science 2025-06-02 Xiaoqing Cheng , Ruizhe Chen , Hongying Zan , Yuxiang Jia , Min Peng

Open-source software (OSS) is foundational to modern digital infrastructure, yet this context for group work continues to struggle to ensure sufficient contributions in many critical cases. This literature review explores how artificial…

Software Engineering · Computer Science 2026-02-10 S M Rakib UI Karim , Wenyi Lu , Sean Goggins

This survey article assesses and compares existing critiques of current fairness-enhancing technical interventions into machine learning (ML) that draw from a range of non-computing disciplines, including philosophy, feminist studies,…

Machine Learning · Computer Science 2022-05-11 Lindsay Weinberg

Ensuring fairness of machine learning systems is a human-in-the-loop process. It relies on developers, users, and the general public to identify fairness problems and make improvements. To facilitate the process we need effective, unbiased,…

Human-Computer Interaction · Computer Science 2019-01-24 Jonathan Dodge , Q. Vera Liao , Yunfeng Zhang , Rachel K. E. Bellamy , Casey Dugan