中文
相关论文

相关论文: Auditing ML Models for Individual Bias and Unfairn…

200 篇论文

The growing trend of legal disputes over the unauthorized use of data in machine learning (ML) systems highlights the urgent need for reliable data-use auditing mechanisms to ensure accountability and transparency in ML. We present the…

密码学与安全 · 计算机科学 2025-09-17 Zonghao Huang , Neil Zhenqiang Gong , Michael K. Reiter

Concerns regarding fairness and bias have been raised in recent years due to the growing use of machine learning models in crucial decision-making processes, especially when it comes to delicate characteristics like gender. In order to…

机器学习 · 计算机科学 2024-08-30 Saish Shinde

Auditing the use of data in training machine-learning (ML) models is an increasingly pressing challenge, as myriad ML practitioners routinely leverage the effort of content creators to train models without their permission. In this paper,…

密码学与安全 · 计算机科学 2025-01-28 Zonghao Huang , Neil Zhenqiang Gong , Michael K. Reiter

In fairness audits, a standard objective is to detect whether a given algorithm performs substantially differently between subgroups. Properly powering the statistical analysis of such audits is crucial for obtaining informative fairness…

应用统计 · 统计学 2023-12-11 Harvineet Singh , Fan Xia , Mi-Ok Kim , Romain Pirracchio , Rumi Chunara , Jean Feng

Machine learning (ML) has become prominent in applications that directly affect people's quality of life, including in healthcare, justice, and finance. ML models have been found to exhibit discrimination based on sensitive attributes such…

机器学习 · 计算机科学 2022-05-25 Sikha Pentyala , David Melanson , Martine De Cock , Golnoosh Farnadi

Regulatory efforts to protect against algorithmic bias have taken on increased urgency with rapid advances in large language models (LLMs), which are machine learning models that can achieve performance rivaling human experts on a wide…

应用统计 · 统计学 2024-04-05 Johann D. Gaebler , Sharad Goel , Aziz Huq , Prasanna Tambe

Unintended biases in machine learning (ML) models are among the major concerns that must be addressed to maintain public trust in ML. In this paper, we address process fairness of ML models that consists in reducing the dependence of models…

机器学习 · 计算机科学 2021-08-06 Guilherme Alves , Maxime Amblard , Fabien Bernier , Miguel Couceiro , Amedeo Napoli

Group fairness metrics can detect when a deep learning model behaves differently for advantaged and disadvantaged groups, but even models that score well on these metrics can make blatantly unfair predictions. We present smooth prediction…

机器学习 · 计算机科学 2020-12-02 Ivoline C. Ngong , Krystal Maughan , Joseph P. Near

Machine learning models in high-stakes applications, such as recidivism prediction and automated personnel selection, often exhibit systematic performance disparities across sensitive subpopulations, raising critical concerns regarding…

机器学习 · 统计学 2026-02-13 Jie Tang , Chuanlong Xie , Xianli Zeng , Lixing Zhu

As artificial intelligence plays an increasingly substantial role in decisions affecting humans and society, the accountability of automated decision systems has been receiving increasing attention from researchers and practitioners.…

机器学习 · 计算机科学 2023-07-04 Furkan Gursoy , Ioannis A. Kakadiaris

Bias research in NLP seeks to analyse models for social biases, thus helping NLP practitioners uncover, measure, and mitigate social harms. We analyse the body of work that uses prompts and templates to assess bias in language models. We…

计算与语言 · 计算机科学 2023-05-23 Seraphina Goldfarb-Tarrant , Eddie Ungless , Esma Balkir , Su Lin Blodgett

Artificial intelligence systems, especially those using machine learning, are being deployed in domains from hiring to loan issuance in order to automate these complex decisions. Judging both the effectiveness and fairness of these AI…

人工智能 · 计算机科学 2025-07-04 Disa Sariola , Patrick Button , Aron Culotta , Nicholas Mattei

The rise of machine learning (ML) is accompanied by several high-profile cases that have stressed the need for fairness, accountability, explainability and trust in ML systems. The existing literature has largely focused on fully automated…

计算机与社会 · 计算机科学 2023-06-14 Bhavya Ghai

ProPublica's analysis of recidivism predictions produced by Correctional Offender Management Profiling for Alternative Sanctions (COMPAS) software tool for the task, has shown that the predictions were racially biased against African…

统计方法学 · 统计学 2019-11-26 Aria Khademi , Vasant Honavar

Fairness is steadily becoming a crucial requirement of Machine Learning (ML) systems. A particularly important notion is subgroup fairness, i.e., fairness in subgroups of individuals that are defined by more than one attributes. Identifying…

Financial institutions increasingly rely on large language models (LLMs) for high-stakes decision-making. However, these models risk perpetuating harmful biases if deployed without careful oversight. This paper investigates racial bias in…

综合经济学 · 经济学 2025-06-24 Thomas R. Cook , Sophia Kazinnik

One of the difficulties of artificial intelligence is to ensure that model decisions are fair and free of bias. In research, datasets, metrics, techniques, and tools are applied to detect and mitigate algorithmic unfairness and bias. This…

Fairness,the impartial treatment towards individuals or groups regardless of their inherent or acquired characteristics [20], is a critical challenge for the successful implementation of Artificial Intelligence (AI) in multiple fields like…

神经与进化计算 · 计算机科学 2025-05-19 Catalina M Jaramillo , Paul Squires , Julian Togelius

Recidivism prediction instruments (RPI's) provide decision makers with an assessment of the likelihood that a criminal defendant will reoffend at a future point in time. While such instruments are gaining increasing popularity across the…

应用统计 · 统计学 2017-03-02 Alexandra Chouldechova

Many ML models are opaque to humans, producing decisions too complex for humans to easily understand. In response, explainable artificial intelligence (XAI) tools that analyze the inner workings of a model have been created. Despite these…

计算机与社会 · 计算机科学 2021-06-17 Kiana Alikhademi , Brianna Richardson , Emma Drobina , Juan E. Gilbert