中文
相关论文

相关论文: Controlling Bias Exposure for Fair Interpretable P…

200 篇论文

How can we control for latent discrimination in predictive models? How can we provably remove it? Such questions are at the heart of algorithmic fairness and its impacts on society. In this paper, we define a new operational fairness…

机器学习 · 计算机科学 2019-02-25 Soheil Ghili , Ehsan Kazemi , Amin Karbasi

Language models are the new state-of-the-art natural language processing (NLP) models and they are being increasingly used in many NLP tasks. Even though there is evidence that language models are biased, the impact of that bias on the…

计算与语言 · 计算机科学 2024-04-29 Fatma Elsafoury , Stamos Katsigiannis

When trained on large, unfiltered crawls from the internet, language models pick up and reproduce all kinds of undesirable biases that can be found in the data: they often generate racist, sexist, violent or otherwise toxic language. As…

计算与语言 · 计算机科学 2021-09-10 Timo Schick , Sahana Udupa , Hinrich Schütze

Despite the rapid development and great success of machine learning models, extensive studies have exposed their disadvantage of inheriting latent discrimination and societal bias from the training data. This phenomenon hinders their…

机器学习 · 计算机科学 2021-12-30 Tianxiang Zhao , Enyan Dai , Kai Shu , Suhang Wang

Fairness is becoming a rising concern w.r.t. machine learning model performance. Especially for sensitive fields such as criminal justice and loan decision, eliminating the prediction discrimination towards a certain group of population…

机器学习 · 计算机科学 2019-09-09 Xiaoqian Wang , Heng Huang

Language models frequently inherit societal biases from their training data. Numerous techniques have been proposed to mitigate these biases during both the pre-training and fine-tuning stages. However, fine-tuning a pre-trained debiased…

计算与语言 · 计算机科学 2024-10-03 Shahed Masoudian , Markus Frohmann , Navid Rekabsaz , Markus Schedl

Debiasing language models from unwanted behaviors in Natural Language Understanding tasks is a topic with rapidly increasing interest in the NLP community. Spurious statistical correlations in the data allow models to perform shortcuts and…

计算与语言 · 计算机科学 2022-12-06 Johannes Mario Meissner , Saku Sugawara , Akiko Aizawa

Mitigating bias in training on biased datasets is an important open problem. Several techniques have been proposed, however the typical evaluation regime is very limited, considering very narrow data conditions. For instance, the effect of…

机器学习 · 计算机科学 2022-10-18 Xudong Han , Aili Shen , Trevor Cohn , Timothy Baldwin , Lea Frermann

NLU models often exploit biases to achieve high dataset-specific performance without properly learning the intended task. Recently proposed debiasing methods are shown to be effective in mitigating this tendency. However, these methods rely…

计算与语言 · 计算机科学 2020-10-14 Prasetya Ajie Utama , Nafise Sadat Moosavi , Iryna Gurevych

Fairness-aware machine learning seeks to maximise utility in generating predictions while avoiding unfair discrimination based on sensitive attributes such as race, sex, religion, etc. An important line of work in this field is enforcing…

机器学习 · 计算机科学 2022-02-24 Stelios Boulitsakis-Logothetis

Automated decision making systems are increasingly being used in real-world applications. In these systems for the most part, the decision rules are derived by minimizing the training error on the available historical data. Therefore, if…

机器学习 · 计算机科学 2018-07-31 AmirEmad Ghassami , Sajad Khodadadian , Negar Kiyavash

Removing bias while keeping all task-relevant information is challenging for fair representation learning methods since they would yield random or degenerate representations w.r.t. labels when the sensitive attributes correlate with labels.…

机器学习 · 计算机科学 2022-08-02 Yixuan Zhang , Feng Zhou , Zhidong Li , Yang Wang , Fang Chen

Societal biases present in pre-trained large language models are a critical issue as these models have been shown to propagate biases in countless downstream applications, rendering them unfair towards specific groups of people. Since…

计算与语言 · 计算机科学 2023-06-08 Himanshu Thakur , Atishay Jain , Praneetha Vaddamanu , Paul Pu Liang , Louis-Philippe Morency

Previous work has examined how debiasing language models affect downstream tasks, specifically, how debiasing techniques influence task performance and whether debiased models also make impartial predictions in downstream tasks or not.…

计算与语言 · 计算机科学 2022-06-03 Sullam Jeoung , Jana Diesner

Bias in classifiers is a severe issue of modern deep learning methods, especially for their application in safety- and security-critical areas. Often, the bias of a classifier is a direct consequence of a bias in the training dataset,…

计算机视觉与模式识别 · 计算机科学 2021-03-11 Christian Reimers , Paul Bodesheim , Jakob Runge , Joachim Denzler

It is evident that deep text classification models trained on human data could be biased. In particular, they produce biased outcomes for texts that explicitly include identity terms of certain demographic groups. We refer to this type of…

计算与语言 · 计算机科学 2021-05-07 Haochen Liu , Wei Jin , Hamid Karimi , Zitao Liu , Jiliang Tang

As machine learning algorithms are increasingly deployed for high-impact automated decision making, ethical and increasingly also legal standards demand that they treat all individuals fairly, without discrimination based on their age,…

机器学习 · 计算机科学 2021-05-03 Maarten Buyl , Tijl De Bie

If our models are used in new or unexpected cases, do we know if they will make fair predictions? Previously, researchers developed ways to debias a model for a single problem domain. However, this is often not how models are trained and…

机器学习 · 计算机科学 2019-11-18 Candice Schumann , Xuezhi Wang , Alex Beutel , Jilin Chen , Hai Qian , Ed H. Chi

Generating fair and accurate predictions plays a pivotal role in deploying large language models (LLMs) in the real world. However, existing debiasing methods inevitably generate unfair or incorrect predictions as they are designed and…

计算与语言 · 计算机科学 2025-02-28 Ruizhe Chen , Yichen Li , Jianfei Yang , Joey Tianyi Zhou , Jian Wu , Zuozhu Liu

Predictive modeling is increasingly being employed to assist human decision-makers. One purported advantage of replacing human judgment with computer models in high stakes settings-- such as sentencing, hiring, policing, college admissions,…

机器学习 · 统计学 2016-10-27 Kristian Lum , James Johndrow